[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:17:51.827652 15720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.90.62:41469
I20260709 13:17:51.829226 15720 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:17:51.830250 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:51.846939 15726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:51.846939 15727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:51.847360 15729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:51.848722 15720 server_base.cc:1061] running on GCE node
I20260709 13:17:53.038471 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:53.038724 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:53.038872 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603073038857 us; error 0 us; skew 500 ppm
I20260709 13:17:53.039651 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:53.045691 15720 webserver.cc:533] Webserver started at http://127.15.90.62:40673/ using document root <none> and password file <none>
I20260709 13:17:53.046499 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:53.046691 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:53.047071 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:53.052881 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/master-0-root/instance:
uuid: "aea36f8b429b4a08ba04eb88dacbbeb3"
format_stamp: "Formatted at 2026-07-09 13:17:53 on dist-test-slave-fpp7"
I20260709 13:17:53.060520 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:17:53.065562 15735 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.066776 15720 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:17:53.067075 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/master-0-root
uuid: "aea36f8b429b4a08ba04eb88dacbbeb3"
format_stamp: "Formatted at 2026-07-09 13:17:53 on dist-test-slave-fpp7"
I20260709 13:17:53.067358 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:53.116003 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:53.117436 15720 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:17:53.117837 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:53.189004 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.62:41469
I20260709 13:17:53.189093 15786 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.62:41469 every 8 connection(s)
I20260709 13:17:53.196638 15787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:53.217847 15787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3: Bootstrap starting.
I20260709 13:17:53.223551 15787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:53.225436 15787 log.cc:826] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3: Log is configured to *not* fsync() on all Append() calls
I20260709 13:17:53.229867 15787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3: No bootstrap required, opened a new log
I20260709 13:17:53.250732 15787 raft_consensus.cc:359] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea36f8b429b4a08ba04eb88dacbbeb3" member_type: VOTER }
I20260709 13:17:53.251334 15787 raft_consensus.cc:385] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:53.251605 15787 raft_consensus.cc:740] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aea36f8b429b4a08ba04eb88dacbbeb3, State: Initialized, Role: FOLLOWER
I20260709 13:17:53.252571 15787 consensus_queue.cc:260] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea36f8b429b4a08ba04eb88dacbbeb3" member_type: VOTER }
I20260709 13:17:53.253093 15787 raft_consensus.cc:399] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:17:53.253391 15787 raft_consensus.cc:493] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:17:53.253743 15787 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:53.257822 15787 raft_consensus.cc:515] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea36f8b429b4a08ba04eb88dacbbeb3" member_type: VOTER }
I20260709 13:17:53.258574 15787 leader_election.cc:304] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aea36f8b429b4a08ba04eb88dacbbeb3; no voters: 
I20260709 13:17:53.260339 15787 leader_election.cc:290] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:17:53.260658 15790 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:53.263371 15790 raft_consensus.cc:697] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [term 1 LEADER]: Becoming Leader. State: Replica: aea36f8b429b4a08ba04eb88dacbbeb3, State: Running, Role: LEADER
I20260709 13:17:53.264287 15790 consensus_queue.cc:237] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea36f8b429b4a08ba04eb88dacbbeb3" member_type: VOTER }
I20260709 13:17:53.265352 15787 sys_catalog.cc:565] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:17:53.275857 15791 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aea36f8b429b4a08ba04eb88dacbbeb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea36f8b429b4a08ba04eb88dacbbeb3" member_type: VOTER } }
I20260709 13:17:53.276199 15792 sys_catalog.cc:455] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aea36f8b429b4a08ba04eb88dacbbeb3. Latest consensus state: current_term: 1 leader_uuid: "aea36f8b429b4a08ba04eb88dacbbeb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aea36f8b429b4a08ba04eb88dacbbeb3" member_type: VOTER } }
I20260709 13:17:53.276726 15792 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:53.276630 15791 sys_catalog.cc:458] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:17:53.280412 15799 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:17:53.291843 15799 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:17:53.294162 15720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:17:53.307785 15799 catalog_manager.cc:1383] Generated new cluster ID: d5ba5143311d46d0a2ed154828167940
I20260709 13:17:53.308089 15799 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:17:53.330962 15799 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:17:53.332571 15799 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:17:53.352808 15799 catalog_manager.cc:6070] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3: Generated new TSK 0
I20260709 13:17:53.353717 15799 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:17:53.361056 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:53.370491 15809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:53.371979 15810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:53.374507 15812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:53.376482 15720 server_base.cc:1061] running on GCE node
I20260709 13:17:53.377254 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:53.377429 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:53.377645 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603073377631 us; error 0 us; skew 500 ppm
I20260709 13:17:53.378283 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:53.382879 15720 webserver.cc:533] Webserver started at http://127.15.90.1:35673/ using document root <none> and password file <none>
I20260709 13:17:53.383419 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:53.383623 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:53.383987 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:53.385082 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-0-root/instance:
uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
format_stamp: "Formatted at 2026-07-09 13:17:53 on dist-test-slave-fpp7"
I20260709 13:17:53.390828 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:17:53.395362 15817 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.396243 15720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:53.396541 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-0-root
uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
format_stamp: "Formatted at 2026-07-09 13:17:53 on dist-test-slave-fpp7"
I20260709 13:17:53.396808 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:53.414160 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:53.416031 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:53.419086 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:53.423715 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:53.423964 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:17:53.424249 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:53.424401 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.535349 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.1:35081
I20260709 13:17:53.535429 15879 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.1:35081 every 8 connection(s)
I20260709 13:17:53.542524 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:53.554636 15884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:53.557054 15885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:53.561200 15720 server_base.cc:1061] running on GCE node
W20260709 13:17:53.561859 15888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:53.562955 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:53.563293 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:53.563596 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603073563573 us; error 0 us; skew 500 ppm
I20260709 13:17:53.564541 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:53.571285 15720 webserver.cc:533] Webserver started at http://127.15.90.2:44417/ using document root <none> and password file <none>
I20260709 13:17:53.571254 15880 heartbeater.cc:344] Connected to a master server at 127.15.90.62:41469
I20260709 13:17:53.571987 15880 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:53.572957 15880 heartbeater.cc:507] Master 127.15.90.62:41469 requested a full tablet report, sending...
I20260709 13:17:53.574388 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:53.574652 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:53.574951 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:53.576123 15752 ts_manager.cc:194] Registered new tserver with Master: 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081)
I20260709 13:17:53.576119 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-1-root/instance:
uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
format_stamp: "Formatted at 2026-07-09 13:17:53 on dist-test-slave-fpp7"
I20260709 13:17:53.579080 15752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42368
I20260709 13:17:53.582267 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:17:53.587004 15892 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.587900 15720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:17:53.588172 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-1-root
uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
format_stamp: "Formatted at 2026-07-09 13:17:53 on dist-test-slave-fpp7"
I20260709 13:17:53.588399 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:53.609493 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:53.610770 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:53.613557 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:53.616552 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:53.616725 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.617022 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:53.617161 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.717545 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.2:43273
I20260709 13:17:53.717654 15954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.2:43273 every 8 connection(s)
I20260709 13:17:53.726261 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:17:53.733454 15958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:17:53.736117 15959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:53.738516 15720 server_base.cc:1061] running on GCE node
W20260709 13:17:53.739420 15961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:17:53.740546 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:17:53.740805 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:17:53.740996 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603073740981 us; error 0 us; skew 500 ppm
I20260709 13:17:53.741681 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:17:53.742266 15955 heartbeater.cc:344] Connected to a master server at 127.15.90.62:41469
I20260709 13:17:53.742609 15955 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:53.743463 15955 heartbeater.cc:507] Master 127.15.90.62:41469 requested a full tablet report, sending...
I20260709 13:17:53.744485 15720 webserver.cc:533] Webserver started at http://127.15.90.3:44731/ using document root <none> and password file <none>
I20260709 13:17:53.745131 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:17:53.745369 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:17:53.745532 15752 ts_manager.cc:194] Registered new tserver with Master: 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:53.745675 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:17:53.746861 15752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42384
I20260709 13:17:53.747191 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-2-root/instance:
uuid: "7593f8411564499b93f419c5b932bd54"
format_stamp: "Formatted at 2026-07-09 13:17:53 on dist-test-slave-fpp7"
I20260709 13:17:53.752817 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:17:53.757115 15966 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.757964 15720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:17:53.758288 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-2-root
uuid: "7593f8411564499b93f419c5b932bd54"
format_stamp: "Formatted at 2026-07-09 13:17:53 on dist-test-slave-fpp7"
I20260709 13:17:53.758638 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783603071664575-15720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:17:53.777992 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:17:53.779640 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:17:53.781231 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:17:53.784011 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:17:53.784260 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.784610 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:17:53.784825 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:17:53.868491 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.3:36689
I20260709 13:17:53.868542 16028 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.3:36689 every 8 connection(s)
I20260709 13:17:53.885766 16029 heartbeater.cc:344] Connected to a master server at 127.15.90.62:41469
I20260709 13:17:53.886173 16029 heartbeater.cc:461] Registering TS with master...
I20260709 13:17:53.887104 16029 heartbeater.cc:507] Master 127.15.90.62:41469 requested a full tablet report, sending...
I20260709 13:17:53.889170 15752 ts_manager.cc:194] Registered new tserver with Master: 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:53.890173 15720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016192622s
I20260709 13:17:53.890563 15752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42388
I20260709 13:17:53.940797 15752 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42392:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:17:53.944303 15752 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:17:54.049719 15845 tablet_service.cc:1511] Processing CreateTablet for tablet 62e48b640b0e42b19311687d79f68f95 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:54.050768 15842 tablet_service.cc:1511] Processing CreateTablet for tablet a78c4e4394894eefa95c0bf1627fcdf9 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:54.049156 15844 tablet_service.cc:1511] Processing CreateTablet for tablet 796ca746f0584355aa2b9dcb5b4d3faa (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:54.052477 15845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e48b640b0e42b19311687d79f68f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.049016 15843 tablet_service.cc:1511] Processing CreateTablet for tablet fba3dfa569214f848ebec392e46aa045 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:54.057771 15844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796ca746f0584355aa2b9dcb5b4d3faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.060527 15841 tablet_service.cc:1511] Processing CreateTablet for tablet ca501d788d864a278a1fbb9f7ea000d1 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:54.064136 15837 tablet_service.cc:1511] Processing CreateTablet for tablet 91a8788d489444fe98326d4ea14fcdc4 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:54.063211 15842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78c4e4394894eefa95c0bf1627fcdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.060590 15839 tablet_service.cc:1511] Processing CreateTablet for tablet 220fc6b52d1f4729a208ff1c73c0eca6 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:54.059963 15840 tablet_service.cc:1511] Processing CreateTablet for tablet a10cd7bc96b540d3b6615e11a5a86840 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:54.064257 15838 tablet_service.cc:1511] Processing CreateTablet for tablet acd3fef44c3c40818e7fa0100b880e49 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:54.073562 15837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a8788d489444fe98326d4ea14fcdc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.075160 15838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd3fef44c3c40818e7fa0100b880e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.076320 15843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba3dfa569214f848ebec392e46aa045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.078702 15839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220fc6b52d1f4729a208ff1c73c0eca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.079434 15840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10cd7bc96b540d3b6615e11a5a86840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.083813 15841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca501d788d864a278a1fbb9f7ea000d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.087270 15994 tablet_service.cc:1511] Processing CreateTablet for tablet 62e48b640b0e42b19311687d79f68f95 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:54.088371 15993 tablet_service.cc:1511] Processing CreateTablet for tablet 796ca746f0584355aa2b9dcb5b4d3faa (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:54.093581 15991 tablet_service.cc:1511] Processing CreateTablet for tablet a78c4e4394894eefa95c0bf1627fcdf9 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:54.097332 15992 tablet_service.cc:1511] Processing CreateTablet for tablet fba3dfa569214f848ebec392e46aa045 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:54.099292 15994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e48b640b0e42b19311687d79f68f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.097977 15990 tablet_service.cc:1511] Processing CreateTablet for tablet ca501d788d864a278a1fbb9f7ea000d1 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:54.115025 15988 tablet_service.cc:1511] Processing CreateTablet for tablet 220fc6b52d1f4729a208ff1c73c0eca6 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:54.115818 15992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba3dfa569214f848ebec392e46aa045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.116930 15989 tablet_service.cc:1511] Processing CreateTablet for tablet a10cd7bc96b540d3b6615e11a5a86840 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:54.123739 15987 tablet_service.cc:1511] Processing CreateTablet for tablet acd3fef44c3c40818e7fa0100b880e49 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:54.125687 15986 tablet_service.cc:1511] Processing CreateTablet for tablet 91a8788d489444fe98326d4ea14fcdc4 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:54.128551 15988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220fc6b52d1f4729a208ff1c73c0eca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.134296 15986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a8788d489444fe98326d4ea14fcdc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.135236 15989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10cd7bc96b540d3b6615e11a5a86840. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.144196 15987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd3fef44c3c40818e7fa0100b880e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.152997 15990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca501d788d864a278a1fbb9f7ea000d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.169332 15993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796ca746f0584355aa2b9dcb5b4d3faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.171715 15991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78c4e4394894eefa95c0bf1627fcdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.226016 15917 tablet_service.cc:1511] Processing CreateTablet for tablet a78c4e4394894eefa95c0bf1627fcdf9 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:17:54.229375 15916 tablet_service.cc:1511] Processing CreateTablet for tablet ca501d788d864a278a1fbb9f7ea000d1 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:17:54.232643 15915 tablet_service.cc:1511] Processing CreateTablet for tablet a10cd7bc96b540d3b6615e11a5a86840 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:17:54.236776 15919 tablet_service.cc:1511] Processing CreateTablet for tablet 796ca746f0584355aa2b9dcb5b4d3faa (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:17:54.243382 15918 tablet_service.cc:1511] Processing CreateTablet for tablet fba3dfa569214f848ebec392e46aa045 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:17:54.245224 15920 tablet_service.cc:1511] Processing CreateTablet for tablet 62e48b640b0e42b19311687d79f68f95 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:17:54.251938 15917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78c4e4394894eefa95c0bf1627fcdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.253413 15920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e48b640b0e42b19311687d79f68f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.254768 15916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca501d788d864a278a1fbb9f7ea000d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.256093 15918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba3dfa569214f848ebec392e46aa045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.257397 15915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10cd7bc96b540d3b6615e11a5a86840. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:17:54.282307 15800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:54.289439 15914 tablet_service.cc:1511] Processing CreateTablet for tablet 220fc6b52d1f4729a208ff1c73c0eca6 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:17:54.292021 15913 tablet_service.cc:1511] Processing CreateTablet for tablet acd3fef44c3c40818e7fa0100b880e49 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:17:54.294600 15912 tablet_service.cc:1511] Processing CreateTablet for tablet 91a8788d489444fe98326d4ea14fcdc4 (DEFAULT_TABLE table=test-workload [id=72c77cf3a2104d70b58adcb18755e4b0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:17:54.300545 15914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220fc6b52d1f4729a208ff1c73c0eca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.302057 15913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acd3fef44c3c40818e7fa0100b880e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.308310 15912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a8788d489444fe98326d4ea14fcdc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.312140 15919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796ca746f0584355aa2b9dcb5b4d3faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:54.395790 16047 tablet_bootstrap.cc:492] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176: Bootstrap starting.
I20260709 13:17:54.437840 16047 tablet_bootstrap.cc:654] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.458876 16048 tablet_bootstrap.cc:492] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215: Bootstrap starting.
I20260709 13:17:54.462298 16047 tablet_bootstrap.cc:492] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176: No bootstrap required, opened a new log
I20260709 13:17:54.463654 16047 ts_tablet_manager.cc:1403] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.003s
I20260709 13:17:54.464370 16049 tablet_bootstrap.cc:492] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54: Bootstrap starting.
I20260709 13:17:54.471280 16047 raft_consensus.cc:359] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.473434 16047 raft_consensus.cc:385] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.473807 16047 raft_consensus.cc:740] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.473995 16048 tablet_bootstrap.cc:654] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.474680 16047 consensus_queue.cc:260] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.477315 15880 heartbeater.cc:499] Master 127.15.90.62:41469 was elected leader, sending a full tablet report...
I20260709 13:17:54.477690 16047 ts_tablet_manager.cc:1434] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:17:54.478904 16047 tablet_bootstrap.cc:492] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176: Bootstrap starting.
I20260709 13:17:54.487160 16047 tablet_bootstrap.cc:654] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.491031 16049 tablet_bootstrap.cc:654] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.494045 16048 tablet_bootstrap.cc:492] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215: No bootstrap required, opened a new log
I20260709 13:17:54.494483 16048 ts_tablet_manager.cc:1403] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.014s
I20260709 13:17:54.497917 16048 raft_consensus.cc:359] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.498682 16048 raft_consensus.cc:385] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.498996 16048 raft_consensus.cc:740] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.499781 16048 consensus_queue.cc:260] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.504307 16047 tablet_bootstrap.cc:492] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176: No bootstrap required, opened a new log
I20260709 13:17:54.504837 16047 ts_tablet_manager.cc:1403] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.010s
I20260709 13:17:54.507597 16047 raft_consensus.cc:359] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.508316 16047 raft_consensus.cc:385] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.508625 16047 raft_consensus.cc:740] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.509325 16047 consensus_queue.cc:260] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.512907 16049 tablet_bootstrap.cc:492] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54: No bootstrap required, opened a new log
I20260709 13:17:54.513347 16049 ts_tablet_manager.cc:1403] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.008s
I20260709 13:17:54.516188 16049 raft_consensus.cc:359] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.516861 16049 raft_consensus.cc:385] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.517146 16049 raft_consensus.cc:740] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.517863 16049 consensus_queue.cc:260] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.520542 16047 ts_tablet_manager.cc:1434] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:17:54.530719 15955 heartbeater.cc:499] Master 127.15.90.62:41469 was elected leader, sending a full tablet report...
I20260709 13:17:54.531138 16049 ts_tablet_manager.cc:1434] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54: Time spent starting tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:17:54.531195 16048 ts_tablet_manager.cc:1434] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent starting tablet: real 0.036s	user 0.015s	sys 0.022s
I20260709 13:17:54.532490 16029 heartbeater.cc:499] Master 127.15.90.62:41469 was elected leader, sending a full tablet report...
I20260709 13:17:54.534040 16047 tablet_bootstrap.cc:492] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176: Bootstrap starting.
I20260709 13:17:54.534852 16048 tablet_bootstrap.cc:492] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215: Bootstrap starting.
I20260709 13:17:54.540638 16049 tablet_bootstrap.cc:492] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54: Bootstrap starting.
W20260709 13:17:54.542788 15881 tablet.cc:2406] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:17:54.542793 16056 raft_consensus.cc:493] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.544441 16056 raft_consensus.cc:515] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.549966 16048 tablet_bootstrap.cc:654] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.558109 16049 tablet_bootstrap.cc:654] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.565809 16056 leader_election.cc:290] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:54.550024 16047 tablet_bootstrap.cc:654] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.584335 16049 tablet_bootstrap.cc:492] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54: No bootstrap required, opened a new log
I20260709 13:17:54.584827 16049 ts_tablet_manager.cc:1403] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.010s
I20260709 13:17:54.592538 16048 tablet_bootstrap.cc:492] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215: No bootstrap required, opened a new log
I20260709 13:17:54.592998 16048 ts_tablet_manager.cc:1403] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.012s
I20260709 13:17:54.587569 16049 raft_consensus.cc:359] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.593564 16049 raft_consensus.cc:385] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.593852 16049 raft_consensus.cc:740] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.594650 16049 consensus_queue.cc:260] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.597083 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c4e4394894eefa95c0bf1627fcdf9" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" is_pre_election: true
I20260709 13:17:54.598460 16047 tablet_bootstrap.cc:492] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176: No bootstrap required, opened a new log
I20260709 13:17:54.598896 16049 ts_tablet_manager.cc:1434] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
W20260709 13:17:54.598868 15967 leader_election.cc:343] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.598989 16047 ts_tablet_manager.cc:1403] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.003s
I20260709 13:17:54.599968 16049 tablet_bootstrap.cc:492] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54: Bootstrap starting.
I20260709 13:17:54.600845 16051 raft_consensus.cc:493] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.601294 16051 raft_consensus.cc:515] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.606527 16051 leader_election.cc:290] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:54.607008 16048 raft_consensus.cc:359] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.609589 16048 raft_consensus.cc:385] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.613086 16048 raft_consensus.cc:740] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.602532 16047 raft_consensus.cc:359] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.613972 16047 raft_consensus.cc:385] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.614403 16047 raft_consensus.cc:740] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.615298 16047 consensus_queue.cc:260] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.616732 16049 tablet_bootstrap.cc:654] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.617913 16047 ts_tablet_manager.cc:1434] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:17:54.620986 16047 tablet_bootstrap.cc:492] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176: Bootstrap starting.
I20260709 13:17:54.621505 15930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c4e4394894eefa95c0bf1627fcdf9" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
I20260709 13:17:54.618656 16048 consensus_queue.cc:260] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.626657 16048 ts_tablet_manager.cc:1434] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:17:54.627612 16048 tablet_bootstrap.cc:492] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215: Bootstrap starting.
I20260709 13:17:54.628963 16049 tablet_bootstrap.cc:492] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54: No bootstrap required, opened a new log
I20260709 13:17:54.629393 16049 ts_tablet_manager.cc:1403] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.006s
I20260709 13:17:54.632328 16049 raft_consensus.cc:359] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.633507 16049 raft_consensus.cc:385] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.634580 16055 raft_consensus.cc:493] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:54.635802 15967 leader_election.cc:343] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.633951 16049 raft_consensus.cc:740] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.635437 16055 raft_consensus.cc:515] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.638931 16049 consensus_queue.cc:260] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.644389 16049 ts_tablet_manager.cc:1434] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:17:54.649142 16049 tablet_bootstrap.cc:492] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54: Bootstrap starting.
I20260709 13:17:54.649581 16055 leader_election.cc:290] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:54.636904 15967 leader_election.cc:304] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7593f8411564499b93f419c5b932bd54; no voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7f0edeb2a4fa4371af359d8d7a4ef176
I20260709 13:17:54.658573 16056 raft_consensus.cc:2749] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:54.661334 16048 tablet_bootstrap.cc:654] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.661134 15930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd3fef44c3c40818e7fa0100b880e49" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
I20260709 13:17:54.663307 16049 tablet_bootstrap.cc:654] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:54.663368 15818 leader_election.cc:343] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.665617 16051 raft_consensus.cc:493] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.666216 16051 raft_consensus.cc:515] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.665639 16047 tablet_bootstrap.cc:654] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.670468 16051 leader_election.cc:290] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:54.673039 15930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
W20260709 13:17:54.675421 15818 leader_election.cc:343] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.699915 16048 tablet_bootstrap.cc:492] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215: No bootstrap required, opened a new log
I20260709 13:17:54.700516 16048 ts_tablet_manager.cc:1403] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.000s
I20260709 13:17:54.702214 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" is_pre_election: true
W20260709 13:17:54.703812 15893 leader_election.cc:343] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.703410 16048 raft_consensus.cc:359] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.704366 16048 raft_consensus.cc:385] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.704710 16048 raft_consensus.cc:740] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.705613 16048 consensus_queue.cc:260] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.711004 16048 ts_tablet_manager.cc:1434] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:17:54.714262 16048 tablet_bootstrap.cc:492] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215: Bootstrap starting.
I20260709 13:17:54.714749 16047 tablet_bootstrap.cc:492] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176: No bootstrap required, opened a new log
I20260709 13:17:54.715251 16047 ts_tablet_manager.cc:1403] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.012s
I20260709 13:17:54.715739 16055 raft_consensus.cc:493] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.716187 16055 raft_consensus.cc:515] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.717828 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54" is_pre_election: true
I20260709 13:17:54.718266 16055 leader_election.cc:290] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:54.719597 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd3fef44c3c40818e7fa0100b880e49" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54" is_pre_election: true
I20260709 13:17:54.719856 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd3fef44c3c40818e7fa0100b880e49" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" is_pre_election: true
I20260709 13:17:54.720679 15855 raft_consensus.cc:2468] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 0.
I20260709 13:17:54.721803 15893 leader_election.cc:304] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:54.722648 16055 raft_consensus.cc:2804] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:54.721825 16047 raft_consensus.cc:359] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.723017 16055 raft_consensus.cc:493] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.723227 16047 raft_consensus.cc:385] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.723400 16055 raft_consensus.cc:3060] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.723703 16047 raft_consensus.cc:740] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.724326 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54" is_pre_election: true
I20260709 13:17:54.725023 16047 consensus_queue.cc:260] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
W20260709 13:17:54.725600 15896 leader_election.cc:343] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.727721 15896 leader_election.cc:304] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215; no voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176
I20260709 13:17:54.730103 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd3fef44c3c40818e7fa0100b880e49" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54" is_pre_election: true
I20260709 13:17:54.730538 16055 raft_consensus.cc:515] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.731360 16049 tablet_bootstrap.cc:492] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54: No bootstrap required, opened a new log
I20260709 13:17:54.731846 16049 ts_tablet_manager.cc:1403] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.007s
I20260709 13:17:54.734696 16049 raft_consensus.cc:359] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.725895 16048 tablet_bootstrap.cc:654] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215: Neither blocks nor log segments found. Creating new log.
W20260709 13:17:54.726455 15821 leader_election.cc:343] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.735334 16047 ts_tablet_manager.cc:1434] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:17:54.735646 15821 leader_election.cc:304] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7593f8411564499b93f419c5b932bd54
W20260709 13:17:54.736832 15821 leader_election.cc:343] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.737221 15821 leader_election.cc:304] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7593f8411564499b93f419c5b932bd54
I20260709 13:17:54.737527 16051 raft_consensus.cc:2749] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:54.738196 16051 raft_consensus.cc:2749] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:54.735368 16049 raft_consensus.cc:385] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.739089 16049 raft_consensus.cc:740] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.739825 16049 consensus_queue.cc:260] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.741441 16055 leader_election.cc:290] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:54.741614 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd3fef44c3c40818e7fa0100b880e49" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:54.741943 16055 raft_consensus.cc:2749] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:54.742215 16049 ts_tablet_manager.cc:1434] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:17:54.742187 15855 raft_consensus.cc:3060] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.743778 16049 tablet_bootstrap.cc:492] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54: Bootstrap starting.
I20260709 13:17:54.750694 16047 tablet_bootstrap.cc:492] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176: Bootstrap starting.
I20260709 13:17:54.755244 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd3fef44c3c40818e7fa0100b880e49" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:54.755496 15855 raft_consensus.cc:2468] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 1.
I20260709 13:17:54.755869 16004 raft_consensus.cc:3060] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.759459 15893 leader_election.cc:304] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
W20260709 13:17:54.757426 15896 leader_election.cc:343] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.763602 16073 raft_consensus.cc:2804] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:54.766914 16073 raft_consensus.cc:697] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 LEADER]: Becoming Leader. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:17:54.767958 16049 tablet_bootstrap.cc:654] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.768364 16048 tablet_bootstrap.cc:492] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215: No bootstrap required, opened a new log
I20260709 13:17:54.767771 16073 consensus_queue.cc:237] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.769158 16004 raft_consensus.cc:2468] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 1.
I20260709 13:17:54.769670 16048 ts_tablet_manager.cc:1403] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.003s
I20260709 13:17:54.773258 16047 tablet_bootstrap.cc:654] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.778920 16048 raft_consensus.cc:359] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.779934 16048 raft_consensus.cc:385] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.780326 16048 raft_consensus.cc:740] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.781584 16048 consensus_queue.cc:260] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.788326 16048 ts_tablet_manager.cc:1434] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:17:54.788620 16049 tablet_bootstrap.cc:492] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54: No bootstrap required, opened a new log
I20260709 13:17:54.789135 16049 ts_tablet_manager.cc:1403] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.009s
I20260709 13:17:54.789678 16048 tablet_bootstrap.cc:492] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215: Bootstrap starting.
I20260709 13:17:54.793501 16047 tablet_bootstrap.cc:492] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176: No bootstrap required, opened a new log
I20260709 13:17:54.793978 16047 ts_tablet_manager.cc:1403] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.001s
I20260709 13:17:54.794263 15750 catalog_manager.cc:5697] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:54.795346 16049 raft_consensus.cc:359] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.796090 16049 raft_consensus.cc:385] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.796424 16049 raft_consensus.cc:740] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.796907 16047 raft_consensus.cc:359] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.797623 16047 raft_consensus.cc:385] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.797358 16049 consensus_queue.cc:260] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.798025 16047 raft_consensus.cc:740] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.798185 16056 raft_consensus.cc:493] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.798631 16056 raft_consensus.cc:515] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.798837 16047 consensus_queue.cc:260] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.804085 15930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
I20260709 13:17:54.804701 15930 raft_consensus.cc:2468] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 0.
I20260709 13:17:54.805886 15967 leader_election.cc:304] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7593f8411564499b93f419c5b932bd54; no voters: 
I20260709 13:17:54.807552 16056 leader_election.cc:290] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:54.807662 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" is_pre_election: true
I20260709 13:17:54.808166 16056 raft_consensus.cc:2804] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:54.808516 16056 raft_consensus.cc:493] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.808844 16056 raft_consensus.cc:3060] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.809736 16048 tablet_bootstrap.cc:654] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.811159 16047 ts_tablet_manager.cc:1434] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:17:54.813907 16075 raft_consensus.cc:493] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.814365 16075 raft_consensus.cc:515] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.816598 16075 leader_election.cc:290] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:54.818470 15930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c4e4394894eefa95c0bf1627fcdf9" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
W20260709 13:17:54.819860 15818 leader_election.cc:343] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.819981 16047 tablet_bootstrap.cc:492] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176: Bootstrap starting.
W20260709 13:17:54.821421 15967 leader_election.cc:343] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.821523 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c4e4394894eefa95c0bf1627fcdf9" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54" is_pre_election: true
I20260709 13:17:54.822170 16004 raft_consensus.cc:2468] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 0.
I20260709 13:17:54.823225 15821 leader_election.cc:304] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:54.823998 16075 raft_consensus.cc:2804] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:54.824354 16075 raft_consensus.cc:493] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.824694 16075 raft_consensus.cc:3060] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.828238 16047 tablet_bootstrap.cc:654] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.829838 16048 tablet_bootstrap.cc:492] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215: No bootstrap required, opened a new log
I20260709 13:17:54.831395 16075 raft_consensus.cc:515] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.832113 16080 raft_consensus.cc:493] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.832808 16080 raft_consensus.cc:515] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.840327 15930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c4e4394894eefa95c0bf1627fcdf9" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:17:54.843269 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" is_pre_election: true
I20260709 13:17:54.843923 15855 raft_consensus.cc:2468] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 0.
W20260709 13:17:54.845749 15818 leader_election.cc:343] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.846505 15967 leader_election.cc:304] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:54.853811 16075 leader_election.cc:290] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 election: Requested vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:54.858055 16048 ts_tablet_manager.cc:1403] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.002s
I20260709 13:17:54.858425 16080 leader_election.cc:290] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:54.859076 16080 raft_consensus.cc:2804] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:54.859477 16080 raft_consensus.cc:493] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.859928 16080 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.862850 16048 raft_consensus.cc:359] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.863750 16048 raft_consensus.cc:385] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.864151 16048 raft_consensus.cc:740] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.865120 16048 consensus_queue.cc:260] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.866149 16047 tablet_bootstrap.cc:492] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176: No bootstrap required, opened a new log
I20260709 13:17:54.866678 16047 ts_tablet_manager.cc:1403] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.019s
I20260709 13:17:54.867446 16056 raft_consensus.cc:515] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.869367 16056 leader_election.cc:290] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:54.869498 16047 raft_consensus.cc:359] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.870333 16047 raft_consensus.cc:385] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.870663 16047 raft_consensus.cc:740] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.871387 16047 consensus_queue.cc:260] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.873613 16049 ts_tablet_manager.cc:1434] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.001s
I20260709 13:17:54.874619 16049 tablet_bootstrap.cc:492] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54: Bootstrap starting.
I20260709 13:17:54.877077 16048 ts_tablet_manager.cc:1434] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:17:54.878031 16048 tablet_bootstrap.cc:492] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215: Bootstrap starting.
I20260709 13:17:54.873600 16047 ts_tablet_manager.cc:1434] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:54.879331 16047 tablet_bootstrap.cc:492] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176: Bootstrap starting.
I20260709 13:17:54.882383 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:17:54.883095 15929 raft_consensus.cc:3060] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.884231 15930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
I20260709 13:17:54.885569 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:54.886102 15855 raft_consensus.cc:3060] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.887482 16047 tablet_bootstrap.cc:654] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.890808 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c4e4394894eefa95c0bf1627fcdf9" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:54.891064 15929 raft_consensus.cc:2468] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 1.
I20260709 13:17:54.891386 16049 tablet_bootstrap.cc:654] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.891363 16004 raft_consensus.cc:3060] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:17:54.892731 15967 leader_election.cc:343] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.902213 15855 raft_consensus.cc:2468] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 1.
I20260709 13:17:54.904072 16004 raft_consensus.cc:2468] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 1.
I20260709 13:17:54.906472 15967 leader_election.cc:304] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7593f8411564499b93f419c5b932bd54; no voters: 
I20260709 13:17:54.908887 16073 raft_consensus.cc:493] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.909373 16073 raft_consensus.cc:515] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.910113 15821 leader_election.cc:304] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:54.911065 16049 tablet_bootstrap.cc:492] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54: No bootstrap required, opened a new log
I20260709 13:17:54.911489 16049 ts_tablet_manager.cc:1403] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 13:17:54.911630 16073 leader_election.cc:290] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:54.911872 16075 raft_consensus.cc:2804] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:54.912814 16056 raft_consensus.cc:2804] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:54.913715 16075 raft_consensus.cc:697] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Becoming Leader. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:17:54.915045 16056 raft_consensus.cc:697] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Becoming Leader. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:54.916078 16075 consensus_queue.cc:237] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.916107 16056 consensus_queue.cc:237] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.917642 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8788d489444fe98326d4ea14fcdc4" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54" is_pre_election: true
I20260709 13:17:54.919370 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8788d489444fe98326d4ea14fcdc4" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" is_pre_election: true
W20260709 13:17:54.920356 15896 leader_election.cc:343] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:17:54.922204 15893 leader_election.cc:343] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.922360 16049 raft_consensus.cc:359] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.922703 15893 leader_election.cc:304] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215; no voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176
I20260709 13:17:54.923069 16049 raft_consensus.cc:385] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.923358 16049 raft_consensus.cc:740] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.923842 16073 raft_consensus.cc:2749] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:54.924094 16049 consensus_queue.cc:260] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.924940 16048 tablet_bootstrap.cc:654] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.928352 16051 raft_consensus.cc:493] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.929214 16051 raft_consensus.cc:515] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.931376 16051 leader_election.cc:290] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:54.933367 16047 tablet_bootstrap.cc:492] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176: No bootstrap required, opened a new log
I20260709 13:17:54.933899 16047 ts_tablet_manager.cc:1403] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.001s
I20260709 13:17:54.933354 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba3dfa569214f848ebec392e46aa045" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
I20260709 13:17:54.941556 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba3dfa569214f848ebec392e46aa045" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54" is_pre_election: true
I20260709 13:17:54.940974 15929 raft_consensus.cc:2468] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 0.
I20260709 13:17:54.943717 15818 leader_election.cc:304] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:54.946110 16051 raft_consensus.cc:2804] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:54.946455 16051 raft_consensus.cc:493] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.946412 16047 raft_consensus.cc:359] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
W20260709 13:17:54.946942 15821 leader_election.cc:343] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.946943 16051 raft_consensus.cc:3060] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.947220 16047 raft_consensus.cc:385] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.945293 16080 raft_consensus.cc:515] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.947603 16047 raft_consensus.cc:740] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.950088 16047 consensus_queue.cc:260] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.954311 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:54.955204 15855 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.957278 16051 raft_consensus.cc:515] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.949441 16049 ts_tablet_manager.cc:1434] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:17:54.962651 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:17:54.963999 16049 tablet_bootstrap.cc:492] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54: Bootstrap starting.
W20260709 13:17:54.966513 15967 leader_election.cc:343] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.967186 16080 leader_election.cc:290] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:54.968616 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba3dfa569214f848ebec392e46aa045" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:17:54.969386 15929 raft_consensus.cc:3060] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:54.972182 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba3dfa569214f848ebec392e46aa045" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:54.973747 16047 ts_tablet_manager.cc:1434] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.006s
W20260709 13:17:54.974272 15821 leader_election.cc:343] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:54.974699 16047 tablet_bootstrap.cc:492] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176: Bootstrap starting.
I20260709 13:17:54.981226 16048 tablet_bootstrap.cc:492] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215: No bootstrap required, opened a new log
I20260709 13:17:54.981776 16048 ts_tablet_manager.cc:1403] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent bootstrapping tablet: real 0.104s	user 0.009s	sys 0.005s
I20260709 13:17:54.983024 16049 tablet_bootstrap.cc:654] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.967046 16051 leader_election.cc:290] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 election: Requested vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:54.988637 16047 tablet_bootstrap.cc:654] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:54.989600 16048 raft_consensus.cc:359] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.991007 16048 raft_consensus.cc:385] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:54.991413 16048 raft_consensus.cc:740] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Initialized, Role: FOLLOWER
I20260709 13:17:54.991660 15929 raft_consensus.cc:2468] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 1.
I20260709 13:17:54.994596 16048 consensus_queue.cc:260] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:54.998667 16048 ts_tablet_manager.cc:1434] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:17:54.998714 15818 leader_election.cc:304] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 7593f8411564499b93f419c5b932bd54
I20260709 13:17:54.999964 16080 raft_consensus.cc:493] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.000211 16048 tablet_bootstrap.cc:492] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215: Bootstrap starting.
I20260709 13:17:55.000422 16080 raft_consensus.cc:515] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.002069 16075 raft_consensus.cc:2804] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.002475 16080 leader_election.cc:290] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:55.002554 16075 raft_consensus.cc:697] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Becoming Leader. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:17:55.004660 15855 raft_consensus.cc:2468] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 1.
I20260709 13:17:55.007704 15967 leader_election.cc:304] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:55.008253 16075 consensus_queue.cc:237] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.008857 16080 raft_consensus.cc:2804] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.009313 16080 raft_consensus.cc:697] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Becoming Leader. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:55.010110 16080 consensus_queue.cc:237] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.012571 15751 catalog_manager.cc:5697] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.015422 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
I20260709 13:17:55.015069 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" is_pre_election: true
I20260709 13:17:55.020417 15855 raft_consensus.cc:2468] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 0.
I20260709 13:17:55.022058 16049 tablet_bootstrap.cc:492] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54: No bootstrap required, opened a new log
I20260709 13:17:55.022531 16049 ts_tablet_manager.cc:1403] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.020s
W20260709 13:17:55.028996 15967 leader_election.cc:343] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.032286 15967 leader_election.cc:304] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:55.034317 16080 raft_consensus.cc:2804] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.034832 16080 raft_consensus.cc:493] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.035267 16080 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.044471 16048 tablet_bootstrap.cc:654] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.054541 16049 raft_consensus.cc:359] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.056124 16049 raft_consensus.cc:385] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.056469 16049 raft_consensus.cc:740] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.057271 16049 consensus_queue.cc:260] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.059345 16047 tablet_bootstrap.cc:492] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176: No bootstrap required, opened a new log
I20260709 13:17:55.059859 16047 ts_tablet_manager.cc:1403] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.004s
I20260709 13:17:55.061261 15751 catalog_manager.cc:5697] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.062427 16047 raft_consensus.cc:359] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.062647 16080 raft_consensus.cc:515] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.063349 16047 raft_consensus.cc:385] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.063757 16047 raft_consensus.cc:740] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.064566 16047 consensus_queue.cc:260] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.065544 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:55.066077 15855 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.066962 16047 ts_tablet_manager.cc:1434] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:55.067768 16047 tablet_bootstrap.cc:492] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176: Bootstrap starting.
I20260709 13:17:55.073240 15855 raft_consensus.cc:2468] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 1.
I20260709 13:17:55.073861 16047 tablet_bootstrap.cc:654] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.073382 15752 catalog_manager.cc:5697] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7593f8411564499b93f419c5b932bd54 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "7593f8411564499b93f419c5b932bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.074473 15967 leader_election.cc:304] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:55.075292 16056 raft_consensus.cc:2804] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.075747 16056 raft_consensus.cc:697] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Becoming Leader. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:55.076552 16056 consensus_queue.cc:237] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.084055 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
W20260709 13:17:55.085464 15967 leader_election.cc:343] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:17:55.086444 16080 leader_election.cc:290] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:55.098281 16049 ts_tablet_manager.cc:1434] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54: Time spent starting tablet: real 0.075s	user 0.011s	sys 0.000s
I20260709 13:17:55.099362 16049 tablet_bootstrap.cc:492] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54: Bootstrap starting.
I20260709 13:17:55.102435 15752 catalog_manager.cc:5697] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7593f8411564499b93f419c5b932bd54 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "7593f8411564499b93f419c5b932bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.105235 16056 raft_consensus.cc:493] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.105676 16056 raft_consensus.cc:515] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.106472 16049 tablet_bootstrap.cc:654] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.107208 16048 tablet_bootstrap.cc:492] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215: No bootstrap required, opened a new log
I20260709 13:17:55.107816 16048 ts_tablet_manager.cc:1403] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.029s
I20260709 13:17:55.108423 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" is_pre_election: true
I20260709 13:17:55.109050 15855 raft_consensus.cc:2468] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 0.
I20260709 13:17:55.109385 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
I20260709 13:17:55.109943 15929 raft_consensus.cc:2468] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 0.
I20260709 13:17:55.110190 15967 leader_election.cc:304] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:55.110966 16056 leader_election.cc:290] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:55.111380 16098 raft_consensus.cc:2804] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.111856 16098 raft_consensus.cc:493] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.104519 15752 catalog_manager.cc:5697] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7593f8411564499b93f419c5b932bd54 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "7593f8411564499b93f419c5b932bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.111560 16048 raft_consensus.cc:359] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.112269 16098 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.115080 16047 tablet_bootstrap.cc:492] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176: No bootstrap required, opened a new log
I20260709 13:17:55.115520 16047 ts_tablet_manager.cc:1403] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.026s
I20260709 13:17:55.118299 16047 raft_consensus.cc:359] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.118947 16047 raft_consensus.cc:385] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.119221 16047 raft_consensus.cc:740] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.119069 16098 raft_consensus.cc:515] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.126670 16098 leader_election.cc:290] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:55.127158 16048 raft_consensus.cc:385] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.127434 16048 raft_consensus.cc:740] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.128160 16048 consensus_queue.cc:260] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.119910 16047 consensus_queue.cc:260] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.132301 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:17:55.132897 15929 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.135257 16048 ts_tablet_manager.cc:1434] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:17:55.136099 16047 ts_tablet_manager.cc:1434] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:17:55.136898 16048 tablet_bootstrap.cc:492] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215: Bootstrap starting.
I20260709 13:17:55.137156 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:55.137691 15855 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.144300 16048 tablet_bootstrap.cc:654] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.156423 15855 raft_consensus.cc:2468] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 1.
I20260709 13:17:55.160080 16049 tablet_bootstrap.cc:492] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54: No bootstrap required, opened a new log
I20260709 13:17:55.160547 16049 ts_tablet_manager.cc:1403] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.019s
I20260709 13:17:55.160719 15929 raft_consensus.cc:2468] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 1.
I20260709 13:17:55.162075 15967 leader_election.cc:304] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:55.163004 16098 raft_consensus.cc:2804] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.163626 16098 raft_consensus.cc:697] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Becoming Leader. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:55.163482 16049 raft_consensus.cc:359] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.164322 16049 raft_consensus.cc:385] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.164615 16049 raft_consensus.cc:740] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.165262 16049 consensus_queue.cc:260] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.164875 16098 consensus_queue.cc:237] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.167449 16049 ts_tablet_manager.cc:1434] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:17:55.168093 16048 tablet_bootstrap.cc:492] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215: No bootstrap required, opened a new log
I20260709 13:17:55.168543 16049 tablet_bootstrap.cc:492] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54: Bootstrap starting.
I20260709 13:17:55.168576 16048 ts_tablet_manager.cc:1403] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.015s
I20260709 13:17:55.172472 16048 raft_consensus.cc:359] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.173322 16048 raft_consensus.cc:385] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.173643 16048 raft_consensus.cc:740] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.174584 16048 consensus_queue.cc:260] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.177101 16048 ts_tablet_manager.cc:1434] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:17:55.177958 16048 tablet_bootstrap.cc:492] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215: Bootstrap starting.
I20260709 13:17:55.181828 16049 tablet_bootstrap.cc:654] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.183509 16048 tablet_bootstrap.cc:654] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215: Neither blocks nor log segments found. Creating new log.
I20260709 13:17:55.197131 16049 tablet_bootstrap.cc:492] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54: No bootstrap required, opened a new log
I20260709 13:17:55.197610 16049 ts_tablet_manager.cc:1403] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 13:17:55.196954 15751 catalog_manager.cc:5697] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7593f8411564499b93f419c5b932bd54 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "7593f8411564499b93f419c5b932bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.199010 16075 raft_consensus.cc:493] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.199477 16075 raft_consensus.cc:515] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.200606 16049 raft_consensus.cc:359] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.201210 16049 raft_consensus.cc:385] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.201447 16049 raft_consensus.cc:740] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.201507 16075 leader_election.cc:290] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:55.202308 16049 consensus_queue.cc:260] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.203384 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54" is_pre_election: true
I20260709 13:17:55.204171 16004 raft_consensus.cc:2468] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 0.
I20260709 13:17:55.205291 16049 ts_tablet_manager.cc:1434] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:17:55.205744 15821 leader_election.cc:304] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:55.206506 16075 raft_consensus.cc:2804] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.206888 16075 raft_consensus.cc:493] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.207224 16075 raft_consensus.cc:3060] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.207921 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
I20260709 13:17:55.208598 15929 raft_consensus.cc:2468] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 0.
I20260709 13:17:55.212182 16073 consensus_queue.cc:1048] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.218883 16075 raft_consensus.cc:515] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.221069 16075 leader_election.cc:290] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 election: Requested vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:55.221801 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:17:55.222389 15929 raft_consensus.cc:3060] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.223771 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:55.224318 16004 raft_consensus.cc:3060] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.228641 16048 tablet_bootstrap.cc:492] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215: No bootstrap required, opened a new log
I20260709 13:17:55.229043 16048 ts_tablet_manager.cc:1403] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.012s
I20260709 13:17:55.231410 16048 raft_consensus.cc:359] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.232062 16048 raft_consensus.cc:385] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:17:55.232297 16048 raft_consensus.cc:740] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Initialized, Role: FOLLOWER
I20260709 13:17:55.232957 16048 consensus_queue.cc:260] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.234467 15929 raft_consensus.cc:2468] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 1.
I20260709 13:17:55.235558 15818 leader_election.cc:304] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:55.236367 16075 raft_consensus.cc:2804] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.236825 16075 raft_consensus.cc:697] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Becoming Leader. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:17:55.237653 16075 consensus_queue.cc:237] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.243880 16004 raft_consensus.cc:2468] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 1.
I20260709 13:17:55.261524 16055 consensus_queue.cc:1048] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.267503 15752 catalog_manager.cc:5697] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.278527 16048 ts_tablet_manager.cc:1434] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215: Time spent starting tablet: real 0.049s	user 0.021s	sys 0.027s
W20260709 13:17:55.296802 15800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:17:55.315659 16098 raft_consensus.cc:493] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.316310 16098 raft_consensus.cc:515] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.318041 16098 leader_election.cc:290] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:55.318897 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8788d489444fe98326d4ea14fcdc4" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" is_pre_election: true
I20260709 13:17:55.319093 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8788d489444fe98326d4ea14fcdc4" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
I20260709 13:17:55.319572 15855 raft_consensus.cc:2468] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 0.
I20260709 13:17:55.319638 15929 raft_consensus.cc:2468] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 0.
I20260709 13:17:55.320717 15967 leader_election.cc:304] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:55.321367 16098 raft_consensus.cc:2804] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:17:55.321731 16098 raft_consensus.cc:493] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.322046 16098 raft_consensus.cc:3060] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.328531 16098 raft_consensus.cc:515] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.330462 16098 leader_election.cc:290] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:55.331254 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8788d489444fe98326d4ea14fcdc4" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:55.331423 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a8788d489444fe98326d4ea14fcdc4" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:17:55.331815 15855 raft_consensus.cc:3060] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.332006 15929 raft_consensus.cc:3060] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.336117 15855 raft_consensus.cc:2468] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 1.
I20260709 13:17:55.337028 15967 leader_election.cc:304] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:55.337647 16098 raft_consensus.cc:2804] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:17:55.338064 16098 raft_consensus.cc:697] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Becoming Leader. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:55.338266 15929 raft_consensus.cc:2468] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 1.
I20260709 13:17:55.338850 16098 consensus_queue.cc:237] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.346635 15752 catalog_manager.cc:5697] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7593f8411564499b93f419c5b932bd54 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "7593f8411564499b93f419c5b932bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.371796 16098 consensus_queue.cc:1048] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.375213 16075 consensus_queue.cc:1048] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.389902 16056 consensus_queue.cc:1048] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.403658 16051 consensus_queue.cc:1048] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:55.410940 15929 raft_consensus.cc:3060] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.425397 16051 consensus_queue.cc:1048] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.426905 16056 raft_consensus.cc:493] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.427358 16056 raft_consensus.cc:515] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.429338 16056 leader_election.cc:290] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:55.439886 16003 raft_consensus.cc:3060] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.440061 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba3dfa569214f848ebec392e46aa045" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" is_pre_election: true
I20260709 13:17:55.443308 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba3dfa569214f848ebec392e46aa045" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" is_pre_election: true
I20260709 13:17:55.451649 16056 consensus_queue.cc:1048] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.458758 15967 leader_election.cc:304] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7593f8411564499b93f419c5b932bd54; no voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7f0edeb2a4fa4371af359d8d7a4ef176
I20260709 13:17:55.464630 16056 raft_consensus.cc:2749] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:17:55.466053 16075 consensus_queue.cc:1048] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.470566 16080 consensus_queue.cc:1048] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.490886 15930 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.499007 16106 raft_consensus.cc:493] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.499516 16106 raft_consensus.cc:515] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.501672 16098 consensus_queue.cc:1048] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.502547 16106 leader_election.cc:290] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:55.503165 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7593f8411564499b93f419c5b932bd54" is_pre_election: true
I20260709 13:17:55.509711 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" is_pre_election: true
I20260709 13:17:55.510969 15893 leader_election.cc:304] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215; no voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176
I20260709 13:17:55.512893 15929 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:17:55.519541 16106 raft_consensus.cc:2749] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:55.522007 16056 consensus_queue.cc:1048] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.557001 16003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95"
dest_uuid: "7593f8411564499b93f419c5b932bd54"
mode: GRACEFUL
new_leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
 from {username='slave'} at 127.0.0.1:59606
I20260709 13:17:55.557631 16003 raft_consensus.cc:606] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Received request to transfer leadership to TS 7f0edeb2a4fa4371af359d8d7a4ef176
I20260709 13:17:55.563247 16003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa"
dest_uuid: "7593f8411564499b93f419c5b932bd54"
mode: GRACEFUL
new_leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
 from {username='slave'} at 127.0.0.1:59606
I20260709 13:17:55.563860 16003 raft_consensus.cc:606] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Received request to transfer leadership to TS 7f0edeb2a4fa4371af359d8d7a4ef176
I20260709 13:17:55.574347 16003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1"
dest_uuid: "7593f8411564499b93f419c5b932bd54"
mode: GRACEFUL
new_leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:59606
I20260709 13:17:55.574805 16003 raft_consensus.cc:606] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Received request to transfer leadership to TS 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:55.579579 16003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840"
dest_uuid: "7593f8411564499b93f419c5b932bd54"
mode: GRACEFUL
new_leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:59606
I20260709 13:17:55.580098 16003 raft_consensus.cc:606] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Received request to transfer leadership to TS 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:55.594157 15855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6"
dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
mode: GRACEFUL
new_leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:52842
I20260709 13:17:55.594817 15855 raft_consensus.cc:606] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Received request to transfer leadership to TS 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:55.612715 16056 consensus_queue.cc:1048] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.626119 16098 consensus_queue.cc:1048] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.635775 16083 raft_consensus.cc:993] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54: : Instructing follower 7f0edeb2a4fa4371af359d8d7a4ef176 to start an election
I20260709 13:17:55.636272 16098 raft_consensus.cc:1081] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Signalling peer 7f0edeb2a4fa4371af359d8d7a4ef176 to start an election
I20260709 13:17:55.638070 15855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa"
dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
 from {username='slave'} at 127.0.0.1:52828
I20260709 13:17:55.638698 15855 raft_consensus.cc:493] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.639115 15855 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.644065 15855 raft_consensus.cc:515] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.646013 15855 leader_election.cc:290] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 2 election: Requested vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:55.646413 15930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:17:55.647480 15930 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.647547 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:55.648180 16003 raft_consensus.cc:3055] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:55.648512 16003 raft_consensus.cc:740] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:55.649304 16003 consensus_queue.cc:260] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.650676 16003 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.654699 15930 raft_consensus.cc:2468] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 2.
I20260709 13:17:55.655901 15818 leader_election.cc:304] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:55.656669 16075 raft_consensus.cc:2804] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:55.657039 16003 raft_consensus.cc:2468] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 2.
I20260709 13:17:55.657124 16075 raft_consensus.cc:697] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Becoming Leader. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:17:55.658037 16075 consensus_queue.cc:237] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.665553 15752 catalog_manager.cc:5697] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 reported cstate change: term changed from 1 to 2, leader changed from 7593f8411564499b93f419c5b932bd54 (127.15.90.3) to 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.667799 16075 consensus_queue.cc:1048] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.680145 16090 consensus_queue.cc:1048] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.690452 16090 raft_consensus.cc:993] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176: : Instructing follower 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:55.690856 16090 raft_consensus.cc:1081] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Signalling peer 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:55.692626 15929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:40776
I20260709 13:17:55.693217 15929 raft_consensus.cc:493] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.693588 15929 raft_consensus.cc:3060] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.700063 15929 raft_consensus.cc:515] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.702602 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:55.702813 15929 leader_election.cc:290] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:55.703205 15855 raft_consensus.cc:3055] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:55.703076 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:55.703943 15855 raft_consensus.cc:740] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:17:55.704135 16003 raft_consensus.cc:3060] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.704774 15855 consensus_queue.cc:260] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.705950 15855 raft_consensus.cc:3060] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.710445 16003 raft_consensus.cc:2468] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 2.
I20260709 13:17:55.711501 15896 leader_election.cc:304] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7593f8411564499b93f419c5b932bd54; no voters: 
I20260709 13:17:55.712201 15855 raft_consensus.cc:2468] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 2.
I20260709 13:17:55.712299 16106 raft_consensus.cc:2804] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:55.712826 16106 raft_consensus.cc:697] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Becoming Leader. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:17:55.713590 16106 consensus_queue.cc:237] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.719796 15752 catalog_manager.cc:5697] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 reported cstate change: term changed from 1 to 2, leader changed from 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1) to 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.799832 16080 raft_consensus.cc:993] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54: : Instructing follower 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:55.800294 16080 raft_consensus.cc:1081] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Signalling peer 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:55.801914 15929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:17:55.802542 15929 raft_consensus.cc:493] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.802913 15929 raft_consensus.cc:3060] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.809662 15929 raft_consensus.cc:515] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.811794 15929 leader_election.cc:290] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:55.812538 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:55.813136 15855 raft_consensus.cc:3060] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.813338 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:55.813905 16003 raft_consensus.cc:3055] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:55.814210 16003 raft_consensus.cc:740] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:55.823624 15855 raft_consensus.cc:2468] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 2.
I20260709 13:17:55.823736 16098 consensus_queue.cc:1048] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:17:55.824728 15893 leader_election.cc:304] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:55.823415 16003 consensus_queue.cc:260] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.825812 16055 raft_consensus.cc:2804] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:55.825965 16003 raft_consensus.cc:3060] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.826297 16055 raft_consensus.cc:697] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Becoming Leader. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:17:55.827098 16055 consensus_queue.cc:237] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.834400 16003 raft_consensus.cc:2468] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 2.
I20260709 13:17:55.839123 15752 catalog_manager.cc:5697] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 reported cstate change: term changed from 1 to 2, leader changed from 7593f8411564499b93f419c5b932bd54 (127.15.90.3) to 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:55.842370 16098 consensus_queue.cc:1048] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:17:55.872700 16098 raft_consensus.cc:993] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54: : Instructing follower 7f0edeb2a4fa4371af359d8d7a4ef176 to start an election
I20260709 13:17:55.873123 16098 raft_consensus.cc:1081] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Signalling peer 7f0edeb2a4fa4371af359d8d7a4ef176 to start an election
I20260709 13:17:55.874437 15855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95"
dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
 from {username='slave'} at 127.0.0.1:52828
I20260709 13:17:55.874879 15855 raft_consensus.cc:493] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.875152 15855 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.879462 15855 raft_consensus.cc:515] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.881184 15855 leader_election.cc:290] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 2 election: Requested vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:55.881788 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:17:55.882131 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:55.882486 15929 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.882694 16003 raft_consensus.cc:3055] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:55.883108 16003 raft_consensus.cc:740] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:55.883839 16003 consensus_queue.cc:260] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.884706 16003 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.888998 16003 raft_consensus.cc:2468] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 2.
I20260709 13:17:55.889006 15929 raft_consensus.cc:2468] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 2.
I20260709 13:17:55.890152 15821 leader_election.cc:304] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:55.890813 16051 raft_consensus.cc:2804] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:55.891276 16051 raft_consensus.cc:697] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Becoming Leader. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:17:55.892064 16051 consensus_queue.cc:237] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:55.898387 15752 catalog_manager.cc:5697] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 reported cstate change: term changed from 1 to 2, leader changed from 7593f8411564499b93f419c5b932bd54 (127.15.90.3) to 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.013217 16083 raft_consensus.cc:993] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54: : Instructing follower 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:56.013680 16098 raft_consensus.cc:1081] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Signalling peer 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:56.015329 15929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:17:56.015892 15929 raft_consensus.cc:493] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:56.016251 15929 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.022678 15929 raft_consensus.cc:515] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:56.025054 15929 leader_election.cc:290] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:56.025748 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:56.026196 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:56.026340 16003 raft_consensus.cc:3055] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:56.026757 15855 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.027031 16003 raft_consensus.cc:740] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:56.027886 16003 consensus_queue.cc:260] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:56.029052 16003 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:56.033174 15855 raft_consensus.cc:2468] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 2.
I20260709 13:17:56.034449 15893 leader_election.cc:304] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:56.035439 16130 raft_consensus.cc:2804] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:56.035701 16003 raft_consensus.cc:2468] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 2.
I20260709 13:17:56.035952 16130 raft_consensus.cc:697] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Becoming Leader. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:17:56.036849 16130 consensus_queue.cc:237] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:56.043578 15752 catalog_manager.cc:5697] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 reported cstate change: term changed from 1 to 2, leader changed from 7593f8411564499b93f419c5b932bd54 (127.15.90.3) to 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:56.113766 16003 raft_consensus.cc:1275] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Refusing update from remote peer 7f0edeb2a4fa4371af359d8d7a4ef176: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.115135 16051 consensus_queue.cc:1048] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.125564 15855 raft_consensus.cc:1275] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.126492 16004 raft_consensus.cc:1275] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.127586 15929 raft_consensus.cc:1275] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Refusing update from remote peer 7f0edeb2a4fa4371af359d8d7a4ef176: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.127372 16130 consensus_queue.cc:1048] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.128500 16055 consensus_queue.cc:1048] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.133445 16133 consensus_queue.cc:1048] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.266799 16003 raft_consensus.cc:1275] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.268290 16130 consensus_queue.cc:1048] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.275847 15855 raft_consensus.cc:1275] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.277335 16134 consensus_queue.cc:1048] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.378504 16003 raft_consensus.cc:1275] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Refusing update from remote peer 7f0edeb2a4fa4371af359d8d7a4ef176: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.379745 16133 consensus_queue.cc:1048] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.387390 15929 raft_consensus.cc:1275] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Refusing update from remote peer 7f0edeb2a4fa4371af359d8d7a4ef176: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.389509 16051 consensus_queue.cc:1048] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.430502 15855 raft_consensus.cc:1275] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.431639 16134 consensus_queue.cc:1048] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:56.438699 16003 raft_consensus.cc:1275] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:56.440176 16134 consensus_queue.cc:1048] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:58.642046 15720 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:17:58.642823 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:58.659616 15855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95"
dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
mode: GRACEFUL
new_leader_uuid: "7593f8411564499b93f419c5b932bd54"
 from {username='slave'} at 127.0.0.1:35846
I20260709 13:17:58.660122 15855 raft_consensus.cc:606] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Received request to transfer leadership to TS 7593f8411564499b93f419c5b932bd54
I20260709 13:17:58.671880 15929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
mode: GRACEFUL
new_leader_uuid: "7593f8411564499b93f419c5b932bd54"
 from {username='slave'} at 127.0.0.1:37004
I20260709 13:17:58.672411 15929 raft_consensus.cc:606] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Received request to transfer leadership to TS 7593f8411564499b93f419c5b932bd54
I20260709 13:17:58.673509 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:58.674010 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:58.761610 16135 raft_consensus.cc:993] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176: : Instructing follower 7593f8411564499b93f419c5b932bd54 to start an election
I20260709 13:17:58.762115 16090 raft_consensus.cc:1081] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Signalling peer 7593f8411564499b93f419c5b932bd54 to start an election
I20260709 13:17:58.763604 16003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95"
dest_uuid: "7593f8411564499b93f419c5b932bd54"
 from {username='slave'} at 127.0.0.1:59594
I20260709 13:17:58.764073 16003 raft_consensus.cc:493] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:58.764348 16003 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.770859 16003 raft_consensus.cc:515] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:58.772780 16003 leader_election.cc:290] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 3 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:58.773434 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:58.773799 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:17:58.774078 15855 raft_consensus.cc:3055] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:58.774461 15855 raft_consensus.cc:740] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:17:58.774490 15929 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.775254 15855 consensus_queue.cc:260] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:58.776177 15855 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.779050 15929 raft_consensus.cc:2468] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 3.
I20260709 13:17:58.780278 15967 leader_election.cc:304] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7593f8411564499b93f419c5b932bd54; no voters: 
I20260709 13:17:58.781134 16098 raft_consensus.cc:2804] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:58.781051 15855 raft_consensus.cc:2468] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 3.
I20260709 13:17:58.782770 16098 raft_consensus.cc:697] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Becoming Leader. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:58.783732 16098 consensus_queue.cc:237] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:58.792026 15751 catalog_manager.cc:5697] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 reported cstate change: term changed from 2 to 3, leader changed from 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1) to 7593f8411564499b93f419c5b932bd54 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "7593f8411564499b93f419c5b932bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.884068 16145 raft_consensus.cc:993] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215: : Instructing follower 7593f8411564499b93f419c5b932bd54 to start an election
I20260709 13:17:58.884667 16055 raft_consensus.cc:1081] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Signalling peer 7593f8411564499b93f419c5b932bd54 to start an election
I20260709 13:17:58.886147 16003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840"
dest_uuid: "7593f8411564499b93f419c5b932bd54"
 from {username='slave'} at 127.0.0.1:59602
I20260709 13:17:58.886660 16003 raft_consensus.cc:493] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:58.886953 16003 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.891144 16003 raft_consensus.cc:515] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:58.892712 16003 leader_election.cc:290] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 3 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:17:58.893507 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:58.893929 15855 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.893826 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:17:58.894529 15929 raft_consensus.cc:3055] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:58.894840 15929 raft_consensus.cc:740] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:17:58.895428 15929 consensus_queue.cc:260] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:58.896476 15929 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:58.898241 15855 raft_consensus.cc:2468] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 3.
I20260709 13:17:58.899333 15967 leader_election.cc:304] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:58.900041 16098 raft_consensus.cc:2804] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:58.900439 16098 raft_consensus.cc:697] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Becoming Leader. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:58.901260 15929 raft_consensus.cc:2468] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 3.
I20260709 13:17:58.901196 16098 consensus_queue.cc:237] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:58.911249 15751 catalog_manager.cc:5697] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 reported cstate change: term changed from 2 to 3, leader changed from 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2) to 7593f8411564499b93f419c5b932bd54 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "7593f8411564499b93f419c5b932bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:59.268993 15929 raft_consensus.cc:1275] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Refusing update from remote peer 7593f8411564499b93f419c5b932bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:59.270030 16098 consensus_queue.cc:1048] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:59.281081 15855 raft_consensus.cc:1275] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Refusing update from remote peer 7593f8411564499b93f419c5b932bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:59.282371 16098 consensus_queue.cc:1048] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:59.306854 15855 raft_consensus.cc:1275] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Refusing update from remote peer 7593f8411564499b93f419c5b932bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:59.308000 16098 consensus_queue.cc:1048] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:59.316633 15929 raft_consensus.cc:1275] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Refusing update from remote peer 7593f8411564499b93f419c5b932bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:59.317905 16139 consensus_queue.cc:1048] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:59.674815 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:59.684906 16003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95"
dest_uuid: "7593f8411564499b93f419c5b932bd54"
mode: GRACEFUL
new_leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:59606
I20260709 13:17:59.685374 16003 raft_consensus.cc:606] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Received request to transfer leadership to TS 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:59.689796 15855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa"
dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
mode: GRACEFUL
new_leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:52842
I20260709 13:17:59.690266 15855 raft_consensus.cc:606] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Received request to transfer leadership to TS 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:59.694557 15855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fba3dfa569214f848ebec392e46aa045"
dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
mode: GRACEFUL
new_leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:52842
I20260709 13:17:59.695030 15855 raft_consensus.cc:606] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Received request to transfer leadership to TS 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:59.700588 15854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a78c4e4394894eefa95c0bf1627fcdf9"
dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
mode: GRACEFUL
new_leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:52842
I20260709 13:17:59.701045 15854 raft_consensus.cc:606] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Received request to transfer leadership to TS 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:59.707217 16003 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840"
dest_uuid: "7593f8411564499b93f419c5b932bd54"
mode: GRACEFUL
new_leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:59606
I20260709 13:17:59.707645 16003 raft_consensus.cc:606] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Received request to transfer leadership to TS 7303e0a4d8ed41b5a3981850ceaf8215
I20260709 13:17:59.713233 16139 raft_consensus.cc:993] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54: : Instructing follower 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:59.713709 16149 raft_consensus.cc:1081] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Signalling peer 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:59.715097 15929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:17:59.715566 15929 raft_consensus.cc:493] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:59.715910 15929 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.720000 15929 raft_consensus.cc:515] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:59.721985 15929 leader_election.cc:290] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 4 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:59.722244 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:59.722260 15854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10cd7bc96b540d3b6615e11a5a86840" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:59.722994 15854 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.723894 16003 raft_consensus.cc:3055] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:59.724169 16003 raft_consensus.cc:740] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:59.724772 16003 consensus_queue.cc:260] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:59.725468 16003 raft_consensus.cc:3060] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.727325 15854 raft_consensus.cc:2468] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 4.
I20260709 13:17:59.728030 15855 raft_consensus.cc:1240] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Rejecting Update request from peer 7593f8411564499b93f419c5b932bd54 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:59.728298 15893 leader_election.cc:304] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:17:59.729095 16055 raft_consensus.cc:2804] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:59.729590 16055 raft_consensus.cc:697] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 LEADER]: Becoming Leader. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:17:59.729784 16003 raft_consensus.cc:2468] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 4.
I20260709 13:17:59.730392 16055 consensus_queue.cc:237] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:59.734081 16139 raft_consensus.cc:993] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54: : Instructing follower 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:59.734481 16139 raft_consensus.cc:1081] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Signalling peer 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:59.735888 15929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:40766
I20260709 13:17:59.736344 15929 raft_consensus.cc:493] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:59.736672 15929 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.737142 15751 catalog_manager.cc:5697] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 reported cstate change: term changed from 3 to 4, leader changed from 7593f8411564499b93f419c5b932bd54 (127.15.90.3) to 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2). New cstate: current_term: 4 leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.741503 15929 raft_consensus.cc:515] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:59.743758 15929 leader_election.cc:290] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 4 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:59.744014 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:59.744452 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:59.744724 15855 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.744969 16003 raft_consensus.cc:3055] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:59.745275 16003 raft_consensus.cc:740] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:17:59.745790 16003 consensus_queue.cc:260] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:59.747057 16003 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:59.750576 16003 raft_consensus.cc:2468] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 4.
I20260709 13:17:59.751470 15896 leader_election.cc:304] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7593f8411564499b93f419c5b932bd54; no voters: 
I20260709 13:17:59.752149 15855 raft_consensus.cc:2468] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 4.
I20260709 13:17:59.752296 16055 raft_consensus.cc:2804] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:59.752894 16055 raft_consensus.cc:697] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 LEADER]: Becoming Leader. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:17:59.753610 16055 consensus_queue.cc:237] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:59.759068 15751 catalog_manager.cc:5697] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 reported cstate change: term changed from 3 to 4, leader changed from 7593f8411564499b93f419c5b932bd54 (127.15.90.3) to 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2). New cstate: current_term: 4 leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.816334 16154 raft_consensus.cc:993] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176: : Instructing follower 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:59.816740 16090 raft_consensus.cc:1081] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Signalling peer 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:59.818024 15929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a78c4e4394894eefa95c0bf1627fcdf9"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:40776
I20260709 13:17:59.818439 15929 raft_consensus.cc:493] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:59.818689 15929 raft_consensus.cc:3060] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:59.822543 15929 raft_consensus.cc:515] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:59.823999 15929 leader_election.cc:290] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:59.824680 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c4e4394894eefa95c0bf1627fcdf9" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:59.824895 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78c4e4394894eefa95c0bf1627fcdf9" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:59.825145 15855 raft_consensus.cc:3055] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:59.825362 16003 raft_consensus.cc:3060] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:59.825486 15855 raft_consensus.cc:740] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:17:59.826109 15855 consensus_queue.cc:260] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:59.826891 15855 raft_consensus.cc:3060] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:59.829241 16003 raft_consensus.cc:2468] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 2.
I20260709 13:17:59.830075 15896 leader_election.cc:304] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7593f8411564499b93f419c5b932bd54; no voters: 
I20260709 13:17:59.830711 16055 raft_consensus.cc:2804] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:59.830719 15855 raft_consensus.cc:2468] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 2.
I20260709 13:17:59.831241 16055 raft_consensus.cc:697] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Becoming Leader. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:17:59.832027 16055 consensus_queue.cc:237] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:59.838066 15751 catalog_manager.cc:5697] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 reported cstate change: term changed from 1 to 2, leader changed from 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1) to 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:59.982776 16154 raft_consensus.cc:993] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176: : Instructing follower 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:59.983170 16090 raft_consensus.cc:1081] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Signalling peer 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:17:59.984406 15929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:40776
I20260709 13:17:59.984853 15929 raft_consensus.cc:493] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:59.985110 15929 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.988832 15929 raft_consensus.cc:515] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:59.990310 15929 leader_election.cc:290] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 3 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:17:59.990953 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:17:59.991313 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:17:59.991410 15855 raft_consensus.cc:3055] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:59.991873 15855 raft_consensus.cc:740] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:17:59.991895 16003 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.992579 15855 consensus_queue.cc:260] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:17:59.993381 15855 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:59.995882 16003 raft_consensus.cc:2468] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 3.
I20260709 13:17:59.996781 15896 leader_election.cc:304] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7593f8411564499b93f419c5b932bd54; no voters: 
I20260709 13:17:59.997370 16055 raft_consensus.cc:2804] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:59.997610 15855 raft_consensus.cc:2468] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 3.
I20260709 13:17:59.997867 16055 raft_consensus.cc:697] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 LEADER]: Becoming Leader. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:17:59.998754 16055 consensus_queue.cc:237] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:00.005216 15751 catalog_manager.cc:5697] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 reported cstate change: term changed from 2 to 3, leader changed from 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1) to 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2). New cstate: current_term: 3 leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.080498 16154 raft_consensus.cc:993] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176: : Instructing follower 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:18:00.080885 16090 raft_consensus.cc:1081] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Signalling peer 7303e0a4d8ed41b5a3981850ceaf8215 to start an election
I20260709 13:18:00.082226 15929 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fba3dfa569214f848ebec392e46aa045"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
 from {username='slave'} at 127.0.0.1:40776
I20260709 13:18:00.082652 15929 raft_consensus.cc:493] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:00.082904 15929 raft_consensus.cc:3060] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.086805 15929 raft_consensus.cc:515] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:00.088071 15929 leader_election.cc:290] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:18:00.088868 15855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba3dfa569214f848ebec392e46aa045" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:18:00.089010 16003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba3dfa569214f848ebec392e46aa045" candidate_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:18:00.089355 15855 raft_consensus.cc:3055] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:00.089500 16003 raft_consensus.cc:3060] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.089599 15855 raft_consensus.cc:740] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:18:00.090302 15855 consensus_queue.cc:260] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:00.091061 15855 raft_consensus.cc:3060] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:00.094080 16003 raft_consensus.cc:2468] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 2.
I20260709 13:18:00.094918 15855 raft_consensus.cc:2468] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7303e0a4d8ed41b5a3981850ceaf8215 in term 2.
I20260709 13:18:00.094909 15896 leader_election.cc:304] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7303e0a4d8ed41b5a3981850ceaf8215, 7593f8411564499b93f419c5b932bd54; no voters: 
I20260709 13:18:00.095803 16055 raft_consensus.cc:2804] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:00.096259 16055 raft_consensus.cc:697] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Becoming Leader. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:18:00.096969 16055 consensus_queue.cc:237] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:00.102640 15751 catalog_manager.cc:5697] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 reported cstate change: term changed from 1 to 2, leader changed from 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1) to 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.161438 16003 raft_consensus.cc:1275] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 4 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:00.162567 16055 consensus_queue.cc:1048] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:00.175616 15855 raft_consensus.cc:1275] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:00.176827 16055 consensus_queue.cc:1048] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:00.210534 15855 raft_consensus.cc:1275] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:00.211871 16055 consensus_queue.cc:1048] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:00.218918 16003 raft_consensus.cc:1275] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 4 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:00.220611 16156 consensus_queue.cc:1048] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:00.241613 16003 raft_consensus.cc:1275] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:00.242658 16156 consensus_queue.cc:1048] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:00.251894 15855 raft_consensus.cc:1275] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:00.253116 16156 consensus_queue.cc:1048] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:00.384644 16003 raft_consensus.cc:1275] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:00.385864 16156 consensus_queue.cc:1048] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:00.393963 15855 raft_consensus.cc:1275] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:00.396145 16156 consensus_queue.cc:1048] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:00.571532 16003 raft_consensus.cc:1275] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:00.572805 16164 consensus_queue.cc:1048] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:00.575114 15854 raft_consensus.cc:1275] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Refusing update from remote peer 7303e0a4d8ed41b5a3981850ceaf8215: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:00.576392 16164 consensus_queue.cc:1048] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:02.717924 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:02.725674 15929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
mode: GRACEFUL
new_leader_uuid: "7593f8411564499b93f419c5b932bd54"
 from {username='slave'} at 127.0.0.1:37004
I20260709 13:18:02.726580 15929 raft_consensus.cc:606] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Received request to transfer leadership to TS 7593f8411564499b93f419c5b932bd54
I20260709 13:18:02.729547 15929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
mode: GRACEFUL
new_leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
 from {username='slave'} at 127.0.0.1:37004
I20260709 13:18:02.730013 15929 raft_consensus.cc:606] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 LEADER]: Received request to transfer leadership to TS 7f0edeb2a4fa4371af359d8d7a4ef176
I20260709 13:18:02.732120 15929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
mode: GRACEFUL
new_leader_uuid: "7593f8411564499b93f419c5b932bd54"
 from {username='slave'} at 127.0.0.1:37004
I20260709 13:18:02.732542 15929 raft_consensus.cc:606] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 LEADER]: Received request to transfer leadership to TS 7593f8411564499b93f419c5b932bd54
I20260709 13:18:02.734644 15929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acd3fef44c3c40818e7fa0100b880e49"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
mode: GRACEFUL
new_leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
 from {username='slave'} at 127.0.0.1:37004
I20260709 13:18:02.735091 15929 raft_consensus.cc:606] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 LEADER]: Received request to transfer leadership to TS 7f0edeb2a4fa4371af359d8d7a4ef176
I20260709 13:18:02.737277 15929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1"
dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
mode: GRACEFUL
new_leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
 from {username='slave'} at 127.0.0.1:37004
I20260709 13:18:02.737670 15929 raft_consensus.cc:606] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Received request to transfer leadership to TS 7f0edeb2a4fa4371af359d8d7a4ef176
I20260709 13:18:02.738773 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:02.739246 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:02.931452 16164 raft_consensus.cc:993] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215: : Instructing follower 7f0edeb2a4fa4371af359d8d7a4ef176 to start an election
I20260709 13:18:02.932053 16055 raft_consensus.cc:1081] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 LEADER]: Signalling peer 7f0edeb2a4fa4371af359d8d7a4ef176 to start an election
I20260709 13:18:02.933485 15854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acd3fef44c3c40818e7fa0100b880e49"
dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
 from {username='slave'} at 127.0.0.1:52832
I20260709 13:18:02.933962 15854 raft_consensus.cc:493] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:02.934267 15854 raft_consensus.cc:3060] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.940119 15854 raft_consensus.cc:515] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:02.942004 15854 leader_election.cc:290] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 2 election: Requested vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:18:02.943029 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd3fef44c3c40818e7fa0100b880e49" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:18:02.943490 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acd3fef44c3c40818e7fa0100b880e49" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:18:02.943820 15929 raft_consensus.cc:3055] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:02.944108 16004 raft_consensus.cc:3060] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.944169 15929 raft_consensus.cc:740] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:18:02.945137 15929 consensus_queue.cc:260] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:02.946067 15929 raft_consensus.cc:3060] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:02.949977 16004 raft_consensus.cc:2468] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 2.
I20260709 13:18:02.950759 15929 raft_consensus.cc:2468] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 2.
I20260709 13:18:02.951332 15821 leader_election.cc:304] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:18:02.953033 16174 raft_consensus.cc:2804] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:02.953933 16174 raft_consensus.cc:697] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Becoming Leader. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:18:02.954830 16174 consensus_queue.cc:237] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:02.962424 15751 catalog_manager.cc:5697] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 reported cstate change: term changed from 1 to 2, leader changed from 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2) to 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.993427 16164 raft_consensus.cc:993] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215: : Instructing follower 7f0edeb2a4fa4371af359d8d7a4ef176 to start an election
I20260709 13:18:02.993932 16055 raft_consensus.cc:1081] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 LEADER]: Signalling peer 7f0edeb2a4fa4371af359d8d7a4ef176 to start an election
I20260709 13:18:02.995311 15854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95"
dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
 from {username='slave'} at 127.0.0.1:52832
I20260709 13:18:02.995877 15854 raft_consensus.cc:493] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:02.996253 15854 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.001484 15854 raft_consensus.cc:515] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.003008 15854 leader_election.cc:290] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 5 election: Requested vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:18:03.003845 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:18:03.004014 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e48b640b0e42b19311687d79f68f95" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:18:03.004508 15929 raft_consensus.cc:3055] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:03.004616 16004 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.004849 15929 raft_consensus.cc:740] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:18:03.005661 15929 consensus_queue.cc:260] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.006493 15929 raft_consensus.cc:3060] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.009665 16004 raft_consensus.cc:2468] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 5.
I20260709 13:18:03.010596 15821 leader_election.cc:304] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:18:03.010716 15929 raft_consensus.cc:2468] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 5.
I20260709 13:18:03.011438 16174 raft_consensus.cc:2804] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:03.011941 16174 raft_consensus.cc:697] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 5 LEADER]: Becoming Leader. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:18:03.012715 16174 consensus_queue.cc:237] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.019737 15751 catalog_manager.cc:5697] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 reported cstate change: term changed from 4 to 5, leader changed from 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2) to 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1). New cstate: current_term: 5 leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.034668 16164 raft_consensus.cc:993] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215: : Instructing follower 7f0edeb2a4fa4371af359d8d7a4ef176 to start an election
I20260709 13:18:03.035157 16055 raft_consensus.cc:1081] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Signalling peer 7f0edeb2a4fa4371af359d8d7a4ef176 to start an election
I20260709 13:18:03.036618 15854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1"
dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
 from {username='slave'} at 127.0.0.1:52832
I20260709 13:18:03.037070 15854 raft_consensus.cc:493] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:03.037366 15854 raft_consensus.cc:3060] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.042439 15854 raft_consensus.cc:515] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.044088 15854 leader_election.cc:290] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 3 election: Requested vote from peers 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273), 7593f8411564499b93f419c5b932bd54 (127.15.90.3:36689)
I20260709 13:18:03.044718 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:18:03.045068 16004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca501d788d864a278a1fbb9f7ea000d1" candidate_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7593f8411564499b93f419c5b932bd54"
I20260709 13:18:03.045300 15929 raft_consensus.cc:3055] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:03.045701 16004 raft_consensus.cc:3060] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.045711 15929 raft_consensus.cc:740] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:18:03.046590 15929 consensus_queue.cc:260] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.047394 15929 raft_consensus.cc:3060] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.051069 16004 raft_consensus.cc:2468] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 3.
I20260709 13:18:03.051143 15929 raft_consensus.cc:2468] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f0edeb2a4fa4371af359d8d7a4ef176 in term 3.
I20260709 13:18:03.052250 15821 leader_election.cc:304] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:18:03.053093 16174 raft_consensus.cc:2804] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:03.053442 16174 raft_consensus.cc:697] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 LEADER]: Becoming Leader. State: Replica: 7f0edeb2a4fa4371af359d8d7a4ef176, State: Running, Role: LEADER
I20260709 13:18:03.054203 16174 consensus_queue.cc:237] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.060519 15751 catalog_manager.cc:5697] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 reported cstate change: term changed from 2 to 3, leader changed from 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2) to 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.109862 16164 raft_consensus.cc:993] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215: : Instructing follower 7593f8411564499b93f419c5b932bd54 to start an election
I20260709 13:18:03.110412 16164 raft_consensus.cc:1081] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 LEADER]: Signalling peer 7593f8411564499b93f419c5b932bd54 to start an election
I20260709 13:18:03.111874 16004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa"
dest_uuid: "7593f8411564499b93f419c5b932bd54"
 from {username='slave'} at 127.0.0.1:59602
I20260709 13:18:03.112424 16004 raft_consensus.cc:493] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:03.112748 16004 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.117918 16004 raft_consensus.cc:515] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.119622 16004 leader_election.cc:290] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 4 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:18:03.120406 15854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:18:03.120834 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796ca746f0584355aa2b9dcb5b4d3faa" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:18:03.121037 15854 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.121378 15929 raft_consensus.cc:3055] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:03.121647 15929 raft_consensus.cc:740] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:18:03.122269 15929 consensus_queue.cc:260] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.123226 15929 raft_consensus.cc:3060] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.126106 15854 raft_consensus.cc:2468] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 4.
I20260709 13:18:03.127311 15967 leader_election.cc:304] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:18:03.127874 15929 raft_consensus.cc:2468] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 4.
I20260709 13:18:03.128257 16149 raft_consensus.cc:2804] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:03.129429 16149 raft_consensus.cc:697] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 4 LEADER]: Becoming Leader. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:18:03.130384 16149 consensus_queue.cc:237] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.136969 15751 catalog_manager.cc:5697] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 reported cstate change: term changed from 3 to 4, leader changed from 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2) to 7593f8411564499b93f419c5b932bd54 (127.15.90.3). New cstate: current_term: 4 leader_uuid: "7593f8411564499b93f419c5b932bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.262494 16055 raft_consensus.cc:993] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215: : Instructing follower 7593f8411564499b93f419c5b932bd54 to start an election
I20260709 13:18:03.262916 16164 raft_consensus.cc:1081] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Signalling peer 7593f8411564499b93f419c5b932bd54 to start an election
I20260709 13:18:03.264106 16004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6"
dest_uuid: "7593f8411564499b93f419c5b932bd54"
 from {username='slave'} at 127.0.0.1:59602
I20260709 13:18:03.264524 16004 raft_consensus.cc:493] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:03.264768 16004 raft_consensus.cc:3060] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.269189 16004 raft_consensus.cc:515] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.270692 16004 leader_election.cc:290] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 3 election: Requested vote from peers 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081), 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273)
I20260709 13:18:03.271317 15854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176"
I20260709 13:18:03.271487 15929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220fc6b52d1f4729a208ff1c73c0eca6" candidate_uuid: "7593f8411564499b93f419c5b932bd54" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7303e0a4d8ed41b5a3981850ceaf8215"
I20260709 13:18:03.271835 15854 raft_consensus.cc:3060] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.272017 15929 raft_consensus.cc:3055] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:03.272377 15929 raft_consensus.cc:740] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7303e0a4d8ed41b5a3981850ceaf8215, State: Running, Role: LEADER
I20260709 13:18:03.272907 15929 consensus_queue.cc:260] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.273753 15929 raft_consensus.cc:3060] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:03.276297 15854 raft_consensus.cc:2468] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 3.
I20260709 13:18:03.277127 15967 leader_election.cc:304] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7593f8411564499b93f419c5b932bd54, 7f0edeb2a4fa4371af359d8d7a4ef176; no voters: 
I20260709 13:18:03.277719 16149 raft_consensus.cc:2804] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:03.278039 15929 raft_consensus.cc:2468] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7593f8411564499b93f419c5b932bd54 in term 3.
I20260709 13:18:03.278100 16149 raft_consensus.cc:697] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Becoming Leader. State: Replica: 7593f8411564499b93f419c5b932bd54, State: Running, Role: LEADER
I20260709 13:18:03.279062 16149 consensus_queue.cc:237] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } }
I20260709 13:18:03.284935 15751 catalog_manager.cc:5697] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 reported cstate change: term changed from 2 to 3, leader changed from 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2) to 7593f8411564499b93f419c5b932bd54 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "7593f8411564499b93f419c5b932bd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.399780 15929 raft_consensus.cc:1275] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 5 FOLLOWER]: Refusing update from remote peer 7f0edeb2a4fa4371af359d8d7a4ef176: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:03.400820 16174 consensus_queue.cc:1048] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:03.413538 16004 raft_consensus.cc:1275] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 5 FOLLOWER]: Refusing update from remote peer 7f0edeb2a4fa4371af359d8d7a4ef176: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:03.415295 16174 consensus_queue.cc:1048] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:18:03.430902 16004 raft_consensus.cc:1275] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Refusing update from remote peer 7f0edeb2a4fa4371af359d8d7a4ef176: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:03.432127 16189 consensus_queue.cc:1048] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:03.441442 15930 raft_consensus.cc:1275] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Refusing update from remote peer 7f0edeb2a4fa4371af359d8d7a4ef176: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:03.443802 16193 consensus_queue.cc:1048] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:03.558341 15930 raft_consensus.cc:1275] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Refusing update from remote peer 7f0edeb2a4fa4371af359d8d7a4ef176: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:03.559428 16193 consensus_queue.cc:1048] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:03.567909 16004 raft_consensus.cc:1275] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Refusing update from remote peer 7f0edeb2a4fa4371af359d8d7a4ef176: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:03.569381 16193 consensus_queue.cc:1048] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7593f8411564499b93f419c5b932bd54" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 36689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:03.619992 15930 raft_consensus.cc:1275] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 FOLLOWER]: Refusing update from remote peer 7593f8411564499b93f419c5b932bd54: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:03.621506 16183 consensus_queue.cc:1048] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:03.629658 15854 raft_consensus.cc:1275] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Refusing update from remote peer 7593f8411564499b93f419c5b932bd54: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:03.632444 16198 consensus_queue.cc:1048] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:03.666769 15930 raft_consensus.cc:1275] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Refusing update from remote peer 7593f8411564499b93f419c5b932bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:03.667850 16198 consensus_queue.cc:1048] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7303e0a4d8ed41b5a3981850ceaf8215" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:03.676277 15854 raft_consensus.cc:1275] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Refusing update from remote peer 7593f8411564499b93f419c5b932bd54: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:03.677788 16183 consensus_queue.cc:1048] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0edeb2a4fa4371af359d8d7a4ef176" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 35081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:03.740087 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:03.745196 15720 tablet_server.cc:179] TabletServer@127.15.90.1:0 shutting down...
I20260709 13:18:03.767364 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:03.768049 15720 tablet_replica.cc:333] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176: stopping tablet replica
I20260709 13:18:03.768673 15720 raft_consensus.cc:2243] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.769204 15720 raft_consensus.cc:2272] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.771623 15720 tablet_replica.cc:333] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176: stopping tablet replica
I20260709 13:18:03.772162 15720 raft_consensus.cc:2243] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:03.772853 15720 raft_consensus.cc:2272] T ca501d788d864a278a1fbb9f7ea000d1 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.774627 15720 tablet_replica.cc:333] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176: stopping tablet replica
I20260709 13:18:03.775095 15720 raft_consensus.cc:2243] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.775486 15720 raft_consensus.cc:2272] T fba3dfa569214f848ebec392e46aa045 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.777041 15720 tablet_replica.cc:333] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176: stopping tablet replica
I20260709 13:18:03.777503 15720 raft_consensus.cc:2243] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.777874 15720 raft_consensus.cc:2272] T 796ca746f0584355aa2b9dcb5b4d3faa P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.779579 15720 tablet_replica.cc:333] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176: stopping tablet replica
I20260709 13:18:03.780148 15720 raft_consensus.cc:2243] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.780627 15720 raft_consensus.cc:2272] T a10cd7bc96b540d3b6615e11a5a86840 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.782156 15720 tablet_replica.cc:333] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176: stopping tablet replica
I20260709 13:18:03.782612 15720 raft_consensus.cc:2243] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.783010 15720 raft_consensus.cc:2272] T a78c4e4394894eefa95c0bf1627fcdf9 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.784500 15720 tablet_replica.cc:333] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176: stopping tablet replica
I20260709 13:18:03.784940 15720 raft_consensus.cc:2243] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:18:03.785552 15720 raft_consensus.cc:2272] T 62e48b640b0e42b19311687d79f68f95 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.787130 15720 tablet_replica.cc:333] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176: stopping tablet replica
I20260709 13:18:03.787524 15720 raft_consensus.cc:2243] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.787989 15720 raft_consensus.cc:2272] T 91a8788d489444fe98326d4ea14fcdc4 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.789740 15720 tablet_replica.cc:333] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176: stopping tablet replica
I20260709 13:18:03.790287 15720 raft_consensus.cc:2243] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:03.790918 15720 raft_consensus.cc:2272] T acd3fef44c3c40818e7fa0100b880e49 P 7f0edeb2a4fa4371af359d8d7a4ef176 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:03.905303 15893 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.90.1:35081: connect: Connection refused (error 111)
I20260709 13:18:03.906788 15720 tablet_server.cc:196] TabletServer@127.15.90.1:0 shutdown complete.
W20260709 13:18:03.909152 15893 consensus_peers.cc:597] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 -> Peer 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081): Couldn't send request to peer 7f0edeb2a4fa4371af359d8d7a4ef176. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:35081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:03.917578 15893 consensus_peers.cc:597] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 -> Peer 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081): Couldn't send request to peer 7f0edeb2a4fa4371af359d8d7a4ef176. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:35081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:03.925918 15720 tablet_server.cc:179] TabletServer@127.15.90.2:0 shutting down...
W20260709 13:18:03.932250 15893 consensus_peers.cc:597] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 -> Peer 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081): Couldn't send request to peer 7f0edeb2a4fa4371af359d8d7a4ef176. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:35081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:03.951135 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:18:03.951236 15967 consensus_peers.cc:597] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 -> Peer 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273): Couldn't send request to peer 7303e0a4d8ed41b5a3981850ceaf8215. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:03.951932 15720 tablet_replica.cc:333] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215: stopping tablet replica
I20260709 13:18:03.952476 15720 raft_consensus.cc:2243] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.952819 15720 raft_consensus.cc:2272] T 62e48b640b0e42b19311687d79f68f95 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.954594 15720 tablet_replica.cc:333] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215: stopping tablet replica
I20260709 13:18:03.955088 15720 raft_consensus.cc:2243] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:18:03.955770 15720 raft_consensus.cc:2272] T a10cd7bc96b540d3b6615e11a5a86840 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.957398 15720 tablet_replica.cc:333] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215: stopping tablet replica
I20260709 13:18:03.957860 15720 raft_consensus.cc:2243] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:03.958496 15720 raft_consensus.cc:2272] T a78c4e4394894eefa95c0bf1627fcdf9 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.960003 15720 tablet_replica.cc:333] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215: stopping tablet replica
I20260709 13:18:03.960397 15720 raft_consensus.cc:2243] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.960726 15720 raft_consensus.cc:2272] T 796ca746f0584355aa2b9dcb5b4d3faa P 7303e0a4d8ed41b5a3981850ceaf8215 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.962387 15720 tablet_replica.cc:333] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215: stopping tablet replica
I20260709 13:18:03.962831 15720 raft_consensus.cc:2243] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.963191 15720 raft_consensus.cc:2272] T ca501d788d864a278a1fbb9f7ea000d1 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.965147 15720 tablet_replica.cc:333] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215: stopping tablet replica
I20260709 13:18:03.965613 15720 raft_consensus.cc:2243] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:03.966269 15720 raft_consensus.cc:2272] T fba3dfa569214f848ebec392e46aa045 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.967741 15720 tablet_replica.cc:333] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215: stopping tablet replica
I20260709 13:18:03.968178 15720 raft_consensus.cc:2243] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.968541 15720 raft_consensus.cc:2272] T 91a8788d489444fe98326d4ea14fcdc4 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.970077 15720 tablet_replica.cc:333] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215: stopping tablet replica
I20260709 13:18:03.970491 15720 raft_consensus.cc:2243] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.970842 15720 raft_consensus.cc:2272] T acd3fef44c3c40818e7fa0100b880e49 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.972667 15720 tablet_replica.cc:333] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215: stopping tablet replica
I20260709 13:18:03.973083 15720 raft_consensus.cc:2243] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:03.973436 15720 raft_consensus.cc:2272] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7303e0a4d8ed41b5a3981850ceaf8215 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:03.999665 15720 tablet_server.cc:196] TabletServer@127.15.90.2:0 shutdown complete.
W20260709 13:18:04.005774 15967 consensus_peers.cc:597] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 -> Peer 7f0edeb2a4fa4371af359d8d7a4ef176 (127.15.90.1:35081): Couldn't send request to peer 7f0edeb2a4fa4371af359d8d7a4ef176. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:35081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.016590 15720 tablet_server.cc:179] TabletServer@127.15.90.3:0 shutting down...
I20260709 13:18:04.039152 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:04.039839 15720 tablet_replica.cc:333] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54: stopping tablet replica
I20260709 13:18:04.040457 15720 raft_consensus.cc:2243] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:04.041242 15720 raft_consensus.cc:2272] T 220fc6b52d1f4729a208ff1c73c0eca6 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:04.041746 15967 consensus_peers.cc:597] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 -> Peer 7303e0a4d8ed41b5a3981850ceaf8215 (127.15.90.2:43273): Couldn't send request to peer 7303e0a4d8ed41b5a3981850ceaf8215. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:43273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:04.043726 15720 tablet_replica.cc:333] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54: stopping tablet replica
I20260709 13:18:04.044245 15720 raft_consensus.cc:2243] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:04.044636 15720 raft_consensus.cc:2272] T fba3dfa569214f848ebec392e46aa045 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:04.046157 15720 tablet_replica.cc:333] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54: stopping tablet replica
I20260709 13:18:04.046628 15720 raft_consensus.cc:2243] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:04.047016 15720 raft_consensus.cc:2272] T ca501d788d864a278a1fbb9f7ea000d1 P 7593f8411564499b93f419c5b932bd54 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:04.049527 15720 tablet_replica.cc:333] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54: stopping tablet replica
I20260709 13:18:04.050026 15720 raft_consensus.cc:2243] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:04.050705 15720 raft_consensus.cc:2272] T 91a8788d489444fe98326d4ea14fcdc4 P 7593f8411564499b93f419c5b932bd54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:04.052175 15720 tablet_replica.cc:333] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54: stopping tablet replica
I20260709 13:18:04.052629 15720 raft_consensus.cc:2243] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:04.052984 15720 raft_consensus.cc:2272] T acd3fef44c3c40818e7fa0100b880e49 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:04.054638 15720 tablet_replica.cc:333] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54: stopping tablet replica
I20260709 13:18:04.055094 15720 raft_consensus.cc:2243] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:04.055487 15720 raft_consensus.cc:2272] T a10cd7bc96b540d3b6615e11a5a86840 P 7593f8411564499b93f419c5b932bd54 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:04.056963 15720 tablet_replica.cc:333] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54: stopping tablet replica
I20260709 13:18:04.057379 15720 raft_consensus.cc:2243] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:04.057750 15720 raft_consensus.cc:2272] T a78c4e4394894eefa95c0bf1627fcdf9 P 7593f8411564499b93f419c5b932bd54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:04.059195 15720 tablet_replica.cc:333] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54: stopping tablet replica
I20260709 13:18:04.059630 15720 raft_consensus.cc:2243] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:18:04.060324 15720 raft_consensus.cc:2272] T 796ca746f0584355aa2b9dcb5b4d3faa P 7593f8411564499b93f419c5b932bd54 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:04.062137 15720 tablet_replica.cc:333] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54: stopping tablet replica
I20260709 13:18:04.062565 15720 raft_consensus.cc:2243] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:04.062932 15720 raft_consensus.cc:2272] T 62e48b640b0e42b19311687d79f68f95 P 7593f8411564499b93f419c5b932bd54 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:04.087564 15720 tablet_server.cc:196] TabletServer@127.15.90.3:0 shutdown complete.
I20260709 13:18:04.103380 15720 master.cc:562] Master@127.15.90.62:41469 shutting down...
I20260709 13:18:04.294564 15720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:04.295125 15720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:04.295490 15720 tablet_replica.cc:333] T 00000000000000000000000000000000 P aea36f8b429b4a08ba04eb88dacbbeb3: stopping tablet replica
I20260709 13:18:04.314177 15720 master.cc:584] Master@127.15.90.62:41469 shutdown complete.
7303e0a4d8ed41b5a3981850ceaf8215  4
7593f8411564499b93f419c5b932bd54  1
7f0edeb2a4fa4371af359d8d7a4ef176  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12529 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:18:04.353964 15720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.90.62:38945
I20260709 13:18:04.355041 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:04.360414 16206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:04.360519 16207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:04.361521 16209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:04.362718 15720 server_base.cc:1061] running on GCE node
I20260709 13:18:04.363480 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:04.363648 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:04.363852 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603084363819 us; error 0 us; skew 500 ppm
I20260709 13:18:04.364352 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:04.366591 15720 webserver.cc:533] Webserver started at http://127.15.90.62:44527/ using document root <none> and password file <none>
I20260709 13:18:04.367072 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:04.367249 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:04.367516 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:04.368752 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/master-0-root/instance:
uuid: "189c8a6a0130456283c1f94f74c1bb3b"
format_stamp: "Formatted at 2026-07-09 13:18:04 on dist-test-slave-fpp7"
I20260709 13:18:04.372845 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:04.375928 16214 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:04.376606 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:04.376870 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/master-0-root
uuid: "189c8a6a0130456283c1f94f74c1bb3b"
format_stamp: "Formatted at 2026-07-09 13:18:04 on dist-test-slave-fpp7"
I20260709 13:18:04.377141 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:04.386147 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:04.387247 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:04.423310 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.62:38945
I20260709 13:18:04.423400 16265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.62:38945 every 8 connection(s)
I20260709 13:18:04.427181 16266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.436105 16266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b: Bootstrap starting.
I20260709 13:18:04.440516 16266 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:04.444268 16266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b: No bootstrap required, opened a new log
I20260709 13:18:04.446166 16266 raft_consensus.cc:359] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189c8a6a0130456283c1f94f74c1bb3b" member_type: VOTER }
I20260709 13:18:04.446504 16266 raft_consensus.cc:385] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:04.446673 16266 raft_consensus.cc:740] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189c8a6a0130456283c1f94f74c1bb3b, State: Initialized, Role: FOLLOWER
I20260709 13:18:04.447220 16266 consensus_queue.cc:260] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189c8a6a0130456283c1f94f74c1bb3b" member_type: VOTER }
I20260709 13:18:04.447609 16266 raft_consensus.cc:399] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:04.447868 16266 raft_consensus.cc:493] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:04.448072 16266 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:04.451897 16266 raft_consensus.cc:515] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189c8a6a0130456283c1f94f74c1bb3b" member_type: VOTER }
I20260709 13:18:04.452323 16266 leader_election.cc:304] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 189c8a6a0130456283c1f94f74c1bb3b; no voters: 
I20260709 13:18:04.453326 16266 leader_election.cc:290] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:04.453688 16269 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:04.454881 16269 raft_consensus.cc:697] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [term 1 LEADER]: Becoming Leader. State: Replica: 189c8a6a0130456283c1f94f74c1bb3b, State: Running, Role: LEADER
I20260709 13:18:04.455557 16269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189c8a6a0130456283c1f94f74c1bb3b" member_type: VOTER }
I20260709 13:18:04.456174 16266 sys_catalog.cc:565] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:04.459734 16271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 189c8a6a0130456283c1f94f74c1bb3b. Latest consensus state: current_term: 1 leader_uuid: "189c8a6a0130456283c1f94f74c1bb3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189c8a6a0130456283c1f94f74c1bb3b" member_type: VOTER } }
I20260709 13:18:04.460427 16271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:04.460548 16270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "189c8a6a0130456283c1f94f74c1bb3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189c8a6a0130456283c1f94f74c1bb3b" member_type: VOTER } }
I20260709 13:18:04.461381 16270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:04.468459 16276 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:04.474365 16276 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:04.475319 15720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:04.482532 16276 catalog_manager.cc:1383] Generated new cluster ID: fa72ec137b2e448dbb0bde2c4955e916
I20260709 13:18:04.482806 16276 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:04.504732 16276 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:04.505937 16276 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:04.518652 16276 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b: Generated new TSK 0
I20260709 13:18:04.519170 16276 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:04.541735 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:04.547079 16287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:04.548274 16288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:04.549567 16290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:04.549801 15720 server_base.cc:1061] running on GCE node
I20260709 13:18:04.550640 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:04.550848 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:04.551033 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603084551017 us; error 0 us; skew 500 ppm
I20260709 13:18:04.551535 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:04.553719 15720 webserver.cc:533] Webserver started at http://127.15.90.1:40349/ using document root <none> and password file <none>
I20260709 13:18:04.554211 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:04.554411 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:04.554674 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:04.555670 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-0-root/instance:
uuid: "930e86a11db843908dabef220ce44c83"
format_stamp: "Formatted at 2026-07-09 13:18:04 on dist-test-slave-fpp7"
I20260709 13:18:04.560070 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:18:04.562939 16295 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:04.563798 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:18:04.564126 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-0-root
uuid: "930e86a11db843908dabef220ce44c83"
format_stamp: "Formatted at 2026-07-09 13:18:04 on dist-test-slave-fpp7"
I20260709 13:18:04.564363 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:04.596232 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:04.597389 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:04.598796 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:04.601011 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:04.601176 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:04.601451 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:04.601601 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:04.640591 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.1:33797
I20260709 13:18:04.640698 16357 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.1:33797 every 8 connection(s)
I20260709 13:18:04.645373 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:04.651950 16362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:04.652254 16363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:04.656143 15720 server_base.cc:1061] running on GCE node
W20260709 13:18:04.656524 16365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:04.657451 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:04.657652 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:04.657770 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603084657759 us; error 0 us; skew 500 ppm
I20260709 13:18:04.658259 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:04.660808 15720 webserver.cc:533] Webserver started at http://127.15.90.2:46213/ using document root <none> and password file <none>
I20260709 13:18:04.661337 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:04.661589 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:04.661875 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:04.662863 16358 heartbeater.cc:344] Connected to a master server at 127.15.90.62:38945
I20260709 13:18:04.663208 16358 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:04.663184 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-1-root/instance:
uuid: "17291dc3920540e780a6a73de6cbbe50"
format_stamp: "Formatted at 2026-07-09 13:18:04 on dist-test-slave-fpp7"
I20260709 13:18:04.664115 16358 heartbeater.cc:507] Master 127.15.90.62:38945 requested a full tablet report, sending...
I20260709 13:18:04.666152 16231 ts_manager.cc:194] Registered new tserver with Master: 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797)
I20260709 13:18:04.668011 16231 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50604
I20260709 13:18:04.668190 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:04.671608 16370 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:04.672365 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:18:04.672657 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-1-root
uuid: "17291dc3920540e780a6a73de6cbbe50"
format_stamp: "Formatted at 2026-07-09 13:18:04 on dist-test-slave-fpp7"
I20260709 13:18:04.672883 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:04.687209 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:04.688462 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:04.689867 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:04.692005 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:04.692219 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:04.692471 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:04.692638 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:04.731351 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.2:43477
I20260709 13:18:04.731491 16432 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.2:43477 every 8 connection(s)
I20260709 13:18:04.735776 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:04.742677 16436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:04.744310 16437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:04.746640 15720 server_base.cc:1061] running on GCE node
W20260709 13:18:04.746826 16439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:04.747963 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:18:04.748087 16433 heartbeater.cc:344] Connected to a master server at 127.15.90.62:38945
W20260709 13:18:04.748255 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:04.748519 16433 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:04.748553 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603084748535 us; error 0 us; skew 500 ppm
I20260709 13:18:04.749224 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:04.749289 16433 heartbeater.cc:507] Master 127.15.90.62:38945 requested a full tablet report, sending...
I20260709 13:18:04.751361 16231 ts_manager.cc:194] Registered new tserver with Master: 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:04.751820 15720 webserver.cc:533] Webserver started at http://127.15.90.3:39257/ using document root <none> and password file <none>
I20260709 13:18:04.752318 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:04.752542 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:04.752802 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:04.752923 16231 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50612
I20260709 13:18:04.754024 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-2-root/instance:
uuid: "a10ba23efa524f30995781ccc0499c2d"
format_stamp: "Formatted at 2026-07-09 13:18:04 on dist-test-slave-fpp7"
I20260709 13:18:04.758136 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:18:04.761061 16444 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:04.761772 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:18:04.762060 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-2-root
uuid: "a10ba23efa524f30995781ccc0499c2d"
format_stamp: "Formatted at 2026-07-09 13:18:04 on dist-test-slave-fpp7"
I20260709 13:18:04.762332 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783603071664575-15720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:04.770450 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:04.771565 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:04.772986 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:04.775130 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:04.775346 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:04.775630 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:04.775861 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:18:04.813508 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.3:32869
I20260709 13:18:04.813598 16506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.3:32869 every 8 connection(s)
I20260709 13:18:04.826134 16507 heartbeater.cc:344] Connected to a master server at 127.15.90.62:38945
I20260709 13:18:04.826516 16507 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:04.827191 16507 heartbeater.cc:507] Master 127.15.90.62:38945 requested a full tablet report, sending...
I20260709 13:18:04.828938 16231 ts_manager.cc:194] Registered new tserver with Master: a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:04.829836 15720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013270576s
I20260709 13:18:04.830257 16231 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50614
I20260709 13:18:04.853619 16231 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50620:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:04.856424 16231 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:04.932129 16472 tablet_service.cc:1511] Processing CreateTablet for tablet 205bc28889664f218fa2d592c18de6ac (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:18:04.933771 16472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205bc28889664f218fa2d592c18de6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.936283 16467 tablet_service.cc:1511] Processing CreateTablet for tablet 094e888869a94c62bd30372b45ac5f80 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:18:04.937649 16467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094e888869a94c62bd30372b45ac5f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.937400 16470 tablet_service.cc:1511] Processing CreateTablet for tablet 1885eb35b6a841d2b89c935e9962957e (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:18:04.938673 16470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1885eb35b6a841d2b89c935e9962957e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.936283 16471 tablet_service.cc:1511] Processing CreateTablet for tablet 21561d4c17834bd0b39353286e085a27 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:18:04.940380 16398 tablet_service.cc:1511] Processing CreateTablet for tablet 205bc28889664f218fa2d592c18de6ac (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:18:04.940838 16469 tablet_service.cc:1511] Processing CreateTablet for tablet ac47935fb81d4c90bb17cd9c7e76efed (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:18:04.941653 16398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205bc28889664f218fa2d592c18de6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.942085 16466 tablet_service.cc:1511] Processing CreateTablet for tablet ddd7c3546314472295f927165b69929c (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:18:04.943085 16468 tablet_service.cc:1511] Processing CreateTablet for tablet 677ad46968fc45a686b66258e5f1cad7 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:18:04.940852 16471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21561d4c17834bd0b39353286e085a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.944795 16397 tablet_service.cc:1511] Processing CreateTablet for tablet 21561d4c17834bd0b39353286e085a27 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:18:04.956393 16397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21561d4c17834bd0b39353286e085a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.945520 16469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac47935fb81d4c90bb17cd9c7e76efed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.947786 16395 tablet_service.cc:1511] Processing CreateTablet for tablet ac47935fb81d4c90bb17cd9c7e76efed (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:18:04.957793 16466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd7c3546314472295f927165b69929c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.958950 16395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac47935fb81d4c90bb17cd9c7e76efed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.959573 16468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677ad46968fc45a686b66258e5f1cad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.950002 16394 tablet_service.cc:1511] Processing CreateTablet for tablet 677ad46968fc45a686b66258e5f1cad7 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:18:04.960976 16394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677ad46968fc45a686b66258e5f1cad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.952119 16393 tablet_service.cc:1511] Processing CreateTablet for tablet 094e888869a94c62bd30372b45ac5f80 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:18:04.963248 16393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094e888869a94c62bd30372b45ac5f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.954308 16396 tablet_service.cc:1511] Processing CreateTablet for tablet 1885eb35b6a841d2b89c935e9962957e (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:18:04.965237 16396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1885eb35b6a841d2b89c935e9962957e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.978716 16465 tablet_service.cc:1511] Processing CreateTablet for tablet badf93c1f3fe432790a0899524b1d56a (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:18:04.980400 16465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badf93c1f3fe432790a0899524b1d56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.986657 16323 tablet_service.cc:1511] Processing CreateTablet for tablet 205bc28889664f218fa2d592c18de6ac (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:18:04.987985 16323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205bc28889664f218fa2d592c18de6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.989383 16315 tablet_service.cc:1511] Processing CreateTablet for tablet bbc053ea461b4cf38f2b8bbf5fbcbcbe (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:18:04.990697 16315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc053ea461b4cf38f2b8bbf5fbcbcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.992689 16316 tablet_service.cc:1511] Processing CreateTablet for tablet badf93c1f3fe432790a0899524b1d56a (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:18:04.994017 16316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badf93c1f3fe432790a0899524b1d56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.996770 16317 tablet_service.cc:1511] Processing CreateTablet for tablet ddd7c3546314472295f927165b69929c (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:18:04.998100 16317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd7c3546314472295f927165b69929c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:04.998607 16464 tablet_service.cc:1511] Processing CreateTablet for tablet bbc053ea461b4cf38f2b8bbf5fbcbcbe (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:18:04.999887 16464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc053ea461b4cf38f2b8bbf5fbcbcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.000885 16318 tablet_service.cc:1511] Processing CreateTablet for tablet 094e888869a94c62bd30372b45ac5f80 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:18:05.001261 16314 tablet_service.cc:1511] Processing CreateTablet for tablet 391258d2247f4747bedd344c82ab8e84 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:18:05.002154 16318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094e888869a94c62bd30372b45ac5f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.002739 16314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 391258d2247f4747bedd344c82ab8e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.004884 16463 tablet_service.cc:1511] Processing CreateTablet for tablet 391258d2247f4747bedd344c82ab8e84 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:18:05.005347 16320 tablet_service.cc:1511] Processing CreateTablet for tablet ac47935fb81d4c90bb17cd9c7e76efed (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:18:05.006192 16463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 391258d2247f4747bedd344c82ab8e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.007019 16320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac47935fb81d4c90bb17cd9c7e76efed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.009205 16321 tablet_service.cc:1511] Processing CreateTablet for tablet 1885eb35b6a841d2b89c935e9962957e (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:18:05.010275 16522 tablet_bootstrap.cc:492] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83: Bootstrap starting.
I20260709 13:18:05.010527 16321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1885eb35b6a841d2b89c935e9962957e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.012876 16322 tablet_service.cc:1511] Processing CreateTablet for tablet 21561d4c17834bd0b39353286e085a27 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:18:05.014575 16319 tablet_service.cc:1511] Processing CreateTablet for tablet 677ad46968fc45a686b66258e5f1cad7 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:18:05.018260 16522 tablet_bootstrap.cc:654] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.024663 16322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21561d4c17834bd0b39353286e085a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.025416 16319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677ad46968fc45a686b66258e5f1cad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.033555 16392 tablet_service.cc:1511] Processing CreateTablet for tablet ddd7c3546314472295f927165b69929c (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:18:05.034826 16392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd7c3546314472295f927165b69929c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.045420 16391 tablet_service.cc:1511] Processing CreateTablet for tablet badf93c1f3fe432790a0899524b1d56a (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:18:05.046715 16391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet badf93c1f3fe432790a0899524b1d56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.051024 16390 tablet_service.cc:1511] Processing CreateTablet for tablet bbc053ea461b4cf38f2b8bbf5fbcbcbe (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:18:05.051345 16389 tablet_service.cc:1511] Processing CreateTablet for tablet 391258d2247f4747bedd344c82ab8e84 (DEFAULT_TABLE table=test-workload [id=81e8c9a0123849b38dd496d9994ec6bd]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:18:05.052345 16390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc053ea461b4cf38f2b8bbf5fbcbcbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.060017 16389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 391258d2247f4747bedd344c82ab8e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:05.112214 16522 tablet_bootstrap.cc:492] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83: No bootstrap required, opened a new log
I20260709 13:18:05.112715 16522 ts_tablet_manager.cc:1403] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83: Time spent bootstrapping tablet: real 0.103s	user 0.020s	sys 0.031s
I20260709 13:18:05.115557 16522 raft_consensus.cc:359] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:05.116264 16522 raft_consensus.cc:385] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.116564 16522 raft_consensus.cc:740] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.117236 16522 consensus_queue.cc:260] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:05.142685 16524 tablet_bootstrap.cc:492] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d: Bootstrap starting.
I20260709 13:18:05.144670 16525 tablet_bootstrap.cc:492] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50: Bootstrap starting.
I20260709 13:18:05.156291 16358 heartbeater.cc:499] Master 127.15.90.62:38945 was elected leader, sending a full tablet report...
I20260709 13:18:05.157878 16525 tablet_bootstrap.cc:654] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.157904 16524 tablet_bootstrap.cc:654] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.165295 16522 ts_tablet_manager.cc:1434] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.017s
I20260709 13:18:05.166218 16522 tablet_bootstrap.cc:492] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83: Bootstrap starting.
I20260709 13:18:05.172806 16522 tablet_bootstrap.cc:654] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.176105 16524 tablet_bootstrap.cc:492] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d: No bootstrap required, opened a new log
I20260709 13:18:05.176671 16524 ts_tablet_manager.cc:1403] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.001s
I20260709 13:18:05.177209 16525 tablet_bootstrap.cc:492] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50: No bootstrap required, opened a new log
I20260709 13:18:05.177587 16525 ts_tablet_manager.cc:1403] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.005s
I20260709 13:18:05.179558 16524 raft_consensus.cc:359] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.179867 16525 raft_consensus.cc:359] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.180327 16524 raft_consensus.cc:385] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.180652 16525 raft_consensus.cc:385] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.180706 16524 raft_consensus.cc:740] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.181080 16525 raft_consensus.cc:740] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.181905 16522 tablet_bootstrap.cc:492] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83: No bootstrap required, opened a new log
I20260709 13:18:05.181713 16524 consensus_queue.cc:260] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.181972 16525 consensus_queue.cc:260] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.182541 16522 ts_tablet_manager.cc:1403] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.006s
I20260709 13:18:05.186132 16522 raft_consensus.cc:359] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.187122 16522 raft_consensus.cc:385] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.187548 16522 raft_consensus.cc:740] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.188676 16522 consensus_queue.cc:260] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.190682 16524 ts_tablet_manager.cc:1434] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 13:18:05.191376 16507 heartbeater.cc:499] Master 127.15.90.62:38945 was elected leader, sending a full tablet report...
I20260709 13:18:05.192015 16522 ts_tablet_manager.cc:1434] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:18:05.193324 16522 tablet_bootstrap.cc:492] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83: Bootstrap starting.
I20260709 13:18:05.195588 16524 tablet_bootstrap.cc:492] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d: Bootstrap starting.
I20260709 13:18:05.201788 16522 tablet_bootstrap.cc:654] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.202303 16524 tablet_bootstrap.cc:654] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.205246 16433 heartbeater.cc:499] Master 127.15.90.62:38945 was elected leader, sending a full tablet report...
I20260709 13:18:05.205266 16525 ts_tablet_manager.cc:1434] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50: Time spent starting tablet: real 0.027s	user 0.018s	sys 0.010s
I20260709 13:18:05.206612 16525 tablet_bootstrap.cc:492] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50: Bootstrap starting.
I20260709 13:18:05.214942 16525 tablet_bootstrap.cc:654] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.218161 16522 tablet_bootstrap.cc:492] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83: No bootstrap required, opened a new log
I20260709 13:18:05.218690 16522 ts_tablet_manager.cc:1403] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.004s
I20260709 13:18:05.222303 16522 raft_consensus.cc:359] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.225522 16522 raft_consensus.cc:385] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.225871 16522 raft_consensus.cc:740] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.226773 16522 consensus_queue.cc:260] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.230005 16522 ts_tablet_manager.cc:1434] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:18:05.231845 16522 tablet_bootstrap.cc:492] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83: Bootstrap starting.
I20260709 13:18:05.232339 16525 tablet_bootstrap.cc:492] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50: No bootstrap required, opened a new log
I20260709 13:18:05.232815 16525 ts_tablet_manager.cc:1403] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.012s
I20260709 13:18:05.236340 16525 raft_consensus.cc:359] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.237130 16525 raft_consensus.cc:385] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.237418 16525 raft_consensus.cc:740] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.238564 16522 tablet_bootstrap.cc:654] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.238111 16525 consensus_queue.cc:260] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.240538 16525 ts_tablet_manager.cc:1434] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:18:05.241616 16525 tablet_bootstrap.cc:492] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50: Bootstrap starting.
I20260709 13:18:05.249686 16525 tablet_bootstrap.cc:654] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.250555 16522 tablet_bootstrap.cc:492] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83: No bootstrap required, opened a new log
I20260709 13:18:05.251089 16522 ts_tablet_manager.cc:1403] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:18:05.254618 16522 raft_consensus.cc:359] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.255739 16522 raft_consensus.cc:385] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.256186 16522 raft_consensus.cc:740] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.257377 16522 consensus_queue.cc:260] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.260627 16525 tablet_bootstrap.cc:492] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50: No bootstrap required, opened a new log
I20260709 13:18:05.261082 16525 ts_tablet_manager.cc:1403] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 13:18:05.262483 16522 ts_tablet_manager.cc:1434] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:18:05.263543 16522 tablet_bootstrap.cc:492] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83: Bootstrap starting.
I20260709 13:18:05.264010 16525 raft_consensus.cc:359] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:05.264695 16525 raft_consensus.cc:385] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.265007 16525 raft_consensus.cc:740] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.265857 16525 consensus_queue.cc:260] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:05.268091 16525 ts_tablet_manager.cc:1434] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:05.269004 16525 tablet_bootstrap.cc:492] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50: Bootstrap starting.
I20260709 13:18:05.270915 16522 tablet_bootstrap.cc:654] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.275902 16525 tablet_bootstrap.cc:654] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.279170 16524 tablet_bootstrap.cc:492] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d: No bootstrap required, opened a new log
I20260709 13:18:05.279551 16524 ts_tablet_manager.cc:1403] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d: Time spent bootstrapping tablet: real 0.084s	user 0.046s	sys 0.026s
I20260709 13:18:05.282644 16524 raft_consensus.cc:359] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.283387 16524 raft_consensus.cc:385] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.283735 16524 raft_consensus.cc:740] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.285285 16522 tablet_bootstrap.cc:492] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83: No bootstrap required, opened a new log
I20260709 13:18:05.284790 16524 consensus_queue.cc:260] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.285940 16522 ts_tablet_manager.cc:1403] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.006s
I20260709 13:18:05.288874 16525 tablet_bootstrap.cc:492] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50: No bootstrap required, opened a new log
I20260709 13:18:05.288919 16524 ts_tablet_manager.cc:1434] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:05.289547 16525 ts_tablet_manager.cc:1403] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:18:05.288898 16522 raft_consensus.cc:359] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.290071 16524 tablet_bootstrap.cc:492] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d: Bootstrap starting.
I20260709 13:18:05.290123 16522 raft_consensus.cc:385] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.290704 16522 raft_consensus.cc:740] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.291649 16522 consensus_queue.cc:260] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.292418 16525 raft_consensus.cc:359] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.293121 16525 raft_consensus.cc:385] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.293417 16525 raft_consensus.cc:740] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.294178 16525 consensus_queue.cc:260] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.296274 16522 ts_tablet_manager.cc:1434] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:18:05.296370 16525 ts_tablet_manager.cc:1434] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:18:05.297465 16525 tablet_bootstrap.cc:492] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50: Bootstrap starting.
I20260709 13:18:05.297461 16522 tablet_bootstrap.cc:492] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83: Bootstrap starting.
I20260709 13:18:05.299192 16524 tablet_bootstrap.cc:654] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.305438 16525 tablet_bootstrap.cc:654] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.306210 16522 tablet_bootstrap.cc:654] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.318290 16522 tablet_bootstrap.cc:492] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83: No bootstrap required, opened a new log
I20260709 13:18:05.318711 16522 ts_tablet_manager.cc:1403] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 13:18:05.319275 16525 tablet_bootstrap.cc:492] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50: No bootstrap required, opened a new log
I20260709 13:18:05.319766 16525 ts_tablet_manager.cc:1403] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:18:05.321466 16531 raft_consensus.cc:493] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.321728 16524 tablet_bootstrap.cc:492] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d: No bootstrap required, opened a new log
I20260709 13:18:05.321573 16522 raft_consensus.cc:359] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.322005 16531 raft_consensus.cc:515] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.322359 16524 ts_tablet_manager.cc:1403] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.014s
I20260709 13:18:05.322373 16522 raft_consensus.cc:385] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.322898 16522 raft_consensus.cc:740] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.322583 16525 raft_consensus.cc:359] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.323421 16525 raft_consensus.cc:385] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.323753 16525 raft_consensus.cc:740] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.323695 16522 consensus_queue.cc:260] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.324651 16525 consensus_queue.cc:260] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.326089 16522 ts_tablet_manager.cc:1434] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:05.327034 16522 tablet_bootstrap.cc:492] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83: Bootstrap starting.
I20260709 13:18:05.328364 16524 raft_consensus.cc:359] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:05.329136 16524 raft_consensus.cc:385] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.329504 16524 raft_consensus.cc:740] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.330288 16524 consensus_queue.cc:260] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:05.332535 16524 ts_tablet_manager.cc:1434] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:18:05.333580 16524 tablet_bootstrap.cc:492] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d: Bootstrap starting.
I20260709 13:18:05.333817 16522 tablet_bootstrap.cc:654] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.341238 16524 tablet_bootstrap.cc:654] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.346726 16531 leader_election.cc:290] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.349637 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094e888869a94c62bd30372b45ac5f80" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d" is_pre_election: true
W20260709 13:18:05.351135 16371 leader_election.cc:343] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.368728 16522 tablet_bootstrap.cc:492] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83: No bootstrap required, opened a new log
I20260709 13:18:05.369362 16522 ts_tablet_manager.cc:1403] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.020s
I20260709 13:18:05.371498 16524 tablet_bootstrap.cc:492] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d: No bootstrap required, opened a new log
I20260709 13:18:05.372061 16524 ts_tablet_manager.cc:1403] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.021s
I20260709 13:18:05.371897 16522 raft_consensus.cc:359] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.372670 16522 raft_consensus.cc:385] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.372989 16522 raft_consensus.cc:740] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.373685 16522 consensus_queue.cc:260] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.374285 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094e888869a94c62bd30372b45ac5f80" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
I20260709 13:18:05.375123 16333 raft_consensus.cc:2468] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 0.
I20260709 13:18:05.375941 16522 ts_tablet_manager.cc:1434] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:18:05.376859 16522 tablet_bootstrap.cc:492] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83: Bootstrap starting.
I20260709 13:18:05.378015 16531 raft_consensus.cc:493] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.378264 16524 raft_consensus.cc:359] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.378607 16531 raft_consensus.cc:515] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.379280 16524 raft_consensus.cc:385] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.379755 16524 raft_consensus.cc:740] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.380744 16524 consensus_queue.cc:260] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.382965 16524 ts_tablet_manager.cc:1434] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:18:05.383033 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1885eb35b6a841d2b89c935e9962957e" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d" is_pre_election: true
I20260709 13:18:05.383555 16522 tablet_bootstrap.cc:654] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.383899 16482 raft_consensus.cc:2468] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 0.
I20260709 13:18:05.384164 16524 tablet_bootstrap.cc:492] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d: Bootstrap starting.
I20260709 13:18:05.385499 16371 leader_election.cc:304] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:05.391767 16524 tablet_bootstrap.cc:654] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.394829 16531 leader_election.cc:290] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.395339 16531 raft_consensus.cc:2804] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.398577 16522 tablet_bootstrap.cc:492] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83: No bootstrap required, opened a new log
I20260709 13:18:05.399140 16522 ts_tablet_manager.cc:1403] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.004s
I20260709 13:18:05.395665 16531 raft_consensus.cc:493] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.400940 16531 raft_consensus.cc:3060] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.404729 16522 raft_consensus.cc:359] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.405608 16522 raft_consensus.cc:385] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.405942 16522 raft_consensus.cc:740] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.406965 16522 consensus_queue.cc:260] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.409430 16522 ts_tablet_manager.cc:1434] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:18:05.410647 16522 tablet_bootstrap.cc:492] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83: Bootstrap starting.
I20260709 13:18:05.376994 16374 leader_election.cc:304] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83; no voters: a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:05.414593 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1885eb35b6a841d2b89c935e9962957e" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
I20260709 13:18:05.414809 16549 raft_consensus.cc:2804] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.415531 16549 raft_consensus.cc:493] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.416337 16549 raft_consensus.cc:3060] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.420780 16522 tablet_bootstrap.cc:654] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:05.432175 16374 leader_election.cc:343] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.431914 16549 raft_consensus.cc:515] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.434325 16531 raft_consensus.cc:515] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.437420 16525 ts_tablet_manager.cc:1434] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50: Time spent starting tablet: real 0.117s	user 0.027s	sys 0.060s
I20260709 13:18:05.437534 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094e888869a94c62bd30372b45ac5f80" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:05.438098 16333 raft_consensus.cc:3060] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.440994 16525 tablet_bootstrap.cc:492] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50: Bootstrap starting.
I20260709 13:18:05.441460 16531 leader_election.cc:290] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.442684 16522 tablet_bootstrap.cc:492] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83: No bootstrap required, opened a new log
I20260709 13:18:05.443221 16522 ts_tablet_manager.cc:1403] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.012s
I20260709 13:18:05.443771 16549 leader_election.cc:290] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.444803 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094e888869a94c62bd30372b45ac5f80" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:05.446033 16481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1885eb35b6a841d2b89c935e9962957e" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:05.446211 16526 raft_consensus.cc:493] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.446627 16481 raft_consensus.cc:3060] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.446790 16526 raft_consensus.cc:515] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.447398 16525 tablet_bootstrap.cc:654] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.453246 16526 leader_election.cc:290] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
W20260709 13:18:05.454264 16371 leader_election.cc:343] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.458909 16522 raft_consensus.cc:359] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.459820 16522 raft_consensus.cc:385] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.460165 16522 raft_consensus.cc:740] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.460999 16522 consensus_queue.cc:260] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.467542 16333 raft_consensus.cc:2468] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 1.
I20260709 13:18:05.471606 16481 raft_consensus.cc:2468] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 1.
W20260709 13:18:05.472615 16279 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:05.473877 16522 ts_tablet_manager.cc:1434] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:18:05.475054 16522 tablet_bootstrap.cc:492] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83: Bootstrap starting.
I20260709 13:18:05.480584 16530 raft_consensus.cc:493] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.481194 16530 raft_consensus.cc:515] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:05.492211 16530 leader_election.cc:290] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:05.495380 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d" is_pre_election: true
W20260709 13:18:05.497295 16296 leader_election.cc:343] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.498071 16526 raft_consensus.cc:493] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.498638 16526 raft_consensus.cc:515] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.504418 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "391258d2247f4747bedd344c82ab8e84" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d" is_pre_election: true
I20260709 13:18:05.505221 16482 raft_consensus.cc:2468] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 0.
I20260709 13:18:05.506703 16296 leader_election.cc:304] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:05.501154 16526 leader_election.cc:290] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.508628 16526 raft_consensus.cc:2804] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.509052 16526 raft_consensus.cc:493] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.509466 16526 raft_consensus.cc:3060] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.436311 16542 raft_consensus.cc:493] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.519665 16542 raft_consensus.cc:515] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.524770 16522 tablet_bootstrap.cc:654] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.528194 16524 tablet_bootstrap.cc:492] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d: No bootstrap required, opened a new log
I20260709 13:18:05.528774 16524 ts_tablet_manager.cc:1403] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d: Time spent bootstrapping tablet: real 0.145s	user 0.050s	sys 0.069s
I20260709 13:18:05.531975 16524 raft_consensus.cc:359] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.533438 16524 raft_consensus.cc:385] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.533893 16524 raft_consensus.cc:740] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.534812 16524 consensus_queue.cc:260] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.537231 16524 ts_tablet_manager.cc:1434] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:05.538184 16524 tablet_bootstrap.cc:492] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d: Bootstrap starting.
I20260709 13:18:05.544588 16524 tablet_bootstrap.cc:654] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.545480 16526 raft_consensus.cc:515] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.556051 16371 leader_election.cc:304] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:05.557255 16549 raft_consensus.cc:2804] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.557890 16549 raft_consensus.cc:697] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Becoming Leader. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:05.558979 16549 consensus_queue.cc:237] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.563901 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
I20260709 13:18:05.564721 16333 raft_consensus.cc:2468] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 0.
I20260709 13:18:05.566658 16557 raft_consensus.cc:493] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.553212 16522 tablet_bootstrap.cc:492] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83: No bootstrap required, opened a new log
I20260709 13:18:05.567296 16557 raft_consensus.cc:515] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
W20260709 13:18:05.567903 16296 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:32869, user_credentials={real_user=slave}} blocked reactor thread for 61250.2us
I20260709 13:18:05.547645 16526 leader_election.cc:290] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 election: Requested vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.569972 16481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "391258d2247f4747bedd344c82ab8e84" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:05.567546 16522 ts_tablet_manager.cc:1403] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.000s
I20260709 13:18:05.570770 16481 raft_consensus.cc:3060] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.566640 16448 leader_election.cc:304] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:05.573637 16530 raft_consensus.cc:2804] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.574146 16530 raft_consensus.cc:493] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.574707 16530 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.573832 16522 raft_consensus.cc:359] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.577057 16524 tablet_bootstrap.cc:492] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d: No bootstrap required, opened a new log
I20260709 13:18:05.576938 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677ad46968fc45a686b66258e5f1cad7" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d" is_pre_election: true
I20260709 13:18:05.577615 16524 ts_tablet_manager.cc:1403] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.018s
I20260709 13:18:05.577337 16374 leader_election.cc:304] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83; no voters: a10ba23efa524f30995781ccc0499c2d
W20260709 13:18:05.578168 16371 leader_election.cc:343] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.578344 16542 leader_election.cc:290] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.575462 16522 raft_consensus.cc:385] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.579869 16522 raft_consensus.cc:740] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.580873 16524 raft_consensus.cc:359] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.581637 16524 raft_consensus.cc:385] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.582000 16524 raft_consensus.cc:740] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.582839 16524 consensus_queue.cc:260] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.591550 16524 ts_tablet_manager.cc:1434] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:18:05.592424 16524 tablet_bootstrap.cc:492] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d: Bootstrap starting.
I20260709 13:18:05.595868 16526 raft_consensus.cc:493] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.596365 16526 raft_consensus.cc:515] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.596977 16524 tablet_bootstrap.cc:654] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.604846 16531 raft_consensus.cc:2804] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.605283 16524 tablet_bootstrap.cc:492] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d: No bootstrap required, opened a new log
I20260709 13:18:05.605937 16524 ts_tablet_manager.cc:1403] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 13:18:05.606045 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1885eb35b6a841d2b89c935e9962957e" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:05.606182 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50" is_pre_election: true
I20260709 13:18:05.606698 16333 raft_consensus.cc:3060] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.606797 16408 raft_consensus.cc:2468] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 0.
I20260709 13:18:05.609633 16524 raft_consensus.cc:359] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.610569 16524 raft_consensus.cc:385] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.610931 16524 raft_consensus.cc:740] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.611940 16524 consensus_queue.cc:260] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.615134 16333 raft_consensus.cc:2468] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 1.
I20260709 13:18:05.615221 16524 ts_tablet_manager.cc:1434] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.007s
I20260709 13:18:05.616540 16524 tablet_bootstrap.cc:492] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d: Bootstrap starting.
I20260709 13:18:05.618095 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677ad46968fc45a686b66258e5f1cad7" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
I20260709 13:18:05.618675 16333 raft_consensus.cc:2468] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 0.
I20260709 13:18:05.624951 16524 tablet_bootstrap.cc:654] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.625970 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677ad46968fc45a686b66258e5f1cad7" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d" is_pre_election: true
W20260709 13:18:05.627290 16296 leader_election.cc:343] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.628095 16557 leader_election.cc:290] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.627578 16231 catalog_manager.cc:5697] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "17291dc3920540e780a6a73de6cbbe50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.595309 16530 raft_consensus.cc:515] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:05.633319 16561 raft_consensus.cc:493] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.633949 16561 raft_consensus.cc:515] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.635864 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50" is_pre_election: true
I20260709 13:18:05.636731 16561 leader_election.cc:290] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:05.636865 16522 consensus_queue.cc:260] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.637737 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc053ea461b4cf38f2b8bbf5fbcbcbe" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
I20260709 13:18:05.638329 16333 raft_consensus.cc:2468] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 0.
I20260709 13:18:05.639259 16525 tablet_bootstrap.cc:492] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50: No bootstrap required, opened a new log
I20260709 13:18:05.639719 16525 ts_tablet_manager.cc:1403] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50: Time spent bootstrapping tablet: real 0.199s	user 0.085s	sys 0.089s
I20260709 13:18:05.639632 16448 leader_election.cc:304] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:05.639518 16522 ts_tablet_manager.cc:1434] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.003s
I20260709 13:18:05.641140 16561 raft_consensus.cc:493] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.642099 16549 raft_consensus.cc:493] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.642501 16530 leader_election.cc:290] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:05.642575 16549 raft_consensus.cc:515] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.643735 16530 raft_consensus.cc:2804] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.644315 16530 raft_consensus.cc:493] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.644654 16530 raft_consensus.cc:3060] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.644582 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "391258d2247f4747bedd344c82ab8e84" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50" is_pre_election: true
I20260709 13:18:05.642402 16561 raft_consensus.cc:515] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.647037 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7c3546314472295f927165b69929c" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d" is_pre_election: true
I20260709 13:18:05.647621 16482 raft_consensus.cc:2468] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 0.
I20260709 13:18:05.647986 16561 leader_election.cc:290] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:05.644955 16549 leader_election.cc:290] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.649277 16371 leader_election.cc:304] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:05.650102 16549 raft_consensus.cc:2804] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.650460 16549 raft_consensus.cc:493] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.650786 16549 raft_consensus.cc:3060] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.650900 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677ad46968fc45a686b66258e5f1cad7" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50" is_pre_election: true
I20260709 13:18:05.648653 16481 raft_consensus.cc:2468] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 1.
I20260709 13:18:05.651947 16407 raft_consensus.cc:2468] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 0.
I20260709 13:18:05.652786 16296 leader_election.cc:304] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:05.653719 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc053ea461b4cf38f2b8bbf5fbcbcbe" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50" is_pre_election: true
I20260709 13:18:05.654811 16557 raft_consensus.cc:2804] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.650125 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "391258d2247f4747bedd344c82ab8e84" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:05.654955 16374 leader_election.cc:304] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83; no voters: a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:05.659734 16525 raft_consensus.cc:359] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.660439 16525 raft_consensus.cc:385] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.660730 16525 raft_consensus.cc:740] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.655967 16531 raft_consensus.cc:697] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Becoming Leader. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:05.663650 16526 leader_election.cc:290] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.673488 16542 raft_consensus.cc:2804] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.665423 16531 consensus_queue.cc:237] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.674804 16542 raft_consensus.cc:493] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.675163 16542 raft_consensus.cc:3060] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.665047 16481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc053ea461b4cf38f2b8bbf5fbcbcbe" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d" is_pre_election: true
I20260709 13:18:05.676446 16530 raft_consensus.cc:515] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
W20260709 13:18:05.680662 16297 leader_election.cc:343] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.681286 16297 leader_election.cc:304] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 930e86a11db843908dabef220ce44c83; no voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:05.682708 16526 raft_consensus.cc:2749] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.664502 16549 raft_consensus.cc:515] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.685770 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7c3546314472295f927165b69929c" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
I20260709 13:18:05.686513 16333 raft_consensus.cc:2468] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 0.
I20260709 13:18:05.687134 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7c3546314472295f927165b69929c" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:05.687861 16482 raft_consensus.cc:3060] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:05.688040 16297 leader_election.cc:343] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.689491 16297 leader_election.cc:304] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83; no voters: a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:05.691830 16526 raft_consensus.cc:2804] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.691989 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc053ea461b4cf38f2b8bbf5fbcbcbe" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50" is_pre_election: true
I20260709 13:18:05.692777 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:05.693462 16407 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.692209 16526 raft_consensus.cc:493] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:05.700521 16446 leader_election.cc:343] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.701601 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50" is_pre_election: true
I20260709 13:18:05.695647 16526 raft_consensus.cc:3060] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.694626 16525 consensus_queue.cc:260] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.695142 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7c3546314472295f927165b69929c" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:05.705701 16525 ts_tablet_manager.cc:1434] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50: Time spent starting tablet: real 0.066s	user 0.002s	sys 0.004s
I20260709 13:18:05.706195 16333 raft_consensus.cc:3060] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.706749 16525 tablet_bootstrap.cc:492] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50: Bootstrap starting.
I20260709 13:18:05.706923 16563 raft_consensus.cc:493] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.708755 16530 leader_election.cc:290] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:05.697211 16557 raft_consensus.cc:697] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 1 LEADER]: Becoming Leader. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
W20260709 13:18:05.694991 16448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:33797, user_credentials={real_user=slave}} blocked reactor thread for 55433.7us
I20260709 13:18:05.707412 16563 raft_consensus.cc:515] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.710264 16557 consensus_queue.cc:237] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.711112 16481 raft_consensus.cc:2393] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 930e86a11db843908dabef220ce44c83 in current term 1: Already voted for candidate a10ba23efa524f30995781ccc0499c2d in this term.
W20260709 13:18:05.698658 16297 leader_election.cc:343] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.711702 16563 leader_election.cc:290] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
W20260709 13:18:05.712256 16297 leader_election.cc:343] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.695601 16549 leader_election.cc:290] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.712275 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
I20260709 13:18:05.713537 16331 raft_consensus.cc:2468] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 0.
I20260709 13:18:05.714708 16530 raft_consensus.cc:493] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.714766 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc053ea461b4cf38f2b8bbf5fbcbcbe" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:05.715984 16330 raft_consensus.cc:3060] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.716027 16448 leader_election.cc:304] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:05.718713 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:05.719296 16332 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.719370 16524 tablet_bootstrap.cc:492] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d: No bootstrap required, opened a new log
I20260709 13:18:05.719869 16524 ts_tablet_manager.cc:1403] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d: Time spent bootstrapping tablet: real 0.104s	user 0.024s	sys 0.032s
I20260709 13:18:05.720134 16561 raft_consensus.cc:2804] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.722018 16561 raft_consensus.cc:493] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.722345 16561 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.727360 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc053ea461b4cf38f2b8bbf5fbcbcbe" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
W20260709 13:18:05.727788 16446 leader_election.cc:343] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.722664 16331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
W20260709 13:18:05.729071 16446 leader_election.cc:343] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.715266 16530 raft_consensus.cc:515] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.732122 16566 raft_consensus.cc:493] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.729871 16480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d" is_pre_election: true
I20260709 13:18:05.735518 16296 leader_election.cc:304] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 930e86a11db843908dabef220ce44c83; no voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:05.732546 16331 raft_consensus.cc:2468] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 0.
W20260709 13:18:05.740497 16371 leader_election.cc:343] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.729399 16333 raft_consensus.cc:2468] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 1.
I20260709 13:18:05.744117 16374 leader_election.cc:304] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83; no voters: a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:05.739060 16407 raft_consensus.cc:2468] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 1.
I20260709 13:18:05.744488 16482 raft_consensus.cc:2468] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 1.
I20260709 13:18:05.739826 16566 raft_consensus.cc:515] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.750589 16549 raft_consensus.cc:2804] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.750774 16530 leader_election.cc:290] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:05.750994 16549 raft_consensus.cc:493] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.751346 16549 raft_consensus.cc:3060] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.761133 16371 leader_election.cc:304] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:05.761597 16526 raft_consensus.cc:515] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.761960 16563 raft_consensus.cc:2804] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.762537 16563 raft_consensus.cc:697] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Becoming Leader. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:05.762141 16230 catalog_manager.cc:5697] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 930e86a11db843908dabef220ce44c83 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "930e86a11db843908dabef220ce44c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.763852 16333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094e888869a94c62bd30372b45ac5f80" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
I20260709 13:18:05.763334 16563 consensus_queue.cc:237] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.764695 16333 raft_consensus.cc:2393] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a10ba23efa524f30995781ccc0499c2d in current term 1: Already voted for candidate 17291dc3920540e780a6a73de6cbbe50 in this term.
I20260709 13:18:05.767830 16446 leader_election.cc:304] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:05.768584 16530 raft_consensus.cc:2804] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.769070 16530 raft_consensus.cc:697] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Becoming Leader. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:05.768983 16549 raft_consensus.cc:515] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.769863 16530 consensus_queue.cc:237] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:05.771791 16549 leader_election.cc:290] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.772948 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:05.773294 16566 leader_election.cc:290] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.773873 16526 leader_election.cc:290] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 election: Requested vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
W20260709 13:18:05.774680 16371 leader_election.cc:343] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.765488 16330 raft_consensus.cc:2468] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 1.
I20260709 13:18:05.764230 16332 raft_consensus.cc:2468] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 1.
I20260709 13:18:05.781742 16542 raft_consensus.cc:515] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.779492 16557 raft_consensus.cc:2749] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.786677 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094e888869a94c62bd30372b45ac5f80" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50" is_pre_election: true
I20260709 13:18:05.788367 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d" is_pre_election: true
I20260709 13:18:05.789465 16524 raft_consensus.cc:359] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.790853 16524 raft_consensus.cc:385] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.791265 16524 raft_consensus.cc:740] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.793130 16480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677ad46968fc45a686b66258e5f1cad7" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:05.794947 16542 leader_election.cc:290] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:05.794873 16446 leader_election.cc:304] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a10ba23efa524f30995781ccc0499c2d; no voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83
I20260709 13:18:05.783396 16561 raft_consensus.cc:515] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.796685 16567 raft_consensus.cc:3060] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.788741 16448 leader_election.cc:304] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 17291dc3920540e780a6a73de6cbbe50
I20260709 13:18:05.799389 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:05.800691 16330 raft_consensus.cc:3060] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.802407 16525 tablet_bootstrap.cc:654] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.804013 16482 raft_consensus.cc:2393] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 930e86a11db843908dabef220ce44c83 in current term 1: Already voted for candidate a10ba23efa524f30995781ccc0499c2d in this term.
I20260709 13:18:05.804847 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50" is_pre_election: true
I20260709 13:18:05.806294 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677ad46968fc45a686b66258e5f1cad7" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:05.807170 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677ad46968fc45a686b66258e5f1cad7" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:05.807407 16330 raft_consensus.cc:2468] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 1.
I20260709 13:18:05.807930 16407 raft_consensus.cc:2393] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 930e86a11db843908dabef220ce44c83 in current term 1: Already voted for candidate 17291dc3920540e780a6a73de6cbbe50 in this term.
I20260709 13:18:05.808539 16524 consensus_queue.cc:260] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.809924 16480 raft_consensus.cc:3060] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.823737 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677ad46968fc45a686b66258e5f1cad7" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:05.824474 16330 raft_consensus.cc:2393] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17291dc3920540e780a6a73de6cbbe50 in current term 1: Already voted for candidate 930e86a11db843908dabef220ce44c83 in this term.
I20260709 13:18:05.813629 16530 raft_consensus.cc:2804] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:05.828225 16297 leader_election.cc:343] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.828693 16374 leader_election.cc:304] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83; no voters: a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:05.828789 16297 leader_election.cc:304] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 930e86a11db843908dabef220ce44c83; no voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:05.829564 16563 raft_consensus.cc:2804] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.830025 16563 raft_consensus.cc:697] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Becoming Leader. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:05.830842 16557 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.832916 16524 ts_tablet_manager.cc:1434] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d: Time spent starting tablet: real 0.113s	user 0.020s	sys 0.003s
I20260709 13:18:05.834659 16561 leader_election.cc:290] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:05.830535 16530 raft_consensus.cc:697] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Becoming Leader. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:05.836854 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:05.837550 16530 consensus_queue.cc:237] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.838354 16524 tablet_bootstrap.cc:492] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d: Bootstrap starting.
I20260709 13:18:05.831564 16563 consensus_queue.cc:237] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.844651 16524 tablet_bootstrap.cc:654] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.846105 16557 raft_consensus.cc:2749] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.843488 16480 raft_consensus.cc:2468] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 1.
I20260709 13:18:05.853224 16374 leader_election.cc:304] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50; no voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:05.855126 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:05.855546 16524 tablet_bootstrap.cc:492] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d: No bootstrap required, opened a new log
I20260709 13:18:05.853942 16542 raft_consensus.cc:2749] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.856032 16524 ts_tablet_manager.cc:1403] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.009s
I20260709 13:18:05.857784 16231 catalog_manager.cc:5697] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d reported cstate change: term changed from 0 to 1, leader changed from <none> to a10ba23efa524f30995781ccc0499c2d (127.15.90.3). New cstate: current_term: 1 leader_uuid: "a10ba23efa524f30995781ccc0499c2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.858747 16524 raft_consensus.cc:359] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.859413 16524 raft_consensus.cc:385] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.859659 16524 raft_consensus.cc:740] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.860724 16296 leader_election.cc:304] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 17291dc3920540e780a6a73de6cbbe50
I20260709 13:18:05.862183 16557 raft_consensus.cc:2804] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.852272 16230 catalog_manager.cc:5697] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "17291dc3920540e780a6a73de6cbbe50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.863065 16557 raft_consensus.cc:697] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 1 LEADER]: Becoming Leader. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:05.864164 16557 consensus_queue.cc:237] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.864230 16230 catalog_manager.cc:5697] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "17291dc3920540e780a6a73de6cbbe50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.865654 16567 raft_consensus.cc:2749] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:05.860358 16524 consensus_queue.cc:260] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
W20260709 13:18:05.867305 16446 leader_election.cc:343] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:05.867333 16525 tablet_bootstrap.cc:492] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50: No bootstrap required, opened a new log
I20260709 13:18:05.869670 16525 ts_tablet_manager.cc:1403] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50: Time spent bootstrapping tablet: real 0.163s	user 0.014s	sys 0.006s
I20260709 13:18:05.870306 16330 raft_consensus.cc:2468] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 1.
I20260709 13:18:05.872355 16524 ts_tablet_manager.cc:1434] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:18:05.873260 16524 tablet_bootstrap.cc:492] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d: Bootstrap starting.
I20260709 13:18:05.873214 16448 leader_election.cc:304] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 17291dc3920540e780a6a73de6cbbe50
I20260709 13:18:05.874329 16530 raft_consensus.cc:2804] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:05.874140 16525 raft_consensus.cc:359] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.874979 16530 raft_consensus.cc:697] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Becoming Leader. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:05.876327 16525 raft_consensus.cc:385] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.876698 16525 raft_consensus.cc:740] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.876821 16530 consensus_queue.cc:237] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.877789 16525 consensus_queue.cc:260] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.879293 16524 tablet_bootstrap.cc:654] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.880761 16525 ts_tablet_manager.cc:1434] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:18:05.881754 16525 tablet_bootstrap.cc:492] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50: Bootstrap starting.
I20260709 13:18:05.890151 16525 tablet_bootstrap.cc:654] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.902966 16230 catalog_manager.cc:5697] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "17291dc3920540e780a6a73de6cbbe50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.912881 16231 catalog_manager.cc:5697] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 930e86a11db843908dabef220ce44c83 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "930e86a11db843908dabef220ce44c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.914336 16525 tablet_bootstrap.cc:492] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50: No bootstrap required, opened a new log
I20260709 13:18:05.914780 16525 ts_tablet_manager.cc:1403] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.002s
I20260709 13:18:05.917339 16525 raft_consensus.cc:359] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.917996 16525 raft_consensus.cc:385] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.918311 16525 raft_consensus.cc:740] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.919070 16525 consensus_queue.cc:260] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.922288 16524 tablet_bootstrap.cc:492] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d: No bootstrap required, opened a new log
I20260709 13:18:05.922706 16524 ts_tablet_manager.cc:1403] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.034s
I20260709 13:18:05.922812 16525 ts_tablet_manager.cc:1434] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:18:05.923847 16525 tablet_bootstrap.cc:492] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50: Bootstrap starting.
I20260709 13:18:05.925212 16524 raft_consensus.cc:359] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.925810 16524 raft_consensus.cc:385] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.926082 16524 raft_consensus.cc:740] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.926859 16524 consensus_queue.cc:260] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.929466 16525 tablet_bootstrap.cc:654] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.930335 16524 ts_tablet_manager.cc:1434] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:18:05.929854 16228 catalog_manager.cc:5697] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d reported cstate change: term changed from 0 to 1, leader changed from <none> to a10ba23efa524f30995781ccc0499c2d (127.15.90.3). New cstate: current_term: 1 leader_uuid: "a10ba23efa524f30995781ccc0499c2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.931810 16228 catalog_manager.cc:5697] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d reported cstate change: term changed from 0 to 1, leader changed from <none> to a10ba23efa524f30995781ccc0499c2d (127.15.90.3). New cstate: current_term: 1 leader_uuid: "a10ba23efa524f30995781ccc0499c2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.937323 16525 tablet_bootstrap.cc:492] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50: No bootstrap required, opened a new log
I20260709 13:18:05.937755 16525 ts_tablet_manager.cc:1403] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:18:05.939950 16525 raft_consensus.cc:359] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.940502 16525 raft_consensus.cc:385] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:05.940709 16525 raft_consensus.cc:740] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Initialized, Role: FOLLOWER
I20260709 13:18:05.941257 16525 consensus_queue.cc:260] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.942798 16542 consensus_queue.cc:1048] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:05.943187 16525 ts_tablet_manager.cc:1434] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:05.944182 16525 tablet_bootstrap.cc:492] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50: Bootstrap starting.
I20260709 13:18:05.949784 16525 tablet_bootstrap.cc:654] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:05.951961 16530 raft_consensus.cc:493] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.952451 16530 raft_consensus.cc:515] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.954876 16530 leader_election.cc:290] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:05.957374 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
I20260709 13:18:05.958181 16330 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 0.
I20260709 13:18:05.958731 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50" is_pre_election: true
I20260709 13:18:05.959525 16407 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 0.
I20260709 13:18:05.961107 16446 leader_election.cc:304] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:05.962376 16542 consensus_queue.cc:1048] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:05.963310 16530 raft_consensus.cc:2804] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:05.964004 16530 raft_consensus.cc:493] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.964452 16530 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.978307 16530 raft_consensus.cc:515] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:05.981925 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:05.982625 16330 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:05.993675 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:05.994274 16407 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.004423 16407 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 1.
I20260709 13:18:06.006088 16446 leader_election.cc:304] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:06.007419 16567 raft_consensus.cc:2804] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:06.008060 16567 raft_consensus.cc:697] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Becoming Leader. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:06.009150 16567 consensus_queue.cc:237] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.011849 16530 leader_election.cc:290] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:06.013357 16330 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 1.
I20260709 13:18:06.015300 16525 tablet_bootstrap.cc:492] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50: No bootstrap required, opened a new log
I20260709 13:18:06.015727 16525 ts_tablet_manager.cc:1403] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50: Time spent bootstrapping tablet: real 0.072s	user 0.031s	sys 0.034s
I20260709 13:18:06.016232 16530 raft_consensus.cc:493] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.016713 16530 raft_consensus.cc:515] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.018126 16525 raft_consensus.cc:359] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.018759 16525 raft_consensus.cc:385] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:06.019402 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
I20260709 13:18:06.020170 16330 raft_consensus.cc:2393] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a10ba23efa524f30995781ccc0499c2d in current term 1: Already voted for candidate 17291dc3920540e780a6a73de6cbbe50 in this term.
I20260709 13:18:06.020591 16530 leader_election.cc:290] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:06.019012 16525 raft_consensus.cc:740] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Initialized, Role: FOLLOWER
I20260709 13:18:06.021932 16525 consensus_queue.cc:260] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.023294 16525 ts_tablet_manager.cc:1434] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:18:06.023990 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17291dc3920540e780a6a73de6cbbe50" is_pre_election: true
I20260709 13:18:06.028012 16446 leader_election.cc:304] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a10ba23efa524f30995781ccc0499c2d; no voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83
I20260709 13:18:06.028785 16567 raft_consensus.cc:3060] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.034354 16567 raft_consensus.cc:2749] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:06.034653 16230 catalog_manager.cc:5697] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d reported cstate change: term changed from 0 to 1, leader changed from <none> to a10ba23efa524f30995781ccc0499c2d (127.15.90.3). New cstate: current_term: 1 leader_uuid: "a10ba23efa524f30995781ccc0499c2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.050251 16542 raft_consensus.cc:493] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.050791 16542 raft_consensus.cc:515] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.052510 16542 leader_election.cc:290] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:06.053246 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "391258d2247f4747bedd344c82ab8e84" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "930e86a11db843908dabef220ce44c83" is_pre_election: true
I20260709 13:18:06.053406 16480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "391258d2247f4747bedd344c82ab8e84" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10ba23efa524f30995781ccc0499c2d" is_pre_election: true
I20260709 13:18:06.054077 16480 raft_consensus.cc:2393] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17291dc3920540e780a6a73de6cbbe50 in current term 1: Already voted for candidate 930e86a11db843908dabef220ce44c83 in this term.
I20260709 13:18:06.054919 16371 leader_election.cc:304] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50; no voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:06.055536 16542 raft_consensus.cc:3060] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.060005 16542 raft_consensus.cc:2749] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:06.091626 16542 consensus_queue.cc:1048] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.100273 16557 consensus_queue.cc:1048] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.101643 16563 consensus_queue.cc:1048] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.117233 16572 consensus_queue.cc:1048] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:06.172778 16567 consensus_queue.cc:1048] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.182421 16567 consensus_queue.cc:1048] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.249020 16567 consensus_queue.cc:1048] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.257995 16407 raft_consensus.cc:3060] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.264405 16567 consensus_queue.cc:1048] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.266530 16567 consensus_queue.cc:1048] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.275440 16406 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:06.283334 16576 consensus_queue.cc:1048] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.287525 16549 consensus_queue.cc:1048] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.289220 16572 consensus_queue.cc:1048] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.302060 16557 consensus_queue.cc:1048] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.320670 16563 consensus_queue.cc:1048] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.331620 16563 consensus_queue.cc:1048] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.340054 16480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac"
dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
mode: GRACEFUL
new_leader_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:60312
I20260709 13:18:06.340816 16480 raft_consensus.cc:606] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Received request to transfer leadership to TS 930e86a11db843908dabef220ce44c83
I20260709 13:18:06.347223 16482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21561d4c17834bd0b39353286e085a27"
dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
mode: GRACEFUL
new_leader_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:60312
I20260709 13:18:06.347767 16482 raft_consensus.cc:606] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Received request to transfer leadership to TS 930e86a11db843908dabef220ce44c83
I20260709 13:18:06.348441 16563 consensus_queue.cc:1048] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.365957 16408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1885eb35b6a841d2b89c935e9962957e"
dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
mode: GRACEFUL
new_leader_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:57992
I20260709 13:18:06.366560 16408 raft_consensus.cc:606] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Received request to transfer leadership to TS 930e86a11db843908dabef220ce44c83
I20260709 13:18:06.372166 16408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed"
dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
mode: GRACEFUL
new_leader_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:57992
I20260709 13:18:06.372644 16542 raft_consensus.cc:993] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50: : Instructing follower 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:06.372730 16408 raft_consensus.cc:606] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Received request to transfer leadership to TS 930e86a11db843908dabef220ce44c83
I20260709 13:18:06.373150 16563 raft_consensus.cc:1081] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Signalling peer 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:06.374560 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1885eb35b6a841d2b89c935e9962957e"
dest_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:38370
I20260709 13:18:06.375118 16330 raft_consensus.cc:493] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.375510 16330 raft_consensus.cc:3060] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.382040 16330 raft_consensus.cc:515] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.384215 16330 leader_election.cc:290] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Requested vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:06.385253 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1885eb35b6a841d2b89c935e9962957e" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:06.385265 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1885eb35b6a841d2b89c935e9962957e" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:06.385982 16408 raft_consensus.cc:3055] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:06.386117 16482 raft_consensus.cc:3060] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.386277 16408 raft_consensus.cc:740] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:06.387039 16408 consensus_queue.cc:260] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.388183 16408 raft_consensus.cc:3060] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.389360 16480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a"
dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
mode: GRACEFUL
new_leader_uuid: "17291dc3920540e780a6a73de6cbbe50"
 from {username='slave'} at 127.0.0.1:60312
I20260709 13:18:06.390015 16480 raft_consensus.cc:606] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Received request to transfer leadership to TS 17291dc3920540e780a6a73de6cbbe50
I20260709 13:18:06.393265 16482 raft_consensus.cc:2468] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:06.393865 16408 raft_consensus.cc:2468] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:06.394431 16296 leader_election.cc:304] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:06.395303 16526 raft_consensus.cc:2804] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:06.395780 16526 raft_consensus.cc:697] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Becoming Leader. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:06.395968 16482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbc053ea461b4cf38f2b8bbf5fbcbcbe"
dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
mode: GRACEFUL
new_leader_uuid: "17291dc3920540e780a6a73de6cbbe50"
 from {username='slave'} at 127.0.0.1:60312
I20260709 13:18:06.396538 16482 raft_consensus.cc:606] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Received request to transfer leadership to TS 17291dc3920540e780a6a73de6cbbe50
I20260709 13:18:06.396499 16526 consensus_queue.cc:237] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.404021 16228 catalog_manager.cc:5697] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 reported cstate change: term changed from 1 to 2, leader changed from 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2) to 930e86a11db843908dabef220ce44c83 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "930e86a11db843908dabef220ce44c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.412624 16330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "391258d2247f4747bedd344c82ab8e84"
dest_uuid: "930e86a11db843908dabef220ce44c83"
mode: GRACEFUL
new_leader_uuid: "a10ba23efa524f30995781ccc0499c2d"
 from {username='slave'} at 127.0.0.1:38394
I20260709 13:18:06.413216 16330 raft_consensus.cc:606] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 1 LEADER]: Received request to transfer leadership to TS a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:06.516909 16557 raft_consensus.cc:993] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83: : Instructing follower a10ba23efa524f30995781ccc0499c2d to start an election
I20260709 13:18:06.517354 16526 raft_consensus.cc:1081] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 1 LEADER]: Signalling peer a10ba23efa524f30995781ccc0499c2d to start an election
I20260709 13:18:06.518692 16482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "391258d2247f4747bedd344c82ab8e84"
dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
 from {username='slave'} at 127.0.0.1:60300
I20260709 13:18:06.519145 16482 raft_consensus.cc:493] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.519444 16482 raft_consensus.cc:3060] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.525297 16482 raft_consensus.cc:515] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.527354 16482 leader_election.cc:290] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 2 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:06.528098 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "391258d2247f4747bedd344c82ab8e84" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:06.528613 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "391258d2247f4747bedd344c82ab8e84" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:06.528640 16330 raft_consensus.cc:3055] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:06.529157 16408 raft_consensus.cc:3060] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.529168 16330 raft_consensus.cc:740] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:06.530000 16330 consensus_queue.cc:260] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.530920 16330 raft_consensus.cc:3060] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.534308 16408 raft_consensus.cc:2468] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 2.
I20260709 13:18:06.535198 16446 leader_election.cc:304] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:06.535634 16330 raft_consensus.cc:2468] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 2.
I20260709 13:18:06.535866 16576 raft_consensus.cc:2804] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:06.536379 16576 raft_consensus.cc:697] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 2 LEADER]: Becoming Leader. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:06.537060 16576 consensus_queue.cc:237] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.546582 16228 catalog_manager.cc:5697] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d reported cstate change: term changed from 1 to 2, leader changed from 930e86a11db843908dabef220ce44c83 (127.15.90.1) to a10ba23efa524f30995781ccc0499c2d (127.15.90.3). New cstate: current_term: 2 leader_uuid: "a10ba23efa524f30995781ccc0499c2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.600486 16577 consensus_queue.cc:1048] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.601117 16576 consensus_queue.cc:1048] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:06.609145 16567 raft_consensus.cc:993] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d: : Instructing follower 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:06.609619 16577 raft_consensus.cc:1081] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Signalling peer 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:06.611413 16332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21561d4c17834bd0b39353286e085a27"
dest_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:38380
I20260709 13:18:06.611963 16332 raft_consensus.cc:493] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.612313 16332 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.619035 16332 raft_consensus.cc:515] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.621706 16332 leader_election.cc:290] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Requested vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:06.622952 16408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:06.623144 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:06.623535 16408 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.623627 16482 raft_consensus.cc:3055] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:06.624013 16482 raft_consensus.cc:740] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:06.624778 16482 consensus_queue.cc:260] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.625949 16482 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.630127 16408 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:06.631330 16297 leader_election.cc:304] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83; no voters: 
I20260709 13:18:06.632108 16526 raft_consensus.cc:2804] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:06.632527 16526 raft_consensus.cc:697] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Becoming Leader. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:06.632540 16482 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:06.633340 16526 consensus_queue.cc:237] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.639032 16230 catalog_manager.cc:5697] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 reported cstate change: term changed from 1 to 2, leader changed from a10ba23efa524f30995781ccc0499c2d (127.15.90.3) to 930e86a11db843908dabef220ce44c83 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "930e86a11db843908dabef220ce44c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.696081 16530 raft_consensus.cc:993] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d: : Instructing follower 17291dc3920540e780a6a73de6cbbe50 to start an election
I20260709 13:18:06.696614 16577 raft_consensus.cc:1081] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Signalling peer 17291dc3920540e780a6a73de6cbbe50 to start an election
I20260709 13:18:06.698014 16408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a"
dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
 from {username='slave'} at 127.0.0.1:57984
I20260709 13:18:06.698560 16408 raft_consensus.cc:493] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.698921 16408 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.703706 16408 raft_consensus.cc:515] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.705698 16408 leader_election.cc:290] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 2 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:06.706813 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:06.707340 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:06.708019 16482 raft_consensus.cc:3055] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:06.707399 16332 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.708361 16482 raft_consensus.cc:740] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:06.709177 16482 consensus_queue.cc:260] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.710340 16482 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.711372 16530 raft_consensus.cc:993] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d: : Instructing follower 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:06.711843 16567 raft_consensus.cc:1081] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Signalling peer 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:06.713843 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac"
dest_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:38380
I20260709 13:18:06.714694 16330 raft_consensus.cc:493] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.714720 16332 raft_consensus.cc:2468] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 2.
I20260709 13:18:06.715270 16330 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.715922 16374 leader_election.cc:304] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83; no voters: 
I20260709 13:18:06.716699 16542 raft_consensus.cc:2804] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:06.716799 16482 raft_consensus.cc:2468] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 2.
I20260709 13:18:06.717231 16542 raft_consensus.cc:697] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 2 LEADER]: Becoming Leader. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:06.718082 16542 consensus_queue.cc:237] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.721517 16530 raft_consensus.cc:993] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d: : Instructing follower 17291dc3920540e780a6a73de6cbbe50 to start an election
I20260709 13:18:06.721918 16530 raft_consensus.cc:1081] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Signalling peer 17291dc3920540e780a6a73de6cbbe50 to start an election
I20260709 13:18:06.723897 16408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbc053ea461b4cf38f2b8bbf5fbcbcbe"
dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
 from {username='slave'} at 127.0.0.1:57984
I20260709 13:18:06.723696 16330 raft_consensus.cc:515] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:06.724536 16408 raft_consensus.cc:493] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.724972 16408 raft_consensus.cc:3060] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.726449 16330 leader_election.cc:290] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Requested vote from peers a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:06.726432 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:06.727128 16482 raft_consensus.cc:3055] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:06.725879 16228 catalog_manager.cc:5697] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 reported cstate change: term changed from 1 to 2, leader changed from a10ba23efa524f30995781ccc0499c2d (127.15.90.3) to 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "17291dc3920540e780a6a73de6cbbe50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.727414 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:06.728003 16406 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.727438 16482 raft_consensus.cc:740] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:06.731904 16408 raft_consensus.cc:515] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.732084 16482 consensus_queue.cc:260] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:06.733371 16482 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.734046 16408 leader_election.cc:290] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 2 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:06.734972 16480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc053ea461b4cf38f2b8bbf5fbcbcbe" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:06.735507 16480 raft_consensus.cc:3055] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:06.735834 16480 raft_consensus.cc:740] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:06.736697 16406 raft_consensus.cc:2468] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:06.736584 16480 consensus_queue.cc:260] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.737720 16480 raft_consensus.cc:3060] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.738103 16297 leader_election.cc:304] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83; no voters: 
I20260709 13:18:06.738996 16526 raft_consensus.cc:2804] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:06.739468 16526 raft_consensus.cc:697] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Becoming Leader. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:06.739410 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc053ea461b4cf38f2b8bbf5fbcbcbe" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:06.740089 16330 raft_consensus.cc:3060] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.740160 16482 raft_consensus.cc:2468] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:06.740379 16526 consensus_queue.cc:237] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:06.745430 16480 raft_consensus.cc:2468] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 2.
I20260709 13:18:06.746407 16330 raft_consensus.cc:2468] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 2.
I20260709 13:18:06.746666 16371 leader_election.cc:304] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:06.747483 16542 raft_consensus.cc:2804] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:06.747937 16542 raft_consensus.cc:697] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [term 2 LEADER]: Becoming Leader. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:06.747576 16228 catalog_manager.cc:5697] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 reported cstate change: term changed from 1 to 2, leader changed from a10ba23efa524f30995781ccc0499c2d (127.15.90.3) to 930e86a11db843908dabef220ce44c83 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "930e86a11db843908dabef220ce44c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.748675 16542 consensus_queue.cc:237] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.755442 16230 catalog_manager.cc:5697] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 reported cstate change: term changed from 1 to 2, leader changed from a10ba23efa524f30995781ccc0499c2d (127.15.90.3) to 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "17291dc3920540e780a6a73de6cbbe50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.789889 16406 raft_consensus.cc:1275] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:06.790904 16526 consensus_queue.cc:1048] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:06.797724 16480 raft_consensus.cc:1275] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:06.799487 16572 consensus_queue.cc:1048] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:06.936738 16549 raft_consensus.cc:993] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50: : Instructing follower 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:06.937196 16542 raft_consensus.cc:1081] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Signalling peer 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:06.938465 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed"
dest_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:38370
I20260709 13:18:06.938900 16330 raft_consensus.cc:493] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:06.939146 16330 raft_consensus.cc:3060] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.943442 16330 raft_consensus.cc:515] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.944968 16330 leader_election.cc:290] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Requested vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:06.945699 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:06.945952 16480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:06.946276 16406 raft_consensus.cc:3055] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:06.946458 16480 raft_consensus.cc:3060] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.946627 16406 raft_consensus.cc:740] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:06.947459 16406 consensus_queue.cc:260] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.948628 16406 raft_consensus.cc:3060] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:06.953097 16480 raft_consensus.cc:2468] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:06.954196 16296 leader_election.cc:304] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:06.954953 16572 raft_consensus.cc:2804] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:06.955089 16406 raft_consensus.cc:2468] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:06.955403 16572 raft_consensus.cc:697] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Becoming Leader. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:06.956328 16572 consensus_queue.cc:237] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:06.962291 16230 catalog_manager.cc:5697] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 reported cstate change: term changed from 1 to 2, leader changed from 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2) to 930e86a11db843908dabef220ce44c83 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "930e86a11db843908dabef220ce44c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:06.971448 16330 raft_consensus.cc:1275] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Refusing update from remote peer a10ba23efa524f30995781ccc0499c2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:06.972678 16577 consensus_queue.cc:1048] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:06.980441 16406 raft_consensus.cc:1275] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Refusing update from remote peer a10ba23efa524f30995781ccc0499c2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:06.981755 16530 consensus_queue.cc:1048] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.086758 16480 raft_consensus.cc:1275] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.088214 16572 consensus_queue.cc:1048] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.095999 16406 raft_consensus.cc:1275] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.097527 16572 consensus_queue.cc:1048] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.112103 16330 raft_consensus.cc:1275] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Refusing update from remote peer 17291dc3920540e780a6a73de6cbbe50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.113155 16542 consensus_queue.cc:1048] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.119977 16480 raft_consensus.cc:1275] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Refusing update from remote peer 17291dc3920540e780a6a73de6cbbe50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.121336 16563 consensus_queue.cc:1048] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.128034 16330 raft_consensus.cc:1275] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Refusing update from remote peer 17291dc3920540e780a6a73de6cbbe50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.129127 16563 consensus_queue.cc:1048] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.137828 16480 raft_consensus.cc:1275] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Refusing update from remote peer 17291dc3920540e780a6a73de6cbbe50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.139119 16563 consensus_queue.cc:1048] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.278218 16480 raft_consensus.cc:1275] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.279466 16572 consensus_queue.cc:1048] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.286796 16406 raft_consensus.cc:1275] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.288666 16616 consensus_queue.cc:1048] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.449848 16480 raft_consensus.cc:1275] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.451083 16616 consensus_queue.cc:1048] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:07.458731 16406 raft_consensus.cc:1275] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:07.460111 16616 consensus_queue.cc:1048] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:09.440884 15720 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:18:09.441606 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:09.458180 16330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac"
dest_uuid: "930e86a11db843908dabef220ce44c83"
mode: GRACEFUL
new_leader_uuid: "a10ba23efa524f30995781ccc0499c2d"
 from {username='slave'} at 127.0.0.1:45460
I20260709 13:18:09.458575 16330 raft_consensus.cc:606] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Received request to transfer leadership to TS a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:09.460525 16330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21561d4c17834bd0b39353286e085a27"
dest_uuid: "930e86a11db843908dabef220ce44c83"
mode: GRACEFUL
new_leader_uuid: "a10ba23efa524f30995781ccc0499c2d"
 from {username='slave'} at 127.0.0.1:45460
I20260709 13:18:09.460883 16330 raft_consensus.cc:606] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Received request to transfer leadership to TS a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:09.461683 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:09.462013 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:09.929137 16616 raft_consensus.cc:993] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83: : Instructing follower a10ba23efa524f30995781ccc0499c2d to start an election
I20260709 13:18:09.929656 16627 raft_consensus.cc:1081] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Signalling peer a10ba23efa524f30995781ccc0499c2d to start an election
I20260709 13:18:09.931067 16480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac"
dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
 from {username='slave'} at 127.0.0.1:60300
I20260709 13:18:09.931576 16480 raft_consensus.cc:493] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:09.931885 16480 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.937417 16480 raft_consensus.cc:515] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:09.939091 16480 leader_election.cc:290] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 3 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:09.939643 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:09.940004 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:09.940152 16330 raft_consensus.cc:3055] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:09.940500 16406 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.940495 16330 raft_consensus.cc:740] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:09.941428 16330 consensus_queue.cc:260] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:09.942499 16330 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:09.946844 16406 raft_consensus.cc:2468] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 3.
I20260709 13:18:09.947994 16446 leader_election.cc:304] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:09.948418 16330 raft_consensus.cc:2468] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 3.
I20260709 13:18:09.948850 16622 raft_consensus.cc:2804] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:09.949757 16622 raft_consensus.cc:697] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Becoming Leader. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:09.950417 16622 consensus_queue.cc:237] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:09.959046 16230 catalog_manager.cc:5697] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d reported cstate change: term changed from 2 to 3, leader changed from 930e86a11db843908dabef220ce44c83 (127.15.90.1) to a10ba23efa524f30995781ccc0499c2d (127.15.90.3). New cstate: current_term: 3 leader_uuid: "a10ba23efa524f30995781ccc0499c2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.061151 16616 raft_consensus.cc:993] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83: : Instructing follower a10ba23efa524f30995781ccc0499c2d to start an election
I20260709 13:18:10.061575 16627 raft_consensus.cc:1081] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Signalling peer a10ba23efa524f30995781ccc0499c2d to start an election
I20260709 13:18:10.062849 16480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21561d4c17834bd0b39353286e085a27"
dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
 from {username='slave'} at 127.0.0.1:60300
I20260709 13:18:10.063258 16480 raft_consensus.cc:493] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.063500 16480 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.068028 16480 raft_consensus.cc:515] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.069633 16480 leader_election.cc:290] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 3 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:10.070250 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:10.070746 16330 raft_consensus.cc:3055] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:10.070647 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:10.071012 16330 raft_consensus.cc:740] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:10.071218 16406 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.071710 16330 consensus_queue.cc:260] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.072497 16330 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.076948 16330 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 3.
I20260709 13:18:10.076705 16406 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 3.
I20260709 13:18:10.078042 16448 leader_election.cc:304] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:10.078823 16622 raft_consensus.cc:2804] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:10.079268 16622 raft_consensus.cc:697] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Becoming Leader. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:10.079993 16622 consensus_queue.cc:237] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.085575 16230 catalog_manager.cc:5697] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d reported cstate change: term changed from 2 to 3, leader changed from 930e86a11db843908dabef220ce44c83 (127.15.90.1) to a10ba23efa524f30995781ccc0499c2d (127.15.90.3). New cstate: current_term: 3 leader_uuid: "a10ba23efa524f30995781ccc0499c2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.462702 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:10.472702 16480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac"
dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
mode: GRACEFUL
new_leader_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:60312
I20260709 13:18:10.473212 16480 raft_consensus.cc:606] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Received request to transfer leadership to TS 930e86a11db843908dabef220ce44c83
I20260709 13:18:10.477967 16480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21561d4c17834bd0b39353286e085a27"
dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
mode: GRACEFUL
new_leader_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:60312
I20260709 13:18:10.478488 16480 raft_consensus.cc:606] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Received request to transfer leadership to TS 930e86a11db843908dabef220ce44c83
I20260709 13:18:10.490149 16407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "094e888869a94c62bd30372b45ac5f80"
dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
mode: GRACEFUL
new_leader_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:57992
I20260709 13:18:10.490607 16407 raft_consensus.cc:606] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Received request to transfer leadership to TS 930e86a11db843908dabef220ce44c83
I20260709 13:18:10.494585 16407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd7c3546314472295f927165b69929c"
dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
mode: GRACEFUL
new_leader_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:57992
I20260709 13:18:10.495003 16407 raft_consensus.cc:606] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Received request to transfer leadership to TS 930e86a11db843908dabef220ce44c83
I20260709 13:18:10.499274 16407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a"
dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
mode: GRACEFUL
new_leader_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:57992
I20260709 13:18:10.499640 16407 raft_consensus.cc:606] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 2 LEADER]: Received request to transfer leadership to TS 930e86a11db843908dabef220ce44c83
I20260709 13:18:10.513432 16407 raft_consensus.cc:1275] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Refusing update from remote peer a10ba23efa524f30995781ccc0499c2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:10.514451 16622 consensus_queue.cc:1048] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:10.520205 16407 raft_consensus.cc:1275] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Refusing update from remote peer a10ba23efa524f30995781ccc0499c2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:10.521922 16628 consensus_queue.cc:1048] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:10.536656 16330 raft_consensus.cc:1275] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Refusing update from remote peer a10ba23efa524f30995781ccc0499c2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:10.538962 16622 consensus_queue.cc:1048] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:10.547820 16332 raft_consensus.cc:1275] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Refusing update from remote peer a10ba23efa524f30995781ccc0499c2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:10.549346 16639 consensus_queue.cc:1048] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:10.550532 16639 raft_consensus.cc:993] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d: : Instructing follower 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:10.550896 16639 raft_consensus.cc:1081] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Signalling peer 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:10.552580 16332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac"
dest_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:38380
I20260709 13:18:10.553085 16332 raft_consensus.cc:493] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.553436 16332 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.560953 16639 raft_consensus.cc:993] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d: : Instructing follower 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:10.561375 16628 raft_consensus.cc:1081] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Signalling peer 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:10.560235 16332 raft_consensus.cc:515] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:10.563102 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21561d4c17834bd0b39353286e085a27"
dest_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:38380
I20260709 13:18:10.563625 16330 raft_consensus.cc:493] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.564183 16330 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.564375 16332 leader_election.cc:290] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 4 election: Requested vote from peers a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:10.564596 16406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:10.565254 16406 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.564632 16480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205bc28889664f218fa2d592c18de6ac" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:10.566035 16480 raft_consensus.cc:3055] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:10.566349 16480 raft_consensus.cc:740] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:10.567058 16480 consensus_queue.cc:260] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:10.568179 16480 raft_consensus.cc:3060] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.570205 16330 raft_consensus.cc:515] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.571450 16406 raft_consensus.cc:2468] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 4.
I20260709 13:18:10.572069 16330 leader_election.cc:290] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 4 election: Requested vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:10.572767 16297 leader_election.cc:304] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83; no voters: 
I20260709 13:18:10.573191 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:10.573377 16616 raft_consensus.cc:2804] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:10.573841 16407 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.573915 16616 raft_consensus.cc:697] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 4 LEADER]: Becoming Leader. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:10.574214 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:10.574784 16482 raft_consensus.cc:3055] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:10.575124 16482 raft_consensus.cc:740] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:10.574916 16616 consensus_queue.cc:237] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } }
I20260709 13:18:10.575913 16482 consensus_queue.cc:260] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.577076 16482 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:10.579983 16407 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 4.
I20260709 13:18:10.580880 16297 leader_election.cc:304] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, 930e86a11db843908dabef220ce44c83; no voters: 
I20260709 13:18:10.581621 16616 raft_consensus.cc:2804] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:10.582026 16616 raft_consensus.cc:697] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 4 LEADER]: Becoming Leader. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:10.582612 16616 consensus_queue.cc:237] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.583316 16482 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 4.
I20260709 13:18:10.582937 16230 catalog_manager.cc:5697] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 reported cstate change: term changed from 3 to 4, leader changed from a10ba23efa524f30995781ccc0499c2d (127.15.90.3) to 930e86a11db843908dabef220ce44c83 (127.15.90.1). New cstate: current_term: 4 leader_uuid: "930e86a11db843908dabef220ce44c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.585657 16480 raft_consensus.cc:2468] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 4.
I20260709 13:18:10.594089 16230 catalog_manager.cc:5697] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 reported cstate change: term changed from 3 to 4, leader changed from a10ba23efa524f30995781ccc0499c2d (127.15.90.3) to 930e86a11db843908dabef220ce44c83 (127.15.90.1). New cstate: current_term: 4 leader_uuid: "930e86a11db843908dabef220ce44c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.673632 16542 raft_consensus.cc:993] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50: : Instructing follower 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:10.674050 16643 raft_consensus.cc:1081] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Signalling peer 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:10.675519 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "094e888869a94c62bd30372b45ac5f80"
dest_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:38370
I20260709 13:18:10.675987 16330 raft_consensus.cc:493] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.676254 16330 raft_consensus.cc:3060] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.680173 16330 raft_consensus.cc:515] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.681443 16330 leader_election.cc:290] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Requested vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:10.682237 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094e888869a94c62bd30372b45ac5f80" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:10.682471 16480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094e888869a94c62bd30372b45ac5f80" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:10.682911 16407 raft_consensus.cc:3055] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.682996 16480 raft_consensus.cc:3060] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.683280 16407 raft_consensus.cc:740] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:10.684106 16407 consensus_queue.cc:260] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.685190 16407 raft_consensus.cc:3060] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.687357 16480 raft_consensus.cc:2468] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:10.688292 16296 leader_election.cc:304] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:10.688923 16616 raft_consensus.cc:2804] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:10.689379 16616 raft_consensus.cc:697] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Becoming Leader. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:10.690073 16407 raft_consensus.cc:2468] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:10.690161 16616 consensus_queue.cc:237] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.696655 16230 catalog_manager.cc:5697] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 reported cstate change: term changed from 1 to 2, leader changed from 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2) to 930e86a11db843908dabef220ce44c83 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "930e86a11db843908dabef220ce44c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.791500 16542 raft_consensus.cc:993] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50: : Instructing follower 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:10.791975 16643 raft_consensus.cc:1081] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Signalling peer 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:10.793227 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd7c3546314472295f927165b69929c"
dest_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:38370
I20260709 13:18:10.793608 16330 raft_consensus.cc:493] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.793820 16330 raft_consensus.cc:3060] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.797508 16330 raft_consensus.cc:515] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.798836 16330 leader_election.cc:290] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Requested vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:10.799499 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7c3546314472295f927165b69929c" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:10.799794 16480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7c3546314472295f927165b69929c" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:10.800061 16407 raft_consensus.cc:3055] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:10.800235 16480 raft_consensus.cc:3060] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.800414 16407 raft_consensus.cc:740] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:10.801187 16407 consensus_queue.cc:260] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.802027 16407 raft_consensus.cc:3060] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:10.804064 16480 raft_consensus.cc:2468] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:10.804872 16296 leader_election.cc:304] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:10.805488 16616 raft_consensus.cc:2804] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:10.805846 16616 raft_consensus.cc:697] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Becoming Leader. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:10.806666 16407 raft_consensus.cc:2468] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 2.
I20260709 13:18:10.806532 16616 consensus_queue.cc:237] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.812410 16230 catalog_manager.cc:5697] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 reported cstate change: term changed from 1 to 2, leader changed from 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2) to 930e86a11db843908dabef220ce44c83 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "930e86a11db843908dabef220ce44c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.911572 16542 raft_consensus.cc:993] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50: : Instructing follower 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:10.912002 16643 raft_consensus.cc:1081] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 2 LEADER]: Signalling peer 930e86a11db843908dabef220ce44c83 to start an election
I20260709 13:18:10.913213 16330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a"
dest_uuid: "930e86a11db843908dabef220ce44c83"
 from {username='slave'} at 127.0.0.1:38370
I20260709 13:18:10.913625 16330 raft_consensus.cc:493] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.913889 16330 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.917780 16330 raft_consensus.cc:515] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.919045 16330 leader_election.cc:290] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 3 election: Requested vote from peers 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:10.919724 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:10.919938 16480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "930e86a11db843908dabef220ce44c83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:10.920195 16407 raft_consensus.cc:3055] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:10.920465 16480 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.920544 16407 raft_consensus.cc:740] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:10.921355 16407 consensus_queue.cc:260] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.922183 16407 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:10.924376 16480 raft_consensus.cc:2468] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 3.
I20260709 13:18:10.925194 16296 leader_election.cc:304] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 930e86a11db843908dabef220ce44c83, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:10.925814 16616 raft_consensus.cc:2804] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:10.926258 16616 raft_consensus.cc:697] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 3 LEADER]: Becoming Leader. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:10.927095 16407 raft_consensus.cc:2468] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 930e86a11db843908dabef220ce44c83 in term 3.
I20260709 13:18:10.927052 16616 consensus_queue.cc:237] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:10.933106 16230 catalog_manager.cc:5697] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 reported cstate change: term changed from 2 to 3, leader changed from 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2) to 930e86a11db843908dabef220ce44c83 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "930e86a11db843908dabef220ce44c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.979761 16407 raft_consensus.cc:1275] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:10.980962 16616 consensus_queue.cc:1048] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:10.987900 16480 raft_consensus.cc:1275] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 4 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:10.989936 16616 consensus_queue.cc:1048] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:11.047787 16407 raft_consensus.cc:1275] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:11.048882 16627 consensus_queue.cc:1048] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:11.056615 16480 raft_consensus.cc:1275] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 4 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:11.058312 16648 consensus_queue.cc:1048] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:11.153534 16406 raft_consensus.cc:1275] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:11.154628 16648 consensus_queue.cc:1048] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:11.162832 16480 raft_consensus.cc:1275] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:11.164188 16616 consensus_queue.cc:1048] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:11.329790 16406 raft_consensus.cc:1275] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:11.331203 16616 consensus_queue.cc:1048] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:11.333325 16480 raft_consensus.cc:1275] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:11.334517 16616 consensus_queue.cc:1048] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:11.436625 16406 raft_consensus.cc:1275] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:11.437987 16648 consensus_queue.cc:1048] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:11.445950 16480 raft_consensus.cc:1275] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Refusing update from remote peer 930e86a11db843908dabef220ce44c83: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:11.447588 16648 consensus_queue.cc:1048] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:13.506062 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:13.513434 16330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21561d4c17834bd0b39353286e085a27"
dest_uuid: "930e86a11db843908dabef220ce44c83"
mode: GRACEFUL
new_leader_uuid: "17291dc3920540e780a6a73de6cbbe50"
 from {username='slave'} at 127.0.0.1:45460
I20260709 13:18:13.514073 16330 raft_consensus.cc:606] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 4 LEADER]: Received request to transfer leadership to TS 17291dc3920540e780a6a73de6cbbe50
I20260709 13:18:13.516836 16330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed"
dest_uuid: "930e86a11db843908dabef220ce44c83"
mode: GRACEFUL
new_leader_uuid: "a10ba23efa524f30995781ccc0499c2d"
 from {username='slave'} at 127.0.0.1:45460
I20260709 13:18:13.517311 16330 raft_consensus.cc:606] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Received request to transfer leadership to TS a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:13.519910 16330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a"
dest_uuid: "930e86a11db843908dabef220ce44c83"
mode: GRACEFUL
new_leader_uuid: "a10ba23efa524f30995781ccc0499c2d"
 from {username='slave'} at 127.0.0.1:45460
I20260709 13:18:13.520319 16330 raft_consensus.cc:606] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 3 LEADER]: Received request to transfer leadership to TS a10ba23efa524f30995781ccc0499c2d
I20260709 13:18:13.522217 16330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd7c3546314472295f927165b69929c"
dest_uuid: "930e86a11db843908dabef220ce44c83"
mode: GRACEFUL
new_leader_uuid: "17291dc3920540e780a6a73de6cbbe50"
 from {username='slave'} at 127.0.0.1:45460
I20260709 13:18:13.522617 16330 raft_consensus.cc:606] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Received request to transfer leadership to TS 17291dc3920540e780a6a73de6cbbe50
I20260709 13:18:13.523519 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:18:13.523989 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:13.646020 16627 raft_consensus.cc:993] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83: : Instructing follower a10ba23efa524f30995781ccc0499c2d to start an election
I20260709 13:18:13.646509 16656 raft_consensus.cc:1081] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Signalling peer a10ba23efa524f30995781ccc0499c2d to start an election
I20260709 13:18:13.647894 16482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed"
dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
 from {username='slave'} at 127.0.0.1:60300
I20260709 13:18:13.648307 16482 raft_consensus.cc:493] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.648582 16482 raft_consensus.cc:3060] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.654385 16482 raft_consensus.cc:515] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.656821 16482 leader_election.cc:290] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 3 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:13.657512 16330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:13.658021 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac47935fb81d4c90bb17cd9c7e76efed" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:13.658391 16330 raft_consensus.cc:3055] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:13.658582 16407 raft_consensus.cc:3060] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.658695 16330 raft_consensus.cc:740] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:13.659538 16330 consensus_queue.cc:260] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.660794 16330 raft_consensus.cc:3060] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.665792 16407 raft_consensus.cc:2468] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 3.
I20260709 13:18:13.667155 16446 leader_election.cc:304] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:13.667793 16330 raft_consensus.cc:2468] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 3.
I20260709 13:18:13.668164 16628 raft_consensus.cc:2804] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:13.669378 16628 raft_consensus.cc:697] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Becoming Leader. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:13.670473 16628 consensus_queue.cc:237] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.677064 16228 catalog_manager.cc:5697] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d reported cstate change: term changed from 2 to 3, leader changed from 930e86a11db843908dabef220ce44c83 (127.15.90.1) to a10ba23efa524f30995781ccc0499c2d (127.15.90.3). New cstate: current_term: 3 leader_uuid: "a10ba23efa524f30995781ccc0499c2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.757767 16627 raft_consensus.cc:993] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83: : Instructing follower a10ba23efa524f30995781ccc0499c2d to start an election
I20260709 13:18:13.758217 16656 raft_consensus.cc:1081] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 3 LEADER]: Signalling peer a10ba23efa524f30995781ccc0499c2d to start an election
I20260709 13:18:13.759524 16482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a"
dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
 from {username='slave'} at 127.0.0.1:60300
I20260709 13:18:13.760032 16482 raft_consensus.cc:493] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.760335 16482 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:13.765268 16482 raft_consensus.cc:515] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.767269 16482 leader_election.cc:290] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 4 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477)
I20260709 13:18:13.768332 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:13.768344 16407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "badf93c1f3fe432790a0899524b1d56a" candidate_uuid: "a10ba23efa524f30995781ccc0499c2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
I20260709 13:18:13.768936 16332 raft_consensus.cc:3055] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:13.769013 16407 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:13.769239 16332 raft_consensus.cc:740] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:13.770190 16332 consensus_queue.cc:260] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.771416 16332 raft_consensus.cc:3060] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:13.775132 16407 raft_consensus.cc:2468] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 4.
I20260709 13:18:13.776077 16446 leader_election.cc:304] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:13.776862 16628 raft_consensus.cc:2804] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:13.777307 16628 raft_consensus.cc:697] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 4 LEADER]: Becoming Leader. State: Replica: a10ba23efa524f30995781ccc0499c2d, State: Running, Role: LEADER
I20260709 13:18:13.777413 16332 raft_consensus.cc:2468] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10ba23efa524f30995781ccc0499c2d in term 4.
I20260709 13:18:13.778154 16628 consensus_queue.cc:237] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.784899 16228 catalog_manager.cc:5697] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d reported cstate change: term changed from 3 to 4, leader changed from 930e86a11db843908dabef220ce44c83 (127.15.90.1) to a10ba23efa524f30995781ccc0499c2d (127.15.90.3). New cstate: current_term: 4 leader_uuid: "a10ba23efa524f30995781ccc0499c2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.869732 16627 raft_consensus.cc:993] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83: : Instructing follower 17291dc3920540e780a6a73de6cbbe50 to start an election
I20260709 13:18:13.870203 16656 raft_consensus.cc:1081] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 4 LEADER]: Signalling peer 17291dc3920540e780a6a73de6cbbe50 to start an election
I20260709 13:18:13.871528 16406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21561d4c17834bd0b39353286e085a27"
dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
 from {username='slave'} at 127.0.0.1:57972
I20260709 13:18:13.871893 16406 raft_consensus.cc:493] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.872116 16406 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.876262 16406 raft_consensus.cc:515] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.877601 16406 leader_election.cc:290] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 5 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:13.878311 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:13.878563 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21561d4c17834bd0b39353286e085a27" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:13.879020 16332 raft_consensus.cc:3055] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:13.879058 16482 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.879487 16332 raft_consensus.cc:740] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:13.880353 16332 consensus_queue.cc:260] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.881616 16332 raft_consensus.cc:3060] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.885392 16482 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 5.
I20260709 13:18:13.886648 16371 leader_election.cc:304] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:13.887473 16643 raft_consensus.cc:2804] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:13.887873 16332 raft_consensus.cc:2468] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 5.
I20260709 13:18:13.888816 16643 raft_consensus.cc:697] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 5 LEADER]: Becoming Leader. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:13.889714 16643 consensus_queue.cc:237] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.895830 16228 catalog_manager.cc:5697] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 reported cstate change: term changed from 4 to 5, leader changed from 930e86a11db843908dabef220ce44c83 (127.15.90.1) to 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2). New cstate: current_term: 5 leader_uuid: "17291dc3920540e780a6a73de6cbbe50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.946180 16627 raft_consensus.cc:993] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83: : Instructing follower 17291dc3920540e780a6a73de6cbbe50 to start an election
I20260709 13:18:13.946655 16656 raft_consensus.cc:1081] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Signalling peer 17291dc3920540e780a6a73de6cbbe50 to start an election
I20260709 13:18:13.947930 16406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd7c3546314472295f927165b69929c"
dest_uuid: "17291dc3920540e780a6a73de6cbbe50"
 from {username='slave'} at 127.0.0.1:57972
I20260709 13:18:13.948283 16406 raft_consensus.cc:493] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.948518 16406 raft_consensus.cc:3060] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.952258 16406 raft_consensus.cc:515] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.953513 16406 leader_election.cc:290] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 3 election: Requested vote from peers 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797), a10ba23efa524f30995781ccc0499c2d (127.15.90.3:32869)
I20260709 13:18:13.954196 16332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7c3546314472295f927165b69929c" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "930e86a11db843908dabef220ce44c83"
I20260709 13:18:13.954423 16482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd7c3546314472295f927165b69929c" candidate_uuid: "17291dc3920540e780a6a73de6cbbe50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a10ba23efa524f30995781ccc0499c2d"
I20260709 13:18:13.954766 16332 raft_consensus.cc:3055] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:13.954872 16482 raft_consensus.cc:3060] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.955149 16332 raft_consensus.cc:740] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 930e86a11db843908dabef220ce44c83, State: Running, Role: LEADER
I20260709 13:18:13.956004 16332 consensus_queue.cc:260] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.957206 16332 raft_consensus.cc:3060] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:13.960989 16482 raft_consensus.cc:2468] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 3.
I20260709 13:18:13.961917 16371 leader_election.cc:304] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17291dc3920540e780a6a73de6cbbe50, a10ba23efa524f30995781ccc0499c2d; no voters: 
I20260709 13:18:13.962574 16643 raft_consensus.cc:2804] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:13.963042 16643 raft_consensus.cc:697] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 3 LEADER]: Becoming Leader. State: Replica: 17291dc3920540e780a6a73de6cbbe50, State: Running, Role: LEADER
I20260709 13:18:13.963302 16332 raft_consensus.cc:2468] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17291dc3920540e780a6a73de6cbbe50 in term 3.
I20260709 13:18:13.963934 16643 consensus_queue.cc:237] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } }
I20260709 13:18:13.970264 16228 catalog_manager.cc:5697] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 reported cstate change: term changed from 2 to 3, leader changed from 930e86a11db843908dabef220ce44c83 (127.15.90.1) to 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2). New cstate: current_term: 3 leader_uuid: "17291dc3920540e780a6a73de6cbbe50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.195925 16406 raft_consensus.cc:1275] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Refusing update from remote peer a10ba23efa524f30995781ccc0499c2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:14.197048 16628 consensus_queue.cc:1048] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.207252 16332 raft_consensus.cc:1275] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Refusing update from remote peer a10ba23efa524f30995781ccc0499c2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:14.209482 16670 consensus_queue.cc:1048] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.212468 16330 raft_consensus.cc:1275] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 4 FOLLOWER]: Refusing update from remote peer a10ba23efa524f30995781ccc0499c2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:14.213605 16670 consensus_queue.cc:1048] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:14.223009 16406 raft_consensus.cc:1275] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Refusing update from remote peer a10ba23efa524f30995781ccc0499c2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:18:14.226631 16657 consensus_queue.cc:1048] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "17291dc3920540e780a6a73de6cbbe50" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:14.347139 16482 raft_consensus.cc:1275] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 5 FOLLOWER]: Refusing update from remote peer 17291dc3920540e780a6a73de6cbbe50: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:14.348313 16643 consensus_queue.cc:1048] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:14.356439 16330 raft_consensus.cc:1275] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 5 FOLLOWER]: Refusing update from remote peer 17291dc3920540e780a6a73de6cbbe50: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:18:14.357858 16665 consensus_queue.cc:1048] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:14.391999 16330 raft_consensus.cc:1275] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Refusing update from remote peer 17291dc3920540e780a6a73de6cbbe50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:14.393075 16665 consensus_queue.cc:1048] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "930e86a11db843908dabef220ce44c83" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 33797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.400684 16482 raft_consensus.cc:1275] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Refusing update from remote peer 17291dc3920540e780a6a73de6cbbe50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:14.403980 16643 consensus_queue.cc:1048] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10ba23efa524f30995781ccc0499c2d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 32869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:14.524844 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:14.531040 15720 tablet_server.cc:179] TabletServer@127.15.90.1:0 shutting down...
I20260709 13:18:14.558210 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:14.558988 15720 tablet_replica.cc:333] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83: stopping tablet replica
I20260709 13:18:14.559660 15720 raft_consensus.cc:2243] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.560173 15720 raft_consensus.cc:2272] T 21561d4c17834bd0b39353286e085a27 P 930e86a11db843908dabef220ce44c83 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.562709 15720 tablet_replica.cc:333] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83: stopping tablet replica
I20260709 13:18:14.563295 15720 raft_consensus.cc:2243] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.563897 15720 raft_consensus.cc:2272] T 391258d2247f4747bedd344c82ab8e84 P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.565970 15720 tablet_replica.cc:333] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83: stopping tablet replica
I20260709 13:18:14.566515 15720 raft_consensus.cc:2243] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.566871 15720 raft_consensus.cc:2272] T ac47935fb81d4c90bb17cd9c7e76efed P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.568969 15720 tablet_replica.cc:333] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83: stopping tablet replica
I20260709 13:18:14.569460 15720 raft_consensus.cc:2243] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.569808 15720 raft_consensus.cc:2272] T ddd7c3546314472295f927165b69929c P 930e86a11db843908dabef220ce44c83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.572371 15720 tablet_replica.cc:333] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83: stopping tablet replica
I20260709 13:18:14.572850 15720 raft_consensus.cc:2243] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.573184 15720 raft_consensus.cc:2272] T badf93c1f3fe432790a0899524b1d56a P 930e86a11db843908dabef220ce44c83 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.575237 15720 tablet_replica.cc:333] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83: stopping tablet replica
I20260709 13:18:14.575748 15720 raft_consensus.cc:2243] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.576099 15720 raft_consensus.cc:2272] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.577813 15720 tablet_replica.cc:333] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83: stopping tablet replica
I20260709 13:18:14.578249 15720 raft_consensus.cc:2243] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:14.579174 15720 raft_consensus.cc:2272] T 1885eb35b6a841d2b89c935e9962957e P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.580992 15720 tablet_replica.cc:333] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83: stopping tablet replica
I20260709 13:18:14.581477 15720 raft_consensus.cc:2243] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:14.582250 15720 raft_consensus.cc:2272] T 094e888869a94c62bd30372b45ac5f80 P 930e86a11db843908dabef220ce44c83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.584162 15720 tablet_replica.cc:333] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83: stopping tablet replica
I20260709 13:18:14.584733 15720 raft_consensus.cc:2243] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:14.585584 15720 raft_consensus.cc:2272] T 677ad46968fc45a686b66258e5f1cad7 P 930e86a11db843908dabef220ce44c83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.587538 15720 tablet_replica.cc:333] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83: stopping tablet replica
I20260709 13:18:14.588039 15720 raft_consensus.cc:2243] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:18:14.588812 15720 raft_consensus.cc:2272] T 205bc28889664f218fa2d592c18de6ac P 930e86a11db843908dabef220ce44c83 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.619951 15720 tablet_server.cc:196] TabletServer@127.15.90.1:0 shutdown complete.
I20260709 13:18:14.641564 15720 tablet_server.cc:179] TabletServer@127.15.90.2:0 shutting down...
W20260709 13:18:14.657433 16448 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.90.1:33797: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260709 13:18:14.672948 16448 consensus_peers.cc:597] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d -> Peer 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797): Couldn't send request to peer 930e86a11db843908dabef220ce44c83. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:33797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:14.676298 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:14.677214 15720 tablet_replica.cc:333] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50: stopping tablet replica
W20260709 13:18:14.677627 16446 consensus_peers.cc:597] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d -> Peer 17291dc3920540e780a6a73de6cbbe50 (127.15.90.2:43477): Couldn't send request to peer 17291dc3920540e780a6a73de6cbbe50. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:14.678457 15720 raft_consensus.cc:2243] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:14.679487 15720 raft_consensus.cc:2272] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.681296 15720 tablet_replica.cc:333] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50: stopping tablet replica
I20260709 13:18:14.681792 15720 raft_consensus.cc:2243] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.682153 15720 raft_consensus.cc:2272] T 391258d2247f4747bedd344c82ab8e84 P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.683774 15720 tablet_replica.cc:333] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50: stopping tablet replica
I20260709 13:18:14.684319 15720 raft_consensus.cc:2243] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:18:14.684995 15720 raft_consensus.cc:2272] T 21561d4c17834bd0b39353286e085a27 P 17291dc3920540e780a6a73de6cbbe50 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.687034 15720 tablet_replica.cc:333] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50: stopping tablet replica
I20260709 13:18:14.687564 15720 raft_consensus.cc:2243] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.688042 15720 raft_consensus.cc:2272] T 1885eb35b6a841d2b89c935e9962957e P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.689636 15720 tablet_replica.cc:333] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50: stopping tablet replica
I20260709 13:18:14.690119 15720 raft_consensus.cc:2243] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.690531 15720 raft_consensus.cc:2272] T 094e888869a94c62bd30372b45ac5f80 P 17291dc3920540e780a6a73de6cbbe50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.692162 15720 tablet_replica.cc:333] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50: stopping tablet replica
I20260709 13:18:14.692642 15720 raft_consensus.cc:2243] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.693013 15720 raft_consensus.cc:2272] T 677ad46968fc45a686b66258e5f1cad7 P 17291dc3920540e780a6a73de6cbbe50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.694720 15720 tablet_replica.cc:333] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50: stopping tablet replica
I20260709 13:18:14.695199 15720 raft_consensus.cc:2243] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.695611 15720 raft_consensus.cc:2272] T 205bc28889664f218fa2d592c18de6ac P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.697119 15720 tablet_replica.cc:333] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50: stopping tablet replica
I20260709 13:18:14.697563 15720 raft_consensus.cc:2243] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.697950 15720 raft_consensus.cc:2272] T badf93c1f3fe432790a0899524b1d56a P 17291dc3920540e780a6a73de6cbbe50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.700343 15720 tablet_replica.cc:333] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50: stopping tablet replica
I20260709 13:18:14.700793 15720 raft_consensus.cc:2243] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:14.701483 15720 raft_consensus.cc:2272] T ddd7c3546314472295f927165b69929c P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.703259 15720 tablet_replica.cc:333] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50: stopping tablet replica
I20260709 13:18:14.703760 15720 raft_consensus.cc:2243] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.704169 15720 raft_consensus.cc:2272] T ac47935fb81d4c90bb17cd9c7e76efed P 17291dc3920540e780a6a73de6cbbe50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.735275 15720 tablet_server.cc:196] TabletServer@127.15.90.2:0 shutdown complete.
W20260709 13:18:14.736299 16448 consensus_peers.cc:597] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d -> Peer 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797): Couldn't send request to peer 930e86a11db843908dabef220ce44c83. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:33797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:14.736878 16448 consensus_peers.cc:597] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d -> Peer 930e86a11db843908dabef220ce44c83 (127.15.90.1:33797): Couldn't send request to peer 930e86a11db843908dabef220ce44c83. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:33797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:14.757431 15720 tablet_server.cc:179] TabletServer@127.15.90.3:0 shutting down...
I20260709 13:18:14.784057 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:14.784771 15720 tablet_replica.cc:333] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d: stopping tablet replica
I20260709 13:18:14.785480 15720 raft_consensus.cc:2243] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:18:14.786392 15720 raft_consensus.cc:2272] T ac47935fb81d4c90bb17cd9c7e76efed P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.788719 15720 tablet_replica.cc:333] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d: stopping tablet replica
I20260709 13:18:14.789467 15720 raft_consensus.cc:2243] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.790088 15720 raft_consensus.cc:2272] T 21561d4c17834bd0b39353286e085a27 P a10ba23efa524f30995781ccc0499c2d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.792485 15720 tablet_replica.cc:333] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d: stopping tablet replica
I20260709 13:18:14.793045 15720 raft_consensus.cc:2243] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.793516 15720 raft_consensus.cc:2272] T bbc053ea461b4cf38f2b8bbf5fbcbcbe P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.795446 15720 tablet_replica.cc:333] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d: stopping tablet replica
I20260709 13:18:14.796060 15720 raft_consensus.cc:2243] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:18:14.796891 15720 raft_consensus.cc:2272] T badf93c1f3fe432790a0899524b1d56a P a10ba23efa524f30995781ccc0499c2d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.799060 15720 tablet_replica.cc:333] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d: stopping tablet replica
I20260709 13:18:14.799630 15720 raft_consensus.cc:2243] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.800143 15720 raft_consensus.cc:2272] T ddd7c3546314472295f927165b69929c P a10ba23efa524f30995781ccc0499c2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.802202 15720 tablet_replica.cc:333] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d: stopping tablet replica
I20260709 13:18:14.802752 15720 raft_consensus.cc:2243] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:18:14.803556 15720 raft_consensus.cc:2272] T 391258d2247f4747bedd344c82ab8e84 P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.805442 15720 tablet_replica.cc:333] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d: stopping tablet replica
I20260709 13:18:14.805961 15720 raft_consensus.cc:2243] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.806411 15720 raft_consensus.cc:2272] T 205bc28889664f218fa2d592c18de6ac P a10ba23efa524f30995781ccc0499c2d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.808091 15720 tablet_replica.cc:333] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d: stopping tablet replica
I20260709 13:18:14.808563 15720 raft_consensus.cc:2243] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.809026 15720 raft_consensus.cc:2272] T 677ad46968fc45a686b66258e5f1cad7 P a10ba23efa524f30995781ccc0499c2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.810668 15720 tablet_replica.cc:333] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d: stopping tablet replica
I20260709 13:18:14.811141 15720 raft_consensus.cc:2243] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.811556 15720 raft_consensus.cc:2272] T 094e888869a94c62bd30372b45ac5f80 P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.813294 15720 tablet_replica.cc:333] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d: stopping tablet replica
I20260709 13:18:14.813757 15720 raft_consensus.cc:2243] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:14.814193 15720 raft_consensus.cc:2272] T 1885eb35b6a841d2b89c935e9962957e P a10ba23efa524f30995781ccc0499c2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.842509 15720 tablet_server.cc:196] TabletServer@127.15.90.3:0 shutdown complete.
I20260709 13:18:14.862775 15720 master.cc:562] Master@127.15.90.62:38945 shutting down...
I20260709 13:18:14.887017 15720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:18:14.887557 15720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:14.887961 15720 tablet_replica.cc:333] T 00000000000000000000000000000000 P 189c8a6a0130456283c1f94f74c1bb3b: stopping tablet replica
I20260709 13:18:14.907984 15720 master.cc:584] Master@127.15.90.62:38945 shutdown complete.
17291dc3920540e780a6a73de6cbbe50  4
930e86a11db843908dabef220ce44c83  5
a10ba23efa524f30995781ccc0499c2d  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10595 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:18:14.949803 15720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.90.62:35161
I20260709 13:18:14.950901 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:14.957432 16683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:14.957962 16686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:14.958237 16684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:14.959481 15720 server_base.cc:1061] running on GCE node
I20260709 13:18:14.963320 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:14.963539 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:14.963728 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603094963707 us; error 0 us; skew 500 ppm
I20260709 13:18:14.964289 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:14.966858 15720 webserver.cc:533] Webserver started at http://127.15.90.62:39919/ using document root <none> and password file <none>
I20260709 13:18:14.967372 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:14.967583 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:14.967923 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:14.969172 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/master-0-root/instance:
uuid: "c8653aabbcbd4e268c41b15906779d0b"
format_stamp: "Formatted at 2026-07-09 13:18:14 on dist-test-slave-fpp7"
I20260709 13:18:14.973912 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:18:14.977481 16691 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:14.978298 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:18:14.978614 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/master-0-root
uuid: "c8653aabbcbd4e268c41b15906779d0b"
format_stamp: "Formatted at 2026-07-09 13:18:14 on dist-test-slave-fpp7"
I20260709 13:18:14.978924 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:14.998914 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:15.000381 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:15.043774 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.62:35161
I20260709 13:18:15.043953 16742 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.62:35161 every 8 connection(s)
I20260709 13:18:15.047866 16743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.057794 16743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Bootstrap starting.
I20260709 13:18:15.062183 16743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.066329 16743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: No bootstrap required, opened a new log
I20260709 13:18:15.068310 16743 raft_consensus.cc:359] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8653aabbcbd4e268c41b15906779d0b" member_type: VOTER }
I20260709 13:18:15.068696 16743 raft_consensus.cc:385] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:15.068913 16743 raft_consensus.cc:740] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8653aabbcbd4e268c41b15906779d0b, State: Initialized, Role: FOLLOWER
I20260709 13:18:15.069509 16743 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8653aabbcbd4e268c41b15906779d0b" member_type: VOTER }
I20260709 13:18:15.069940 16743 raft_consensus.cc:399] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:18:15.070148 16743 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:18:15.070458 16743 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:15.074412 16743 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8653aabbcbd4e268c41b15906779d0b" member_type: VOTER }
I20260709 13:18:15.074894 16743 leader_election.cc:304] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8653aabbcbd4e268c41b15906779d0b; no voters: 
I20260709 13:18:15.076061 16743 leader_election.cc:290] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:18:15.076570 16746 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:15.078078 16746 raft_consensus.cc:697] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [term 1 LEADER]: Becoming Leader. State: Replica: c8653aabbcbd4e268c41b15906779d0b, State: Running, Role: LEADER
I20260709 13:18:15.078923 16743 sys_catalog.cc:565] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:18:15.078800 16746 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8653aabbcbd4e268c41b15906779d0b" member_type: VOTER }
I20260709 13:18:15.084815 16747 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8653aabbcbd4e268c41b15906779d0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8653aabbcbd4e268c41b15906779d0b" member_type: VOTER } }
I20260709 13:18:15.084909 16748 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8653aabbcbd4e268c41b15906779d0b. Latest consensus state: current_term: 1 leader_uuid: "c8653aabbcbd4e268c41b15906779d0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8653aabbcbd4e268c41b15906779d0b" member_type: VOTER } }
I20260709 13:18:15.085875 16747 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:15.085938 16748 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [sys.catalog]: This master's current role is: LEADER
I20260709 13:18:15.088531 16754 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:18:15.094753 16754 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:18:15.097827 15720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:18:15.103967 16754 catalog_manager.cc:1383] Generated new cluster ID: 5ab38b66223d4d238d9946658644658f
I20260709 13:18:15.104282 16754 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:18:15.147368 16754 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:18:15.148896 16754 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:18:15.162892 16754 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Generated new TSK 0
I20260709 13:18:15.163615 16754 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:18:15.229545 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:15.235773 16764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:15.237226 16765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:15.238797 16767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:15.239188 15720 server_base.cc:1061] running on GCE node
I20260709 13:18:15.240294 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:15.240530 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:15.240720 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603095240701 us; error 0 us; skew 500 ppm
I20260709 13:18:15.241278 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:15.243809 15720 webserver.cc:533] Webserver started at http://127.15.90.1:37583/ using document root <none> and password file <none>
I20260709 13:18:15.244308 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:15.244521 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:15.244799 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:15.246002 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/instance:
uuid: "96eaa6dafb3e4bbe914e54dc12507912"
format_stamp: "Formatted at 2026-07-09 13:18:15 on dist-test-slave-fpp7"
I20260709 13:18:15.250874 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:18:15.254573 16772 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:15.255429 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:18:15.255726 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root
uuid: "96eaa6dafb3e4bbe914e54dc12507912"
format_stamp: "Formatted at 2026-07-09 13:18:15 on dist-test-slave-fpp7"
I20260709 13:18:15.255988 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:15.272536 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:15.273917 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:15.275496 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:15.278038 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:15.278228 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:15.278539 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:15.278709 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:15.326545 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.1:46655
I20260709 13:18:15.326653 16834 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.1:46655 every 8 connection(s)
I20260709 13:18:15.331827 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:15.340806 16839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:15.340770 16840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:15.343880 16842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:15.344475 15720 server_base.cc:1061] running on GCE node
I20260709 13:18:15.345955 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:15.346205 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:15.346405 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603095346377 us; error 0 us; skew 500 ppm
I20260709 13:18:15.346967 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:15.349169 16835 heartbeater.cc:344] Connected to a master server at 127.15.90.62:35161
I20260709 13:18:15.349562 16835 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:15.349881 15720 webserver.cc:533] Webserver started at http://127.15.90.2:35831/ using document root <none> and password file <none>
I20260709 13:18:15.350407 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:15.350338 16835 heartbeater.cc:507] Master 127.15.90.62:35161 requested a full tablet report, sending...
I20260709 13:18:15.350782 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:15.351092 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:15.352576 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/instance:
uuid: "4b60b701acc7473e87e3e529a2a34689"
format_stamp: "Formatted at 2026-07-09 13:18:15 on dist-test-slave-fpp7"
I20260709 13:18:15.352681 16708 ts_manager.cc:194] Registered new tserver with Master: 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:15.355389 16708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58310
I20260709 13:18:15.358774 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:18:15.362267 16847 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:15.363116 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:18:15.363468 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root
uuid: "4b60b701acc7473e87e3e529a2a34689"
format_stamp: "Formatted at 2026-07-09 13:18:15 on dist-test-slave-fpp7"
I20260709 13:18:15.363824 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:15.375181 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:15.376602 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:15.378271 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:15.381439 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:15.381676 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:15.381932 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:15.382105 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:15.428284 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.2:33931
I20260709 13:18:15.428366 16909 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.2:33931 every 8 connection(s)
I20260709 13:18:15.433712 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:15.441641 16913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:15.443269 16914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:15.446681 16916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:15.446995 16910 heartbeater.cc:344] Connected to a master server at 127.15.90.62:35161
I20260709 13:18:15.447274 15720 server_base.cc:1061] running on GCE node
I20260709 13:18:15.447517 16910 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:15.448369 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:18:15.448410 16910 heartbeater.cc:507] Master 127.15.90.62:35161 requested a full tablet report, sending...
W20260709 13:18:15.448753 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:15.449030 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603095449008 us; error 0 us; skew 500 ppm
I20260709 13:18:15.449928 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:15.450709 16708 ts_manager.cc:194] Registered new tserver with Master: 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:15.452263 16708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58326
I20260709 13:18:15.452816 15720 webserver.cc:533] Webserver started at http://127.15.90.3:43081/ using document root <none> and password file <none>
I20260709 13:18:15.453509 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:15.453783 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:15.454082 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:15.455363 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/instance:
uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
format_stamp: "Formatted at 2026-07-09 13:18:15 on dist-test-slave-fpp7"
I20260709 13:18:15.460320 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:15.463632 16921 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:15.464499 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:18:15.464814 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root
uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
format_stamp: "Formatted at 2026-07-09 13:18:15 on dist-test-slave-fpp7"
I20260709 13:18:15.465127 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:15.485757 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:15.487001 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:15.488318 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:15.490483 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:15.490717 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:15.490960 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:15.491132 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:15.530481 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.3:33725
I20260709 13:18:15.530586 16983 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.3:33725 every 8 connection(s)
I20260709 13:18:15.544239 16984 heartbeater.cc:344] Connected to a master server at 127.15.90.62:35161
I20260709 13:18:15.544615 16984 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:15.545295 16984 heartbeater.cc:507] Master 127.15.90.62:35161 requested a full tablet report, sending...
I20260709 13:18:15.547152 16708 ts_manager.cc:194] Registered new tserver with Master: ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:15.548043 15720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01415886s
I20260709 13:18:15.548478 16708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58336
I20260709 13:18:15.572615 16708 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58338:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:18:15.579085 16708 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:18:15.791009 16800 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5bdf407d5944728fca8072489ee727 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:15.791522 16799 tablet_service.cc:1511] Processing CreateTablet for tablet efa7919f3d1c40e096823aab461b0e25 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:15.792647 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5bdf407d5944728fca8072489ee727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.793241 16799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa7919f3d1c40e096823aab461b0e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.792886 16798 tablet_service.cc:1511] Processing CreateTablet for tablet 671210bca23f4566a684a188613c1665 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:15.794176 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 671210bca23f4566a684a188613c1665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.795972 16797 tablet_service.cc:1511] Processing CreateTablet for tablet 4c50b9c8ead54558a785ce80fcc5fb62 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:15.797426 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c50b9c8ead54558a785ce80fcc5fb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.799211 16796 tablet_service.cc:1511] Processing CreateTablet for tablet 109354c29850459b80f792dad016fc0d (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:15.800531 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109354c29850459b80f792dad016fc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.805193 16795 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:15.806943 16795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.813578 16949 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5bdf407d5944728fca8072489ee727 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:15.815263 16949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5bdf407d5944728fca8072489ee727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.817194 16948 tablet_service.cc:1511] Processing CreateTablet for tablet efa7919f3d1c40e096823aab461b0e25 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:15.818837 16948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa7919f3d1c40e096823aab461b0e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.826807 16794 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcc7a68c24d41ef9c36f0bbfdb0e774 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:15.828215 16794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcc7a68c24d41ef9c36f0bbfdb0e774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.827967 16791 tablet_service.cc:1511] Processing CreateTablet for tablet 89c4a22bddc9425886aa0574ae085451 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:15.829224 16791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c4a22bddc9425886aa0574ae085451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.830226 16793 tablet_service.cc:1511] Processing CreateTablet for tablet 595865d470ea4e5489bcc4699f26ff4a (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:15.831624 16947 tablet_service.cc:1511] Processing CreateTablet for tablet 671210bca23f4566a684a188613c1665 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:15.832872 16792 tablet_service.cc:1511] Processing CreateTablet for tablet 17115e8a13c346f1998df3bc8f52ec52 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:15.833407 16947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 671210bca23f4566a684a188613c1665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.831524 16793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595865d470ea4e5489bcc4699f26ff4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.839179 16999 tablet_bootstrap.cc:492] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:15.840070 16792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17115e8a13c346f1998df3bc8f52ec52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.841200 16798 tablet_service.cc:1511] Processing CreateTablet for tablet 6455509d1ac14e1d961f38607a869924 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:15.842348 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6455509d1ac14e1d961f38607a869924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.845131 16946 tablet_service.cc:1511] Processing CreateTablet for tablet 4c50b9c8ead54558a785ce80fcc5fb62 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:15.846444 16946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c50b9c8ead54558a785ce80fcc5fb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.851630 16945 tablet_service.cc:1511] Processing CreateTablet for tablet 109354c29850459b80f792dad016fc0d (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:15.852906 16945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109354c29850459b80f792dad016fc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.866423 16944 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:15.867806 16944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.867704 16943 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcc7a68c24d41ef9c36f0bbfdb0e774 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:15.869809 16942 tablet_service.cc:1511] Processing CreateTablet for tablet 595865d470ea4e5489bcc4699f26ff4a (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:15.871030 16942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595865d470ea4e5489bcc4699f26ff4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.872854 16941 tablet_service.cc:1511] Processing CreateTablet for tablet 17115e8a13c346f1998df3bc8f52ec52 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:15.874145 16941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17115e8a13c346f1998df3bc8f52ec52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.876691 16940 tablet_service.cc:1511] Processing CreateTablet for tablet 89c4a22bddc9425886aa0574ae085451 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:15.877951 16940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c4a22bddc9425886aa0574ae085451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.880147 16943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcc7a68c24d41ef9c36f0bbfdb0e774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.882556 16875 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5bdf407d5944728fca8072489ee727 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:18:15.883922 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5bdf407d5944728fca8072489ee727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.906145 16874 tablet_service.cc:1511] Processing CreateTablet for tablet efa7919f3d1c40e096823aab461b0e25 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:18:15.908825 16873 tablet_service.cc:1511] Processing CreateTablet for tablet 671210bca23f4566a684a188613c1665 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:18:15.895462 16999 tablet_bootstrap.cc:654] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:15.907593 16874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa7919f3d1c40e096823aab461b0e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.913384 16868 tablet_service.cc:1511] Processing CreateTablet for tablet 595865d470ea4e5489bcc4699f26ff4a (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:18:15.914707 16868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595865d470ea4e5489bcc4699f26ff4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.916802 16871 tablet_service.cc:1511] Processing CreateTablet for tablet 109354c29850459b80f792dad016fc0d (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:18:15.918092 16871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 109354c29850459b80f792dad016fc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.920034 16873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 671210bca23f4566a684a188613c1665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.920782 16869 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcc7a68c24d41ef9c36f0bbfdb0e774 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:18:15.922446 16869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcc7a68c24d41ef9c36f0bbfdb0e774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.923022 16796 tablet_service.cc:1511] Processing CreateTablet for tablet f8b8274145134eaa8f14229eceeca799 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:15.924235 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b8274145134eaa8f14229eceeca799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.924739 16872 tablet_service.cc:1511] Processing CreateTablet for tablet 4c50b9c8ead54558a785ce80fcc5fb62 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:18:15.925968 16872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c50b9c8ead54558a785ce80fcc5fb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.928331 16867 tablet_service.cc:1511] Processing CreateTablet for tablet 17115e8a13c346f1998df3bc8f52ec52 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:18:15.928774 16870 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:18:15.930024 16867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17115e8a13c346f1998df3bc8f52ec52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.930316 16792 tablet_service.cc:1511] Processing CreateTablet for tablet d757b655f89a468ab8fc0ad2914716b7 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:15.931480 16792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d757b655f89a468ab8fc0ad2914716b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.932085 16870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.931718 16866 tablet_service.cc:1511] Processing CreateTablet for tablet 89c4a22bddc9425886aa0574ae085451 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:18:15.936508 16866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c4a22bddc9425886aa0574ae085451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.941939 16791 tablet_service.cc:1511] Processing CreateTablet for tablet d157a8f033dd43d5a5c824d9e6235fe9 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:15.943140 16791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d157a8f033dd43d5a5c824d9e6235fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.952086 16799 tablet_service.cc:1511] Processing CreateTablet for tablet 57dfb70986d346cdb015b37c0f58dce3 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:15.953307 16799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dfb70986d346cdb015b37c0f58dce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.970028 16945 tablet_service.cc:1511] Processing CreateTablet for tablet f8b8274145134eaa8f14229eceeca799 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:15.977671 16944 tablet_service.cc:1511] Processing CreateTablet for tablet d157a8f033dd43d5a5c824d9e6235fe9 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:18:15.959533 16946 tablet_service.cc:1511] Processing CreateTablet for tablet 6455509d1ac14e1d961f38607a869924 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:15.979620 16945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b8274145134eaa8f14229eceeca799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:15.980208 16795 tablet_service.cc:1511] Processing CreateTablet for tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:15.994967 16798 tablet_service.cc:1511] Processing CreateTablet for tablet 2e62b3fa7cbf498099f802cfe999bd65 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:16.005534 16999 tablet_bootstrap.cc:492] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:16.006211 16999 ts_tablet_manager.cc:1403] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.167s	user 0.002s	sys 0.016s
I20260709 13:18:16.008349 16946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6455509d1ac14e1d961f38607a869924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.013271 16873 tablet_service.cc:1511] Processing CreateTablet for tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:16.013427 16874 tablet_service.cc:1511] Processing CreateTablet for tablet d757b655f89a468ab8fc0ad2914716b7 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:16.014565 16873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.016934 16948 tablet_service.cc:1511] Processing CreateTablet for tablet d757b655f89a468ab8fc0ad2914716b7 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:18:16.018606 16948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d757b655f89a468ab8fc0ad2914716b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.021042 16943 tablet_service.cc:1511] Processing CreateTablet for tablet 57dfb70986d346cdb015b37c0f58dce3 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:16.029458 16940 tablet_service.cc:1511] Processing CreateTablet for tablet 2e62b3fa7cbf498099f802cfe999bd65 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:16.024456 16944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d157a8f033dd43d5a5c824d9e6235fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.019200 16867 tablet_service.cc:1511] Processing CreateTablet for tablet 6455509d1ac14e1d961f38607a869924 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:18:16.026713 16941 tablet_service.cc:1511] Processing CreateTablet for tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:18:16.039404 17001 tablet_bootstrap.cc:492] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:16.042989 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e62b3fa7cbf498099f802cfe999bd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.047852 16795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.066371 16875 tablet_service.cc:1511] Processing CreateTablet for tablet f8b8274145134eaa8f14229eceeca799 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:18:16.066844 16999 raft_consensus.cc:359] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.067620 16999 raft_consensus.cc:385] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.067946 16999 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.071331 16943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dfb70986d346cdb015b37c0f58dce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.069607 16874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d757b655f89a468ab8fc0ad2914716b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.078794 16941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.083990 16940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e62b3fa7cbf498099f802cfe999bd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.087011 17001 tablet_bootstrap.cc:654] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.088363 16873 tablet_service.cc:1511] Processing CreateTablet for tablet 57dfb70986d346cdb015b37c0f58dce3 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:18:16.075434 16868 tablet_service.cc:1511] Processing CreateTablet for tablet d157a8f033dd43d5a5c824d9e6235fe9 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
W20260709 13:18:16.093202 16756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:16.094128 16873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dfb70986d346cdb015b37c0f58dce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.095036 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b8274145134eaa8f14229eceeca799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.097620 16949 tablet_service.cc:1511] Processing CreateTablet for tablet e60cb274e4a7404ebaf6480f093cdf56 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:16.098798 16949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60cb274e4a7404ebaf6480f093cdf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.098650 16947 tablet_service.cc:1511] Processing CreateTablet for tablet be49fe28fec04ec88f4f84bc7aa2149f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:16.100030 16947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be49fe28fec04ec88f4f84bc7aa2149f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.101413 16800 tablet_service.cc:1511] Processing CreateTablet for tablet be49fe28fec04ec88f4f84bc7aa2149f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:16.102588 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be49fe28fec04ec88f4f84bc7aa2149f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.103962 16867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6455509d1ac14e1d961f38607a869924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.108320 17002 tablet_bootstrap.cc:492] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:16.111972 16868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d157a8f033dd43d5a5c824d9e6235fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.112489 16869 tablet_service.cc:1511] Processing CreateTablet for tablet 2e62b3fa7cbf498099f802cfe999bd65 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:18:16.120388 16869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e62b3fa7cbf498099f802cfe999bd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.117982 16870 tablet_service.cc:1511] Processing CreateTablet for tablet be49fe28fec04ec88f4f84bc7aa2149f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:18:16.132531 16870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be49fe28fec04ec88f4f84bc7aa2149f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.116693 16797 tablet_service.cc:1511] Processing CreateTablet for tablet e60cb274e4a7404ebaf6480f093cdf56 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:16.133500 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60cb274e4a7404ebaf6480f093cdf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.118716 16999 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.137089 16872 tablet_service.cc:1511] Processing CreateTablet for tablet e60cb274e4a7404ebaf6480f093cdf56 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:18:16.138278 16872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e60cb274e4a7404ebaf6480f093cdf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.151708 16999 ts_tablet_manager.cc:1434] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.145s	user 0.007s	sys 0.005s
I20260709 13:18:16.152211 17001 tablet_bootstrap.cc:492] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:16.152679 17001 ts_tablet_manager.cc:1403] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.004s
I20260709 13:18:16.152827 16835 heartbeater.cc:499] Master 127.15.90.62:35161 was elected leader, sending a full tablet report...
I20260709 13:18:16.156726 16999 tablet_bootstrap.cc:492] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:16.161516 16796 tablet_service.cc:1511] Processing CreateTablet for tablet aa815b919c824fb196befa2fd6eeac35 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:16.162878 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa815b919c824fb196befa2fd6eeac35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.155489 17001 raft_consensus.cc:359] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.173362 16999 tablet_bootstrap.cc:654] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.173678 17001 raft_consensus.cc:385] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.174005 17001 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.174809 17001 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.177229 16875 tablet_service.cc:1511] Processing CreateTablet for tablet aa815b919c824fb196befa2fd6eeac35 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:16.178475 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa815b919c824fb196befa2fd6eeac35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.182852 17002 tablet_bootstrap.cc:654] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.183493 16946 tablet_service.cc:1511] Processing CreateTablet for tablet aa815b919c824fb196befa2fd6eeac35 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:18:16.190559 16792 tablet_service.cc:1511] Processing CreateTablet for tablet e9f7a2a0447a4956b36d1e9902e62f56 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:16.191740 16792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f7a2a0447a4956b36d1e9902e62f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.191566 16946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa815b919c824fb196befa2fd6eeac35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.196596 16947 tablet_service.cc:1511] Processing CreateTablet for tablet 05d0b0f25f26402cb5f324812a9f12c4 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:16.197405 17001 ts_tablet_manager.cc:1434] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:18:16.197777 16947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05d0b0f25f26402cb5f324812a9f12c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.198205 16984 heartbeater.cc:499] Master 127.15.90.62:35161 was elected leader, sending a full tablet report...
I20260709 13:18:16.198494 17001 tablet_bootstrap.cc:492] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:16.208226 16795 tablet_service.cc:1511] Processing CreateTablet for tablet 406d9b96060f4833ba26879d81f73bdc (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:16.209916 16795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406d9b96060f4833ba26879d81f73bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.182740 16866 tablet_service.cc:1511] Processing CreateTablet for tablet 05d0b0f25f26402cb5f324812a9f12c4 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:16.211215 16866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05d0b0f25f26402cb5f324812a9f12c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.216686 16798 tablet_service.cc:1511] Processing CreateTablet for tablet 05d0b0f25f26402cb5f324812a9f12c4 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:18:16.217970 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05d0b0f25f26402cb5f324812a9f12c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.222038 16870 tablet_service.cc:1511] Processing CreateTablet for tablet e9f7a2a0447a4956b36d1e9902e62f56 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:16.225211 17001 tablet_bootstrap.cc:654] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.240694 16941 tablet_service.cc:1511] Processing CreateTablet for tablet e9f7a2a0447a4956b36d1e9902e62f56 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:18:16.254122 16870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f7a2a0447a4956b36d1e9902e62f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.255034 16999 tablet_bootstrap.cc:492] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:16.255506 16999 ts_tablet_manager.cc:1403] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.032s
I20260709 13:18:16.259164 16999 raft_consensus.cc:359] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.260185 16999 raft_consensus.cc:385] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.260465 16999 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.261252 16999 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.263428 16999 ts_tablet_manager.cc:1434] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:18:16.264348 16999 tablet_bootstrap.cc:492] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:16.252794 16941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f7a2a0447a4956b36d1e9902e62f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.273247 16999 tablet_bootstrap.cc:654] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.278321 17002 tablet_bootstrap.cc:492] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:16.278788 17002 ts_tablet_manager.cc:1403] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.171s	user 0.007s	sys 0.038s
I20260709 13:18:16.279953 16869 tablet_service.cc:1511] Processing CreateTablet for tablet 406d9b96060f4833ba26879d81f73bdc (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:16.281174 16869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406d9b96060f4833ba26879d81f73bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.285264 16798 tablet_service.cc:1511] Processing CreateTablet for tablet a51b55458c5a45c78b6a978ce6a10d31 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:16.286451 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51b55458c5a45c78b6a978ce6a10d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.289287 16873 tablet_service.cc:1511] Processing CreateTablet for tablet a51b55458c5a45c78b6a978ce6a10d31 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:16.290527 16873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51b55458c5a45c78b6a978ce6a10d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.290445 17002 raft_consensus.cc:359] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.291625 17002 raft_consensus.cc:385] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.292235 17002 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.293254 17002 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.301354 16944 tablet_service.cc:1511] Processing CreateTablet for tablet a51b55458c5a45c78b6a978ce6a10d31 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:18:16.302579 16944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51b55458c5a45c78b6a978ce6a10d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.305565 16795 tablet_service.cc:1511] Processing CreateTablet for tablet 043a927eb1a442999f1930b07d059e8f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:16.306777 16795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043a927eb1a442999f1930b07d059e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.307547 16800 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7411023b914822890ea380b2bf8efc (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:16.308748 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7411023b914822890ea380b2bf8efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.312670 16867 tablet_service.cc:1511] Processing CreateTablet for tablet 043a927eb1a442999f1930b07d059e8f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:16.313313 16868 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7411023b914822890ea380b2bf8efc (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:16.313885 16867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043a927eb1a442999f1930b07d059e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.314471 16868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7411023b914822890ea380b2bf8efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.321344 16948 tablet_service.cc:1511] Processing CreateTablet for tablet 3a7411023b914822890ea380b2bf8efc (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:18:16.322592 16948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7411023b914822890ea380b2bf8efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.323338 16940 tablet_service.cc:1511] Processing CreateTablet for tablet deabeb68cc1e4f73b9a6b49f9f29da22 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:16.328671 16796 tablet_service.cc:1511] Processing CreateTablet for tablet deabeb68cc1e4f73b9a6b49f9f29da22 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:16.329836 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deabeb68cc1e4f73b9a6b49f9f29da22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.330675 16940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deabeb68cc1e4f73b9a6b49f9f29da22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.348996 16947 tablet_service.cc:1511] Processing CreateTablet for tablet 043a927eb1a442999f1930b07d059e8f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:18:16.357000 16943 tablet_service.cc:1511] Processing CreateTablet for tablet 406d9b96060f4833ba26879d81f73bdc (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:18:16.350701 16947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043a927eb1a442999f1930b07d059e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.370434 16875 tablet_service.cc:1511] Processing CreateTablet for tablet deabeb68cc1e4f73b9a6b49f9f29da22 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:18:16.371737 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deabeb68cc1e4f73b9a6b49f9f29da22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.383942 17001 tablet_bootstrap.cc:492] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:16.384466 17001 ts_tablet_manager.cc:1403] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.186s	user 0.011s	sys 0.003s
I20260709 13:18:16.384699 17002 ts_tablet_manager.cc:1434] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.106s	user 0.013s	sys 0.010s
I20260709 13:18:16.385399 16910 heartbeater.cc:499] Master 127.15.90.62:35161 was elected leader, sending a full tablet report...
I20260709 13:18:16.385682 16999 tablet_bootstrap.cc:492] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:16.386157 16999 ts_tablet_manager.cc:1403] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.122s	user 0.019s	sys 0.028s
I20260709 13:18:16.387241 17001 raft_consensus.cc:359] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.388142 17001 raft_consensus.cc:385] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.388521 17001 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.389037 16999 raft_consensus.cc:359] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.389729 16999 raft_consensus.cc:385] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.389292 17001 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.390019 16999 raft_consensus.cc:740] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.390884 17005 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.391304 17005 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.393123 17002 tablet_bootstrap.cc:492] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:16.393762 17005 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:16.405290 17002 tablet_bootstrap.cc:654] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.414146 16999 consensus_queue.cc:260] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.417904 16999 ts_tablet_manager.cc:1434] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 13:18:16.420981 16941 tablet_service.cc:1511] Processing CreateTablet for tablet efa1a19816094c78802287ff39e74b62 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:16.423017 16943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406d9b96060f4833ba26879d81f73bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.422744 16795 tablet_service.cc:1511] Processing CreateTablet for tablet 72998e8e2cff40f3be2ce73539159ecf (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:16.424151 16795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72998e8e2cff40f3be2ce73539159ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.423800 16869 tablet_service.cc:1511] Processing CreateTablet for tablet 949d7afc13ea44af96dab1af3a1dd354 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:16.421006 16792 tablet_service.cc:1511] Processing CreateTablet for tablet 949d7afc13ea44af96dab1af3a1dd354 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:16.426389 16792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949d7afc13ea44af96dab1af3a1dd354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.427249 16872 tablet_service.cc:1511] Processing CreateTablet for tablet efa1a19816094c78802287ff39e74b62 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:16.428180 17001 ts_tablet_manager.cc:1434] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:18:16.429411 17001 tablet_bootstrap.cc:492] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:16.426363 16869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949d7afc13ea44af96dab1af3a1dd354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.435950 16941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa1a19816094c78802287ff39e74b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.436674 16800 tablet_service.cc:1511] Processing CreateTablet for tablet efdef9f5ee0b4225ba140b5208412fde (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:16.437880 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdef9f5ee0b4225ba140b5208412fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.439950 16872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa1a19816094c78802287ff39e74b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.440651 16870 tablet_service.cc:1511] Processing CreateTablet for tablet efdef9f5ee0b4225ba140b5208412fde (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:16.441849 16870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdef9f5ee0b4225ba140b5208412fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.444458 16796 tablet_service.cc:1511] Processing CreateTablet for tablet efa1a19816094c78802287ff39e74b62 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:18:16.445693 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa1a19816094c78802287ff39e74b62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.457769 16948 tablet_service.cc:1511] Processing CreateTablet for tablet efdef9f5ee0b4225ba140b5208412fde (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:18:16.458155 16866 tablet_service.cc:1511] Processing CreateTablet for tablet 72998e8e2cff40f3be2ce73539159ecf (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:16.459033 16948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdef9f5ee0b4225ba140b5208412fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.459328 16866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72998e8e2cff40f3be2ce73539159ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.455529 16999 tablet_bootstrap.cc:492] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:16.463572 16940 tablet_service.cc:1511] Processing CreateTablet for tablet 949d7afc13ea44af96dab1af3a1dd354 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:18:16.468526 16940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949d7afc13ea44af96dab1af3a1dd354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.471980 17004 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.472450 17004 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.474836 17004 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:16.481065 17005 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.481528 17005 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.483508 17005 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:16.498374 16946 tablet_service.cc:1511] Processing CreateTablet for tablet 98d04db01c024df0a2b3bb75c0fcd76f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:16.500536 16944 tablet_service.cc:1511] Processing CreateTablet for tablet 72998e8e2cff40f3be2ce73539159ecf (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:18:16.500681 16949 tablet_service.cc:1511] Processing CreateTablet for tablet cd1d35ba148544669e52d7293ac9bd82 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:16.501726 17002 tablet_bootstrap.cc:492] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:16.502197 17002 ts_tablet_manager.cc:1403] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.028s
I20260709 13:18:16.502298 16945 tablet_service.cc:1511] Processing CreateTablet for tablet 32f35f41a8f1466fb1831fe03e474c4d (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:16.504889 16946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d04db01c024df0a2b3bb75c0fcd76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.506042 16944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72998e8e2cff40f3be2ce73539159ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.510941 16945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f35f41a8f1466fb1831fe03e474c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.516367 17001 tablet_bootstrap.cc:654] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.523451 16940 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea18b0f585149f0a5558b066b194a9d (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:16.526060 17002 raft_consensus.cc:359] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.526788 17002 raft_consensus.cc:385] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.527081 17002 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.528074 16949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1d35ba148544669e52d7293ac9bd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.528728 16942 tablet_service.cc:1511] Processing CreateTablet for tablet 7c407adc8efe4ee9859c31d64a280e7a (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:16.529923 16942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c407adc8efe4ee9859c31d64a280e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.531625 16940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea18b0f585149f0a5558b066b194a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.537355 16875 tablet_service.cc:1511] Processing CreateTablet for tablet 98d04db01c024df0a2b3bb75c0fcd76f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:16.539561 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d04db01c024df0a2b3bb75c0fcd76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.549038 16869 tablet_service.cc:1511] Processing CreateTablet for tablet cd1d35ba148544669e52d7293ac9bd82 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:16.550305 16869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1d35ba148544669e52d7293ac9bd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.568440 16867 tablet_service.cc:1511] Processing CreateTablet for tablet 32f35f41a8f1466fb1831fe03e474c4d (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:16.569372 16874 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9fb47e66dc4499902e4f88e8774c9c (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:16.570051 16868 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea18b0f585149f0a5558b066b194a9d (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:16.571604 16873 tablet_service.cc:1511] Processing CreateTablet for tablet 7c407adc8efe4ee9859c31d64a280e7a (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:16.573722 16871 tablet_service.cc:1511] Processing CreateTablet for tablet e37840a1d83b4fe5be57618ff85b8a47 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:16.570863 17002 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.582494 17002 ts_tablet_manager.cc:1434] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:18:16.585125 16947 tablet_service.cc:1511] Processing CreateTablet for tablet e37840a1d83b4fe5be57618ff85b8a47 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:16.586701 16947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37840a1d83b4fe5be57618ff85b8a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.585377 16941 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9fb47e66dc4499902e4f88e8774c9c (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:16.597740 16941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9fb47e66dc4499902e4f88e8774c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.613056 16999 tablet_bootstrap.cc:654] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.615286 17002 tablet_bootstrap.cc:492] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:16.625911 17010 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.626425 17010 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.627251 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:16.627942 16810 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:16.628326 16870 tablet_service.cc:1511] Processing CreateTablet for tablet 06e6de173e42433e8df1572e54437e03 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:16.629030 17010 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:16.629101 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:16.629309 16924 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:16.630167 17005 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.630525 17005 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.630858 17005 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.646675 16869 tablet_service.cc:1511] Processing CreateTablet for tablet 168ed6dff4844944aff3337d23ee2950 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:16.649705 16875 tablet_service.cc:1511] Processing CreateTablet for tablet 78ca000fd50c4b38bfdd60badc024845 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:16.625190 16867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f35f41a8f1466fb1831fe03e474c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.661573 17001 tablet_bootstrap.cc:492] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:16.662051 17001 ts_tablet_manager.cc:1403] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.233s	user 0.013s	sys 0.009s
I20260709 13:18:16.650636 16948 tablet_service.cc:1511] Processing CreateTablet for tablet 06e6de173e42433e8df1572e54437e03 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:16.665616 17005 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.666494 16948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e6de173e42433e8df1572e54437e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.667657 17005 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:16.678696 17001 raft_consensus.cc:359] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.680807 17001 raft_consensus.cc:385] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.681118 17001 raft_consensus.cc:740] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.681821 17001 consensus_queue.cc:260] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.682456 16945 tablet_service.cc:1511] Processing CreateTablet for tablet 168ed6dff4844944aff3337d23ee2950 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:16.687233 16943 tablet_service.cc:1511] Processing CreateTablet for tablet c1b0416e641248ecbd3052388f5edf59 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:16.690973 16942 tablet_service.cc:1511] Processing CreateTablet for tablet 78ca000fd50c4b38bfdd60badc024845 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:16.696034 16869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168ed6dff4844944aff3337d23ee2950. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:16.676034 16924 leader_election.cc:343] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.683975 16945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168ed6dff4844944aff3337d23ee2950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.700275 16872 tablet_service.cc:1511] Processing CreateTablet for tablet c1b0416e641248ecbd3052388f5edf59 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:16.700686 17010 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.701166 17010 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.703037 17010 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:16.705025 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ca000fd50c4b38bfdd60badc024845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.705082 16946 tablet_service.cc:1511] Processing CreateTablet for tablet caf243a747f348a29b25b4642b64788e (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:16.706372 16946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf243a747f348a29b25b4642b64788e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.707957 16873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c407adc8efe4ee9859c31d64a280e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.709128 16870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e6de173e42433e8df1572e54437e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.709687 16874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9fb47e66dc4499902e4f88e8774c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.699536 17005 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.710819 16871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37840a1d83b4fe5be57618ff85b8a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.711098 17005 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.713057 17005 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:16.713842 16866 tablet_service.cc:1511] Processing CreateTablet for tablet caf243a747f348a29b25b4642b64788e (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:16.714589 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:16.715142 16809 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.716986 16942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ca000fd50c4b38bfdd60badc024845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.718241 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:16.718887 16810 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:16.721267 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:16.723229 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:16.715252 16940 tablet_service.cc:1511] Processing CreateTablet for tablet 5e604fa8c1b148ea9842f341b4a2c000 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:16.724956 16940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e604fa8c1b148ea9842f341b4a2c000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.725019 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:16.726871 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:16.727840 16868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea18b0f585149f0a5558b066b194a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.731864 17001 ts_tablet_manager.cc:1434] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 13:18:16.732870 17001 tablet_bootstrap.cc:492] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:16.738145 16999 tablet_bootstrap.cc:492] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:16.738595 16999 ts_tablet_manager.cc:1403] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.320s	user 0.020s	sys 0.020s
I20260709 13:18:16.740065 16943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b0416e641248ecbd3052388f5edf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.749353 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:18:16.750478 16924 leader_election.cc:343] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:16.751405 16924 leader_election.cc:343] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.743498 16809 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:16.751915 17005 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:16.753481 17005 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.756940 16872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b0416e641248ecbd3052388f5edf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.764464 17005 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.696208 16944 tablet_service.cc:1511] Processing CreateTablet for tablet 3291b51968ff4989a89ff1c802955900 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:16.781616 16800 tablet_service.cc:1511] Processing CreateTablet for tablet cd1d35ba148544669e52d7293ac9bd82 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:18:16.781908 16795 tablet_service.cc:1511] Processing CreateTablet for tablet 32f35f41a8f1466fb1831fe03e474c4d (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:18:16.782944 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1d35ba148544669e52d7293ac9bd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.783541 16795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f35f41a8f1466fb1831fe03e474c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.783946 16866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf243a747f348a29b25b4642b64788e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.788559 16796 tablet_service.cc:1511] Processing CreateTablet for tablet 98d04db01c024df0a2b3bb75c0fcd76f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:18:16.790237 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d04db01c024df0a2b3bb75c0fcd76f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.812846 16875 tablet_service.cc:1511] Processing CreateTablet for tablet 5e604fa8c1b148ea9842f341b4a2c000 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:16.815243 16944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3291b51968ff4989a89ff1c802955900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.753767 16924 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:16.817426 16941 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc0e6e74a524cd59d8c8341367e62b3 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:16.735656 16949 tablet_service.cc:1511] Processing CreateTablet for tablet dbad0fc0e5714f879e763bb34b5f172f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:16.826611 16946 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd370afa4144ee3b93ac6dc4ae63e07 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:16.827899 16873 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd370afa4144ee3b93ac6dc4ae63e07 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:16.819585 17001 tablet_bootstrap.cc:654] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.834928 16867 tablet_service.cc:1511] Processing CreateTablet for tablet dbad0fc0e5714f879e763bb34b5f172f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:16.835844 16792 tablet_service.cc:1511] Processing CreateTablet for tablet 7c407adc8efe4ee9859c31d64a280e7a (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:18:16.836284 16867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbad0fc0e5714f879e763bb34b5f172f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.836131 16798 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9fb47e66dc4499902e4f88e8774c9c (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:18:16.837051 16792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c407adc8efe4ee9859c31d64a280e7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.837657 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9fb47e66dc4499902e4f88e8774c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.843851 16946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd370afa4144ee3b93ac6dc4ae63e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.844141 17023 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:16.844446 16870 tablet_service.cc:1511] Processing CreateTablet for tablet 3291b51968ff4989a89ff1c802955900 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:16.844719 16797 tablet_service.cc:1511] Processing CreateTablet for tablet e37840a1d83b4fe5be57618ff85b8a47 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:18:16.845700 16870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3291b51968ff4989a89ff1c802955900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.845790 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37840a1d83b4fe5be57618ff85b8a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.847220 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e604fa8c1b148ea9842f341b4a2c000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.849022 16791 tablet_service.cc:1511] Processing CreateTablet for tablet 06e6de173e42433e8df1572e54437e03 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:18:16.850028 16941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc0e6e74a524cd59d8c8341367e62b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.850165 16791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e6de173e42433e8df1572e54437e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.851056 16948 tablet_service.cc:1511] Processing CreateTablet for tablet c61e860f8a8d481aa272d36c7e4a93e0 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:16.852272 16948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61e860f8a8d481aa272d36c7e4a93e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.852891 16873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd370afa4144ee3b93ac6dc4ae63e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.827602 17005 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.856467 16800 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea18b0f585149f0a5558b066b194a9d (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:18:16.856873 16799 tablet_service.cc:1511] Processing CreateTablet for tablet c1b0416e641248ecbd3052388f5edf59 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:18:16.857178 16794 tablet_service.cc:1511] Processing CreateTablet for tablet 168ed6dff4844944aff3337d23ee2950 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:18:16.857563 17005 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:18:16.858070 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 106687us
I20260709 13:18:16.859874 16793 tablet_service.cc:1511] Processing CreateTablet for tablet 78ca000fd50c4b38bfdd60badc024845 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:18:16.862766 16949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbad0fc0e5714f879e763bb34b5f172f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.857663 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea18b0f585149f0a5558b066b194a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.869206 16794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 168ed6dff4844944aff3337d23ee2950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.878082 16793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ca000fd50c4b38bfdd60badc024845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.880775 16799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b0416e641248ecbd3052388f5edf59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.863735 16999 raft_consensus.cc:359] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.900584 16947 tablet_service.cc:1511] Processing CreateTablet for tablet 2db7a71cf1004eaab193504169d474c4 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:16.901932 16947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db7a71cf1004eaab193504169d474c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.902211 17002 tablet_bootstrap.cc:654] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:16.914867 16795 tablet_service.cc:1511] Processing CreateTablet for tablet caf243a747f348a29b25b4642b64788e (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:18:16.886550 16999 raft_consensus.cc:385] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:16.920749 16999 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:16.924683 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:16.925134 16866 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc0e6e74a524cd59d8c8341367e62b3 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:16.926115 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:18:16.926138 16850 leader_election.cc:343] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:16.881335 16924 leader_election.cc:343] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:16.927390 16850 leader_election.cc:343] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:16.927433 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 48064.7us
W20260709 13:18:16.931850 16924 leader_election.cc:343] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.933535 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:16.934103 16809 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:16.936020 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:16.942268 16809 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:16.933890 16924 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:16.943619 17005 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.944092 17005 raft_consensus.cc:697] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:16.944900 17005 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.948002 16866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc0e6e74a524cd59d8c8341367e62b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:16.948598 16924 leader_election.cc:343] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:16.949265 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:16.950858 16871 tablet_service.cc:1511] Processing CreateTablet for tablet 2db7a71cf1004eaab193504169d474c4 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:16.958920 16795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf243a747f348a29b25b4642b64788e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.958880 16945 tablet_service.cc:1511] Processing CreateTablet for tablet 1555b08c459f47689fc0d1a7cf582a1b (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:16.959502 17004 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.960335 16945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1555b08c459f47689fc0d1a7cf582a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.960014 17004 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.961952 17004 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:16.962575 16871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db7a71cf1004eaab193504169d474c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.963349 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:16.965794 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:16.966450 17023 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:16.966379 16885 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:16.972703 16867 tablet_service.cc:1511] Processing CreateTablet for tablet 1555b08c459f47689fc0d1a7cf582a1b (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:16.974040 16867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1555b08c459f47689fc0d1a7cf582a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.976152 16869 tablet_service.cc:1511] Processing CreateTablet for tablet c61e860f8a8d481aa272d36c7e4a93e0 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:16.977319 16869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61e860f8a8d481aa272d36c7e4a93e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:16.971149 16868 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:16.922183 16999 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:16.981853 16999 ts_tablet_manager.cc:1434] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.243s	user 0.010s	sys 0.000s
I20260709 13:18:16.982172 16868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.005113 16792 tablet_service.cc:1511] Processing CreateTablet for tablet 3291b51968ff4989a89ff1c802955900 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:18:17.006381 16792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3291b51968ff4989a89ff1c802955900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.005911 16799 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:17.007494 16999 tablet_bootstrap.cc:492] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:17.007537 16799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.000232 17023 raft_consensus.cc:697] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:17.024533 17001 tablet_bootstrap.cc:492] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:17.025126 17001 ts_tablet_manager.cc:1403] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.292s	user 0.006s	sys 0.020s
W20260709 13:18:17.025192 16775 leader_election.cc:343] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.025947 16775 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:17.026732 17004 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:17.027067 17004 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.027375 17004 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.028117 17001 raft_consensus.cc:359] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.028224 16875 tablet_service.cc:1511] Processing CreateTablet for tablet 778275eedaec440eb9d6de3b4984d656 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:17.029476 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778275eedaec440eb9d6de3b4984d656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.032612 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:17.031987 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:17.035429 16944 tablet_service.cc:1511] Processing CreateTablet for tablet 778275eedaec440eb9d6de3b4984d656 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:17.036518 16944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778275eedaec440eb9d6de3b4984d656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.038161 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:17.038117 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:17.039392 16850 leader_election.cc:343] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.039268 16794 tablet_service.cc:1511] Processing CreateTablet for tablet 5e604fa8c1b148ea9842f341b4a2c000 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:18:17.039877 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:17.040366 16796 tablet_service.cc:1511] Processing CreateTablet for tablet 2db7a71cf1004eaab193504169d474c4 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:18:17.041620 17010 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:17.046417 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db7a71cf1004eaab193504169d474c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.048025 16872 tablet_service.cc:1511] Processing CreateTablet for tablet 2bff4b982e59440089e2d3d5b8ada66f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:17.049219 16872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bff4b982e59440089e2d3d5b8ada66f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:18:17.050323 16775 leader_election.cc:343] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.050781 16942 tablet_service.cc:1511] Processing CreateTablet for tablet 2bff4b982e59440089e2d3d5b8ada66f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:17.051287 16775 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:17.044023 17001 raft_consensus.cc:385] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.063799 17001 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.064883 16942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bff4b982e59440089e2d3d5b8ada66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.064662 17001 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.066329 17001 ts_tablet_manager.cc:1434] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.006s
I20260709 13:18:17.056743 16940 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb5156c6c9245bfaeffc22854718789 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:17.042615 16791 tablet_service.cc:1511] Processing CreateTablet for tablet dbad0fc0e5714f879e763bb34b5f172f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:18:17.067695 16940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb5156c6c9245bfaeffc22854718789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.067741 16875 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb5156c6c9245bfaeffc22854718789 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:17.068869 16875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb5156c6c9245bfaeffc22854718789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.073005 16797 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc0e6e74a524cd59d8c8341367e62b3 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:18:17.074011 16946 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:18:17.075265 16946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.077015 17023 consensus_queue.cc:237] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.060168 17004 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.083895 16949 tablet_service.cc:1511] Processing CreateTablet for tablet 8abf86e7719a4c7bae84b69e92b761bb (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:17.085438 16948 tablet_service.cc:1511] Processing CreateTablet for tablet f4f36dd72a75406881b100b0ebbaeaff (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:17.089232 16810 raft_consensus.cc:2393] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:17.090138 17004 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.090700 17004 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.092072 16866 tablet_service.cc:1511] Processing CreateTablet for tablet f4f36dd72a75406881b100b0ebbaeaff (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:17.093286 16866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f36dd72a75406881b100b0ebbaeaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.091099 17004 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:17.095366 16756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:17.095969 16948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f36dd72a75406881b100b0ebbaeaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.097635 16949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8abf86e7719a4c7bae84b69e92b761bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.086035 16870 tablet_service.cc:1511] Processing CreateTablet for tablet 8abf86e7719a4c7bae84b69e92b761bb (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:17.097638 17002 tablet_bootstrap.cc:492] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:17.101034 17002 ts_tablet_manager.cc:1403] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.486s	user 0.023s	sys 0.019s
I20260709 13:18:17.101672 16943 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe476f65c0445399ab9cd51828acf2f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:17.102885 16943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe476f65c0445399ab9cd51828acf2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.108110 17002 raft_consensus.cc:359] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.108984 17002 raft_consensus.cc:385] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.109305 17002 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.111735 16794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e604fa8c1b148ea9842f341b4a2c000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.113037 16874 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0d07e74a6f4d4b9accba26620d27f9 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:17.113224 16947 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0d07e74a6f4d4b9accba26620d27f9 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:17.114358 16874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0d07e74a6f4d4b9accba26620d27f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.114387 16947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0d07e74a6f4d4b9accba26620d27f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.108712 16867 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe476f65c0445399ab9cd51828acf2f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:17.115936 16791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbad0fc0e5714f879e763bb34b5f172f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.110543 17002 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.135315 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc0e6e74a524cd59d8c8341367e62b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.136897 17002 ts_tablet_manager.cc:1434] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:18:17.119800 17001 tablet_bootstrap.cc:492] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:17.137972 16794 tablet_service.cc:1511] Processing CreateTablet for tablet 1555b08c459f47689fc0d1a7cf582a1b (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:18:17.139199 16794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1555b08c459f47689fc0d1a7cf582a1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.120412 17030 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:17.149166 17001 tablet_bootstrap.cc:654] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.116983 16793 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd370afa4144ee3b93ac6dc4ae63e07 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:18:17.128460 17004 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.150367 16793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd370afa4144ee3b93ac6dc4ae63e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.120711 16798 tablet_service.cc:1511] Processing CreateTablet for tablet c61e860f8a8d481aa272d36c7e4a93e0 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:18:17.178015 16870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8abf86e7719a4c7bae84b69e92b761bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.190941 16794 tablet_service.cc:1511] Processing CreateTablet for tablet 778275eedaec440eb9d6de3b4984d656 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:18:17.191793 17002 tablet_bootstrap.cc:492] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:17.179631 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61e860f8a8d481aa272d36c7e4a93e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.198668 16794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778275eedaec440eb9d6de3b4984d656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.201066 16999 tablet_bootstrap.cc:654] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.196821 16867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe476f65c0445399ab9cd51828acf2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.212656 16800 tablet_service.cc:1511] Processing CreateTablet for tablet 2bff4b982e59440089e2d3d5b8ada66f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:18:17.221575 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bff4b982e59440089e2d3d5b8ada66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.234768 17002 tablet_bootstrap.cc:654] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.239111 17001 tablet_bootstrap.cc:492] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
W20260709 13:18:17.243093 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 191860us
I20260709 13:18:17.251585 16999 tablet_bootstrap.cc:492] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:17.253288 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:17.253556 16999 ts_tablet_manager.cc:1403] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.252s	user 0.026s	sys 0.020s
I20260709 13:18:17.253888 16885 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.256476 16999 raft_consensus.cc:359] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.257833 17001 ts_tablet_manager.cc:1403] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.191s	user 0.009s	sys 0.020s
I20260709 13:18:17.257668 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:17.258344 16850 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:17.259047 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:17.261240 16796 tablet_service.cc:1511] Processing CreateTablet for tablet 6fb5156c6c9245bfaeffc22854718789 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:18:17.262080 16799 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe476f65c0445399ab9cd51828acf2f (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:18:17.262658 16792 tablet_service.cc:1511] Processing CreateTablet for tablet 8abf86e7719a4c7bae84b69e92b761bb (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:18:17.263527 16791 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0d07e74a6f4d4b9accba26620d27f9 (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:18:17.267059 16999 raft_consensus.cc:385] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.271095 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:17.271371 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb5156c6c9245bfaeffc22854718789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.274061 17001 raft_consensus.cc:359] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.274767 17001 raft_consensus.cc:385] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.275039 17001 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.281594 16705 catalog_manager.cc:5697] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.291137 16705 catalog_manager.cc:5697] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.293193 16799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe476f65c0445399ab9cd51828acf2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.281026 16999 raft_consensus.cc:740] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.296660 16999 consensus_queue.cc:260] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:17.277647 16775 leader_election.cc:343] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:17.301270 16775 leader_election.cc:343] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:17.302110 16775 leader_election.cc:343] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.302608 16775 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:17.303696 17031 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:17.281025 16885 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:17.306669 17010 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:17.308562 16794 tablet_service.cc:1511] Processing CreateTablet for tablet f4f36dd72a75406881b100b0ebbaeaff (DEFAULT_TABLE table=test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:18:17.310281 17010 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.310909 17010 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.314098 17010 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.299563 16999 ts_tablet_manager.cc:1434] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.000s
I20260709 13:18:17.315399 16999 tablet_bootstrap.cc:492] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:17.315176 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:17.315919 17001 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.318115 17001 ts_tablet_manager.cc:1434] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:18:17.319104 17001 tablet_bootstrap.cc:492] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:17.310307 16794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4f36dd72a75406881b100b0ebbaeaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.322873 16792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8abf86e7719a4c7bae84b69e92b761bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.327960 16791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0d07e74a6f4d4b9accba26620d27f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:17.329602 16999 tablet_bootstrap.cc:654] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.333801 17002 tablet_bootstrap.cc:492] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:17.335292 17002 ts_tablet_manager.cc:1403] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.157s	user 0.026s	sys 0.021s
I20260709 13:18:17.336515 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:17.337293 16810 raft_consensus.cc:2393] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:18:17.336544 16775 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:17.339238 17031 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:17.340010 16850 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:17.341389 17036 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.343771 17031 raft_consensus.cc:697] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:17.350308 17031 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.357431 17002 raft_consensus.cc:359] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.358201 17002 raft_consensus.cc:385] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.358465 17002 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.359241 17002 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.359918 17001 tablet_bootstrap.cc:654] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.361157 17036 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:17.361606 17002 ts_tablet_manager.cc:1434] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:18:17.362569 17002 tablet_bootstrap.cc:492] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:17.363950 16708 catalog_manager.cc:5697] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.368754 17002 tablet_bootstrap.cc:654] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.372884 16999 tablet_bootstrap.cc:492] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:17.373543 16999 ts_tablet_manager.cc:1403] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.004s
I20260709 13:18:17.378192 17001 tablet_bootstrap.cc:492] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:17.378660 17001 ts_tablet_manager.cc:1403] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.060s	user 0.002s	sys 0.014s
I20260709 13:18:17.377285 16999 raft_consensus.cc:359] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.382082 17001 raft_consensus.cc:359] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.382812 17001 raft_consensus.cc:385] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.383107 17001 raft_consensus.cc:740] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.379828 16999 raft_consensus.cc:385] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.384243 16999 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.384946 16999 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.385566 17001 consensus_queue.cc:260] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.387712 16999 ts_tablet_manager.cc:1434] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:18:17.388520 17002 tablet_bootstrap.cc:492] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:17.388605 17001 ts_tablet_manager.cc:1434] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:18:17.388728 16999 tablet_bootstrap.cc:492] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:17.389216 17002 ts_tablet_manager.cc:1403] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.009s
I20260709 13:18:17.389843 17001 tablet_bootstrap.cc:492] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:17.392515 17002 raft_consensus.cc:359] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.393313 17002 raft_consensus.cc:385] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.393656 17002 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.394483 17002 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.395776 16999 tablet_bootstrap.cc:654] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.397086 17001 tablet_bootstrap.cc:654] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.397198 17002 ts_tablet_manager.cc:1434] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:18:17.397614 17023 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.437700 17023 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.441548 17023 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:17.439308 17002 tablet_bootstrap.cc:492] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:17.443022 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:17.443997 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:17.445358 16924 leader_election.cc:343] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.445886 16810 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:17.447175 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:17.448318 17023 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:17.448758 17023 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.449095 17023 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.450507 17002 tablet_bootstrap.cc:654] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.454416 17001 tablet_bootstrap.cc:492] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:17.454890 17001 ts_tablet_manager.cc:1403] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.065s	user 0.004s	sys 0.007s
I20260709 13:18:17.456432 17023 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.457813 17001 raft_consensus.cc:359] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.458534 17001 raft_consensus.cc:385] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.458822 17001 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.459136 16999 tablet_bootstrap.cc:492] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:17.459589 16999 ts_tablet_manager.cc:1403] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.036s
I20260709 13:18:17.459539 17001 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.461930 17001 ts_tablet_manager.cc:1434] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:17.462554 16999 raft_consensus.cc:359] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.463233 16999 raft_consensus.cc:385] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.463587 16999 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.467595 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:17.468369 16810 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.477547 17001 tablet_bootstrap.cc:492] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:17.479979 17005 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:17.464694 16999 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.481213 17023 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:17.482587 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:17.483348 16999 ts_tablet_manager.cc:1434] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:18:17.484072 16810 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
W20260709 13:18:17.484594 16924 leader_election.cc:343] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.485291 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:17.488781 17023 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:17.489404 17023 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:17.490244 17023 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.493613 17001 tablet_bootstrap.cc:654] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.493988 16999 tablet_bootstrap.cc:492] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:17.501866 17005 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.504328 17005 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.507279 17005 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:17.509105 16999 tablet_bootstrap.cc:654] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.509101 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:17.514111 16924 leader_election.cc:343] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.514914 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:17.516271 16924 leader_election.cc:343] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.516623 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:17.517204 17005 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:17.520614 17001 tablet_bootstrap.cc:492] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:17.520741 17005 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:17.521205 17001 ts_tablet_manager.cc:1403] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.044s	user 0.026s	sys 0.000s
I20260709 13:18:17.523031 17002 tablet_bootstrap.cc:492] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:17.525125 17002 ts_tablet_manager.cc:1403] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.024s
I20260709 13:18:17.529199 17002 raft_consensus.cc:359] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.529915 17002 raft_consensus.cc:385] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.530251 17002 raft_consensus.cc:740] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.532096 17001 raft_consensus.cc:359] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.532258 17002 consensus_queue.cc:260] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.533092 17001 raft_consensus.cc:385] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.533504 17001 raft_consensus.cc:740] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.537094 17002 ts_tablet_manager.cc:1434] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:18:17.538108 17001 consensus_queue.cc:260] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.542359 17002 tablet_bootstrap.cc:492] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:17.549391 17002 tablet_bootstrap.cc:654] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.556525 16999 tablet_bootstrap.cc:492] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:17.557122 16999 ts_tablet_manager.cc:1403] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.063s	user 0.024s	sys 0.011s
I20260709 13:18:17.559966 16999 raft_consensus.cc:359] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.561959 16999 raft_consensus.cc:385] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.562249 16999 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.562911 16999 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.565356 16999 ts_tablet_manager.cc:1434] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:18:17.572080 17002 tablet_bootstrap.cc:492] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:17.572721 17002 ts_tablet_manager.cc:1403] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.005s
I20260709 13:18:17.576320 17002 raft_consensus.cc:359] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.577204 17002 raft_consensus.cc:385] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.577518 17002 raft_consensus.cc:740] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.579756 17002 consensus_queue.cc:260] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.585731 16999 tablet_bootstrap.cc:492] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:17.589802 17002 ts_tablet_manager.cc:1434] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:18:17.590864 17002 tablet_bootstrap.cc:492] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:17.601487 17053 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:17.605614 16708 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:17.623106 17005 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.623600 17005 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.625649 17005 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:17.627693 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:17.629272 17031 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.629850 17031 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.632413 17031 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.635452 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:17.637178 17002 tablet_bootstrap.cc:654] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.637526 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:17.638322 16958 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
W20260709 13:18:17.639954 16775 leader_election.cc:343] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.641691 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:17.643139 17004 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:17.643603 17004 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.644057 17004 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.653066 17002 tablet_bootstrap.cc:492] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:17.653725 17002 ts_tablet_manager.cc:1403] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.001s
I20260709 13:18:17.656518 17002 raft_consensus.cc:359] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.657330 17002 raft_consensus.cc:385] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.657270 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:17.657842 17002 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.658483 16884 raft_consensus.cc:2393] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:17.658838 17002 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:17.663096 16924 consensus_peers.cc:597] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:17.668716 16924 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:17.669747 17057 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.681146 17002 ts_tablet_manager.cc:1434] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:18:17.682550 17002 tablet_bootstrap.cc:492] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:17.675019 17004 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.686486 16999 tablet_bootstrap.cc:654] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.693934 17001 ts_tablet_manager.cc:1434] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.172s	user 0.046s	sys 0.068s
I20260709 13:18:17.697772 17001 tablet_bootstrap.cc:492] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:17.700345 16999 tablet_bootstrap.cc:492] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:17.700544 17004 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.700790 16999 ts_tablet_manager.cc:1403] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.000s
I20260709 13:18:17.703357 16999 raft_consensus.cc:359] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.704241 16999 raft_consensus.cc:385] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.704536 16999 raft_consensus.cc:740] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.705216 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:17.705145 16999 consensus_queue.cc:260] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.705799 16958 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.704063 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:17.708781 16999 ts_tablet_manager.cc:1434] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:18:17.712137 16775 leader_election.cc:343] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.711702 17057 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:17.721236 16958 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:17.725006 17001 tablet_bootstrap.cc:654] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.725416 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:17.725947 17002 tablet_bootstrap.cc:654] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.726564 17004 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:17.727039 17004 raft_consensus.cc:697] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:17.728372 17004 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.734987 16999 tablet_bootstrap.cc:492] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:17.735486 17001 tablet_bootstrap.cc:492] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:17.735925 17001 ts_tablet_manager.cc:1403] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.038s	user 0.004s	sys 0.011s
I20260709 13:18:17.736275 17002 tablet_bootstrap.cc:492] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:17.736701 17002 ts_tablet_manager.cc:1403] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.006s
I20260709 13:18:17.738428 17001 raft_consensus.cc:359] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.738637 17002 raft_consensus.cc:359] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.739147 17001 raft_consensus.cc:385] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.739290 17002 raft_consensus.cc:385] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.739490 17001 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.739626 17002 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.740375 17002 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.740245 17001 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.742105 17002 ts_tablet_manager.cc:1434] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:18:17.742566 17001 ts_tablet_manager.cc:1434] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:17.743161 17002 tablet_bootstrap.cc:492] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:17.743425 17001 tablet_bootstrap.cc:492] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:17.749291 17001 tablet_bootstrap.cc:654] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.751124 16999 tablet_bootstrap.cc:654] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.753450 16707 catalog_manager.cc:5697] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.755988 17004 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.756428 17004 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.758445 17004 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.762940 17002 tablet_bootstrap.cc:654] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.766238 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:17.766768 17036 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.767172 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:17.767192 17036 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.767855 16958 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:17.769217 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:17.769392 17036 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.772833 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:17.772984 16885 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:17.773741 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:17.774288 16958 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:17.775588 17004 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:17.775978 17004 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.776291 17004 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.775476 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:17.777633 17036 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:17.777972 17036 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.778276 17036 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.789819 17004 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.791450 16809 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:17.792582 16999 tablet_bootstrap.cc:492] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:17.793023 16999 ts_tablet_manager.cc:1403] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.000s
I20260709 13:18:17.795567 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:17.798004 17036 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.798548 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:17.799118 16885 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:17.799186 16958 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.795517 16999 raft_consensus.cc:359] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.802448 16999 raft_consensus.cc:385] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.802724 16999 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.803264 17001 tablet_bootstrap.cc:492] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:17.803789 17001 ts_tablet_manager.cc:1403] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.046s
I20260709 13:18:17.803390 16999 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.806627 16958 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:17.806447 17001 raft_consensus.cc:359] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.807209 17001 raft_consensus.cc:385] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.807509 17001 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.807919 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:17.808336 17001 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.808701 17031 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:17.809388 17004 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.813267 16999 ts_tablet_manager.cc:1434] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:18:17.815877 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:17.816618 17001 ts_tablet_manager.cc:1434] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:18:17.816673 17010 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.817667 16999 tablet_bootstrap.cc:492] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:17.817242 17010 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.818204 17004 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:17.819365 17010 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.821704 17001 tablet_bootstrap.cc:492] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:17.823385 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:17.825086 16810 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:17.827171 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:17.831606 17010 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:17.831990 17010 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.832321 17010 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.833631 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:17.839289 16959 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:17.837417 17036 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.849090 17010 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.833709 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:17.858625 16958 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:17.859239 17010 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.866444 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:17.868422 16810 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.868556 17001 tablet_bootstrap.cc:654] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.873523 17002 tablet_bootstrap.cc:492] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:17.873834 17064 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.873997 17002 ts_tablet_manager.cc:1403] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.131s	user 0.020s	sys 0.003s
I20260709 13:18:17.874276 17064 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.875486 17031 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:17.876447 17064 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:17.876430 17031 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.877203 17002 raft_consensus.cc:359] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.877496 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:17.877880 17002 raft_consensus.cc:385] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.878204 17002 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.866609 17036 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.878039 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:17.878100 16808 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:17.880299 17036 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.881250 16884 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:17.881364 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:17.881886 16958 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.881659 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:17.882541 17073 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.882774 17064 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:17.883045 17073 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.883314 17064 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.879161 17002 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.886065 17064 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.888530 17073 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.891021 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:17.892874 16775 leader_election.cc:343] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.900187 17002 ts_tablet_manager.cc:1434] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 13:18:17.901446 17002 tablet_bootstrap.cc:492] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:17.904461 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:18:17.907188 16775 leader_election.cc:343] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:17.907778 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:17.909024 16810 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:17.910166 16999 tablet_bootstrap.cc:654] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.910380 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:17.910817 17073 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:17.911267 17010 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:17.912410 17036 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:17.916965 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:17.918577 16810 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:17.918205 17010 raft_consensus.cc:697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:17.920491 17010 consensus_queue.cc:237] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.920953 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:17.922297 16850 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:17.922627 16958 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:17.923229 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:17.924074 17036 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:17.924882 17036 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.928543 17036 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:17.933441 17001 tablet_bootstrap.cc:492] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:17.933873 17001 ts_tablet_manager.cc:1403] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.112s	user 0.027s	sys 0.017s
I20260709 13:18:17.934173 17064 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.935421 16959 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:18:17.938382 17001 raft_consensus.cc:359] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.939240 17001 raft_consensus.cc:385] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:17.939502 17001 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:17.938134 16707 catalog_manager.cc:5697] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:17.939832 17031 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:17.940243 17001 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.944581 17002 tablet_bootstrap.cc:654] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:17.948755 17036 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:17.996942 17057 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:18.004019 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:18.004999 17010 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.005448 16809 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.005491 17010 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.008976 17081 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.009002 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.008622 17036 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.009428 17064 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.012959 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:18.015350 16885 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:18.013602 16999 tablet_bootstrap.cc:492] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:18.009418 17081 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.016548 16999 ts_tablet_manager.cc:1403] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.199s	user 0.029s	sys 0.016s
I20260709 13:18:18.022720 16999 raft_consensus.cc:359] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.023587 16999 raft_consensus.cc:385] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.023919 16999 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.024690 17001 ts_tablet_manager.cc:1434] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.005s
I20260709 13:18:18.026428 17001 tablet_bootstrap.cc:492] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:18.030562 16999 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.033905 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:18.034062 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:18.034746 16958 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:18:18.037195 17077 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.036969 16809 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:18.039324 16999 ts_tablet_manager.cc:1434] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:18:18.039314 17083 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.039799 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:18.040066 17083 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.042121 17001 tablet_bootstrap.cc:654] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.042162 17083 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.042373 17057 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.043565 16999 tablet_bootstrap.cc:492] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:18.042994 17057 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:18.044426 16850 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.044782 17057 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.043864 17081 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.050664 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.053220 16885 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.054260 16708 catalog_manager.cc:5697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.056027 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.051472 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.048781 17010 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.049227 17081 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.073767 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.074373 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.075189 16959 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
W20260709 13:18:18.077750 16850 leader_election.cc:343] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:18.078419 16850 leader_election.cc:343] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.080370 17002 tablet_bootstrap.cc:492] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:18.080950 17002 ts_tablet_manager.cc:1403] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.180s	user 0.030s	sys 0.026s
I20260709 13:18:18.084276 16999 tablet_bootstrap.cc:654] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.082198 17057 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:18.079296 16850 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.091140 17002 raft_consensus.cc:359] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.091873 17002 raft_consensus.cc:385] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.092192 17002 raft_consensus.cc:740] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.092609 17010 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.092841 17002 consensus_queue.cc:260] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.094820 17002 ts_tablet_manager.cc:1434] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:18:18.091643 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.097625 16850 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:18.097862 17001 tablet_bootstrap.cc:492] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:18.098305 17001 ts_tablet_manager.cc:1403] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.016s
I20260709 13:18:18.098337 17010 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.098737 17010 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.099102 17010 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:18.101089 16756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:18.102826 17001 raft_consensus.cc:359] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.103463 17001 raft_consensus.cc:385] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.103756 17001 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.104473 17002 tablet_bootstrap.cc:492] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:18.104363 17057 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:18.105778 16850 leader_election.cc:343] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.105922 17001 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.107721 16999 tablet_bootstrap.cc:492] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:18.108129 16999 ts_tablet_manager.cc:1403] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.065s	user 0.006s	sys 0.005s
I20260709 13:18:18.108206 17001 ts_tablet_manager.cc:1434] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:18:18.109179 17001 tablet_bootstrap.cc:492] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:18.108052 17057 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.113209 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.113791 16810 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:18.114965 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.114934 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:18.115694 16884 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:18.116066 17054 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.116422 17054 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.116730 17057 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.116747 17054 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.118907 17010 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.121740 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:18.122897 16999 raft_consensus.cc:359] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:18.123309 16850 leader_election.cc:343] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.123534 16999 raft_consensus.cc:385] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.123847 16999 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.124424 17054 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.124521 16999 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.126497 16999 ts_tablet_manager.cc:1434] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:18:18.127249 17002 tablet_bootstrap.cc:654] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.126897 16707 catalog_manager.cc:5697] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.128052 17010 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.127326 16999 tablet_bootstrap.cc:492] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:18.130738 17001 tablet_bootstrap.cc:654] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.138473 16999 tablet_bootstrap.cc:654] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.141037 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:18.141626 16810 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.143698 17001 tablet_bootstrap.cc:492] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:18.144140 17001 ts_tablet_manager.cc:1403] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.012s
I20260709 13:18:18.147313 17001 raft_consensus.cc:359] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.148074 17001 raft_consensus.cc:385] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.148352 17001 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.148450 16810 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:18.149037 17001 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.149746 17081 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.151361 17001 ts_tablet_manager.cc:1434] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:18.152204 17001 tablet_bootstrap.cc:492] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:18.152437 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:18.153113 16959 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.156790 17054 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.156960 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:18.159296 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:18.159992 16884 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.160738 17057 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.161273 17057 raft_consensus.cc:697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:18.161980 17057 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.162918 17002 tablet_bootstrap.cc:492] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:18.163385 17002 ts_tablet_manager.cc:1403] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.023s
I20260709 13:18:18.165969 17002 raft_consensus.cc:359] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.166637 17002 raft_consensus.cc:385] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.166953 17002 raft_consensus.cc:740] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.167573 17002 consensus_queue.cc:260] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.167908 17081 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.168509 17081 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.170421 17002 ts_tablet_manager.cc:1434] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:18.170557 17081 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.172295 17002 tablet_bootstrap.cc:492] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:18.173252 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:18.175020 16850 leader_election.cc:343] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.175925 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.176512 16959 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:18.177582 17023 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.179500 17023 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.183665 17002 tablet_bootstrap.cc:654] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.184122 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:18.185338 16924 leader_election.cc:343] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.186249 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.183516 17001 tablet_bootstrap.cc:654] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.187054 16810 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:18.188555 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:18.189568 17064 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.190012 17064 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.190436 17064 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.194757 17002 tablet_bootstrap.cc:492] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:18.195216 17002 ts_tablet_manager.cc:1403] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:18:18.197791 17002 raft_consensus.cc:359] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.197858 17064 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.198493 17002 raft_consensus.cc:385] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.198772 17002 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.201135 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:18.201900 16809 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.183481 17023 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:18:18.177460 16850 leader_election.cc:343] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.205380 16850 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.206075 17001 tablet_bootstrap.cc:492] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:18.206307 17081 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.206772 17031 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.207322 17031 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.207870 16850 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:18.207991 17002 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.209622 17031 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.177814 16884 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:18.210464 17081 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.210956 17081 raft_consensus.cc:697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:18.211364 17064 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.206516 17001 ts_tablet_manager.cc:1403] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.012s
I20260709 13:18:18.211951 17081 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.213994 17010 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.214413 17010 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.216384 17010 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.214735 17002 ts_tablet_manager.cc:1434] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:18:18.216770 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:18.217721 17002 tablet_bootstrap.cc:492] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
W20260709 13:18:18.218007 16924 leader_election.cc:343] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.220976 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.223568 16999 tablet_bootstrap.cc:492] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:18.224061 16999 ts_tablet_manager.cc:1403] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.020s
W20260709 13:18:18.225301 16775 leader_election.cc:343] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.225515 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.226198 17001 raft_consensus.cc:359] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.226883 17001 raft_consensus.cc:385] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.227187 17001 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.227800 17001 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.229364 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.230118 16958 raft_consensus.cc:2393] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:18.231313 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.232017 17002 tablet_bootstrap.cc:654] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.232399 17010 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.233632 16809 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:18.234249 17001 ts_tablet_manager.cc:1434] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:18:18.235091 17001 tablet_bootstrap.cc:492] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:18.228500 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.237411 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:18.239176 16707 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.240845 17031 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.241207 17057 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.246291 17010 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.256871 17057 raft_consensus.cc:697] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:18.249109 16999 raft_consensus.cc:359] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.258229 16999 raft_consensus.cc:385] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.250517 16705 catalog_manager.cc:5697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.258592 16999 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.259423 16999 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.256407 17001 tablet_bootstrap.cc:654] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:18.241607 16775 leader_election.cc:343] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.262251 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.263069 17054 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.266603 17054 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.268678 17054 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.269291 16999 ts_tablet_manager.cc:1434] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:18:18.241300 17031 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.270437 16999 tablet_bootstrap.cc:492] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:18.271097 17031 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.269335 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.270325 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.273264 16884 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:18.274072 17031 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.274514 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:18:18.275357 16924 leader_election.cc:343] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.276178 17054 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.276889 17054 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.277333 17054 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.277884 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.281514 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.282244 16959 raft_consensus.cc:2393] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:18.284217 16999 tablet_bootstrap.cc:654] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.284360 17057 consensus_queue.cc:237] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.289865 17054 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.294701 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:18.295346 17074 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:18.296074 16924 leader_election.cc:343] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.296794 17064 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.297226 17064 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.297442 16775 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.299173 17064 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.300678 17031 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.296630 17074 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:18.302958 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.303313 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:18.305037 16924 leader_election.cc:343] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:18.305716 16924 leader_election.cc:343] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.306533 16924 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:18.308576 17064 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.312701 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:18.313468 16885 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.323772 16885 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:18.325321 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:18.326220 17064 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.326702 17064 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:18.327502 17064 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.332666 17002 tablet_bootstrap.cc:492] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:18.333153 17002 ts_tablet_manager.cc:1403] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.036s
I20260709 13:18:18.335708 17002 raft_consensus.cc:359] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.336362 17002 raft_consensus.cc:385] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.336621 17002 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.338814 17002 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.339035 16707 catalog_manager.cc:5697] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.341012 17002 ts_tablet_manager.cc:1434] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:18.342020 17002 tablet_bootstrap.cc:492] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:18.349246 17054 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.352626 17001 tablet_bootstrap.cc:492] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:18.352377 17010 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:18.353027 17001 ts_tablet_manager.cc:1403] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.118s	user 0.021s	sys 0.029s
I20260709 13:18:18.354522 17031 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.356225 16999 tablet_bootstrap.cc:492] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:18.356710 16999 ts_tablet_manager.cc:1403] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.087s	user 0.022s	sys 0.026s
I20260709 13:18:18.359241 16999 raft_consensus.cc:359] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.359956 16999 raft_consensus.cc:385] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.360209 16999 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.360977 17002 tablet_bootstrap.cc:654] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.360800 16999 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.356410 17001 raft_consensus.cc:359] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.361629 17001 raft_consensus.cc:385] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.361877 17001 raft_consensus.cc:740] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.362599 17001 consensus_queue.cc:260] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.364689 17001 ts_tablet_manager.cc:1434] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:18:18.365731 17001 tablet_bootstrap.cc:492] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:18.367377 16999 ts_tablet_manager.cc:1434] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.001s
I20260709 13:18:18.368255 16999 tablet_bootstrap.cc:492] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:18.368355 17002 tablet_bootstrap.cc:492] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:18.368918 17002 ts_tablet_manager.cc:1403] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:18:18.370057 17031 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.370507 17031 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.371245 17001 tablet_bootstrap.cc:654] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.372466 17031 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.373952 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.373997 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.375231 16884 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
W20260709 13:18:18.376114 16775 leader_election.cc:343] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.376595 16705 catalog_manager.cc:5697] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:18.374387 17002 raft_consensus.cc:359] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.380328 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.380558 17002 raft_consensus.cc:385] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.381070 17002 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.381361 17031 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.381628 16999 tablet_bootstrap.cc:654] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.381767 17031 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.382123 17031 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.382254 17002 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.389144 17031 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.389822 17002 ts_tablet_manager.cc:1434] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:18:18.391084 17002 tablet_bootstrap.cc:492] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:18.391830 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:18.392410 16884 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.397845 17002 tablet_bootstrap.cc:654] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.399086 16884 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:18.402612 17031 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.405236 16999 tablet_bootstrap.cc:492] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:18.405457 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:18.405961 16999 ts_tablet_manager.cc:1403] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.006s
I20260709 13:18:18.409206 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:18.409983 17031 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.410185 17001 tablet_bootstrap.cc:492] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:18.410493 17031 raft_consensus.cc:697] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:18.410818 17001 ts_tablet_manager.cc:1403] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.013s
I20260709 13:18:18.410609 16999 raft_consensus.cc:359] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.411455 16999 raft_consensus.cc:385] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.411316 17031 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.411839 16999 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.412614 16999 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.413293 17001 raft_consensus.cc:359] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.413956 17001 raft_consensus.cc:385] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.414211 17001 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.415228 16999 ts_tablet_manager.cc:1434] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:18.416088 17002 tablet_bootstrap.cc:492] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:18.416512 17002 ts_tablet_manager.cc:1403] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
W20260709 13:18:18.416692 16775 leader_election.cc:343] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.418952 17002 raft_consensus.cc:359] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.419631 17002 raft_consensus.cc:385] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.419407 17083 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:18.419934 17002 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.420565 17002 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.422587 17002 ts_tablet_manager.cc:1434] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:18.423395 17002 tablet_bootstrap.cc:492] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:18.423975 17001 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.425972 17001 ts_tablet_manager.cc:1434] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:18:18.427068 16999 tablet_bootstrap.cc:492] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:18.431751 17001 tablet_bootstrap.cc:492] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:18.437517 17001 tablet_bootstrap.cc:654] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.437517 16999 tablet_bootstrap.cc:654] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.440570 17002 tablet_bootstrap.cc:654] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.453122 16999 tablet_bootstrap.cc:492] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:18.453790 16999 ts_tablet_manager.cc:1403] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 13:18:18.457353 16999 raft_consensus.cc:359] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.458289 16999 raft_consensus.cc:385] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.458690 16999 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.459717 16999 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.453140 16705 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.464279 16999 ts_tablet_manager.cc:1434] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:18:18.464627 17002 tablet_bootstrap.cc:492] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:18.465087 17002 ts_tablet_manager.cc:1403] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.012s
I20260709 13:18:18.465391 17001 tablet_bootstrap.cc:492] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:18.465124 16999 tablet_bootstrap.cc:492] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:18.465957 17001 ts_tablet_manager.cc:1403] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.034s	user 0.027s	sys 0.002s
I20260709 13:18:18.467829 17002 raft_consensus.cc:359] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.468521 17002 raft_consensus.cc:385] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.468343 17001 raft_consensus.cc:359] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.468833 17002 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.469164 17001 raft_consensus.cc:385] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.469470 17001 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.469692 17002 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.470237 17001 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.471342 16999 tablet_bootstrap.cc:654] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.472474 17001 ts_tablet_manager.cc:1434] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:18.473416 17001 tablet_bootstrap.cc:492] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:18.475230 17002 ts_tablet_manager.cc:1434] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:18:18.476154 17002 tablet_bootstrap.cc:492] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:18.479322 17001 tablet_bootstrap.cc:654] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.481938 17002 tablet_bootstrap.cc:654] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.490761 17001 tablet_bootstrap.cc:492] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:18.491302 17001 ts_tablet_manager.cc:1403] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:18:18.491178 17031 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:18.494000 17074 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.494200 17001 raft_consensus.cc:359] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.494501 17074 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.495087 17001 raft_consensus.cc:385] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.495464 17001 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.496263 17001 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.497403 17054 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.497819 17054 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.497749 17057 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:18.500151 17054 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.500882 17074 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.501355 17074 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.501768 17074 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.502297 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.505164 17001 ts_tablet_manager.cc:1434] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:18:18.506698 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.507745 17001 tablet_bootstrap.cc:492] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:18.507627 16957 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:18.508603 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.508881 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.509270 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:18.509333 16881 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:18.505195 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.510210 17031 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.510123 17004 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:18.510660 17031 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.510990 17031 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:18.505559 16924 leader_election.cc:343] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:18.512137 16924 leader_election.cc:343] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.512763 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:18.506387 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.514317 16959 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:18.515278 17064 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.517047 17001 tablet_bootstrap.cc:654] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.517911 17083 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.518507 17083 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.521035 17083 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.523149 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.526970 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:18.528275 16775 leader_election.cc:343] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.529313 16775 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:18.530241 17004 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.530704 17004 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.531121 17004 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.503602 17074 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.549930 17004 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.552788 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.553794 17083 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.554559 16885 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.522046 17031 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.568962 17031 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.570696 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:18.571486 16883 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.574115 17004 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.575829 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:18.576692 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:18.577353 16959 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.586440 16959 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:18.587878 16775 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:18:18.588984 16775 leader_election.cc:343] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.589972 17004 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.590324 17083 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.590816 17004 raft_consensus.cc:697] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:18.590955 17083 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.593791 17083 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.594756 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.594849 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.595376 16809 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
W20260709 13:18:18.596525 16850 leader_election.cc:343] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.597461 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.598729 17083 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.599160 17083 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.599575 17083 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.599524 16883 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:18.571457 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:18.600976 16957 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.601007 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:18.601863 17074 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.602418 17074 raft_consensus.cc:697] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:18.603452 17074 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.605710 17064 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:18.613940 17064 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:18.618886 17082 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:18.591960 17004 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.631745 17064 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:18.632508 17083 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.636057 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:18.636694 16808 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.642334 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:18.643175 16808 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
W20260709 13:18:18.644119 16850 leader_election.cc:343] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:18.645009 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.646045 17082 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:18.646602 17082 raft_consensus.cc:697] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:18.658126 16957 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:18.659848 17083 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.683007 17083 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.697360 17083 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.714370 16999 tablet_bootstrap.cc:492] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:18.714993 16999 ts_tablet_manager.cc:1403] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.250s	user 0.048s	sys 0.099s
I20260709 13:18:18.705505 17023 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.739082 17001 tablet_bootstrap.cc:492] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:18.739605 17001 ts_tablet_manager.cc:1403] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.232s	user 0.038s	sys 0.065s
I20260709 13:18:18.744411 17083 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.737010 17023 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.705658 17082 consensus_queue.cc:237] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.761231 17073 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.761888 17073 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.764755 16999 raft_consensus.cc:359] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.771956 16999 raft_consensus.cc:385] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.772241 16999 raft_consensus.cc:740] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.774250 17023 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.775267 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.776088 16810 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:18:18.776312 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.774394 17073 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.776890 16884 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:18.777962 17002 tablet_bootstrap.cc:492] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:18.778146 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.780192 16882 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.782517 16999 consensus_queue.cc:260] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.783775 16807 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:18.783761 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.789561 16999 ts_tablet_manager.cc:1434] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.004s
I20260709 13:18:18.789475 16883 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:18.787974 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.783005 17002 ts_tablet_manager.cc:1403] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.307s	user 0.027s	sys 0.045s
I20260709 13:18:18.794437 17002 raft_consensus.cc:359] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.795271 17081 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:18.796980 17001 raft_consensus.cc:359] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.797737 17001 raft_consensus.cc:385] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.797982 17001 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.798600 17001 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.796500 17002 raft_consensus.cc:385] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:18.799434 17002 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:18.800915 16775 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:18.800177 17002 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.790721 16999 tablet_bootstrap.cc:492] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:18.809830 16707 catalog_manager.cc:5697] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.813488 16924 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:18.818970 17132 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.820463 17132 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.820869 17132 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.814107 16707 catalog_manager.cc:5697] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.819347 17073 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.826777 17073 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.827163 17073 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.829015 17001 ts_tablet_manager.cc:1434] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.089s	user 0.010s	sys 0.007s
I20260709 13:18:18.829952 17001 tablet_bootstrap.cc:492] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:18.831923 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.837042 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.838442 17081 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.840790 17054 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.841431 17054 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.863925 17131 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.876467 17002 ts_tablet_manager.cc:1434] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.084s	user 0.005s	sys 0.001s
I20260709 13:18:18.877261 17002 tablet_bootstrap.cc:492] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:18.882606 17132 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.884793 17054 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.878882 17131 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.901468 16959 raft_consensus.cc:2393] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:18:18.902415 17131 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.905598 17001 tablet_bootstrap.cc:654] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.907374 17132 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:18.913107 16958 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.913911 17121 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:18.911042 17073 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.921591 17073 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.923717 17132 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:18.925534 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:18.926210 16882 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.925200 16707 catalog_manager.cc:5697] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:18.925567 17077 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.930456 17077 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:18.932797 17077 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:18.936717 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.937500 17002 tablet_bootstrap.cc:654] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.937520 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:18.938443 16957 raft_consensus.cc:2393] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:18.925333 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:18.940791 16959 raft_consensus.cc:2393] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:18:18.951251 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.951884 16883 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:18.954073 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.955250 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:18.960337 16810 raft_consensus.cc:2393] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:18.960575 16999 tablet_bootstrap.cc:654] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:18.961619 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:18.958914 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:18.959201 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:18.964916 16809 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:18.966734 16850 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:18.967940 17082 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.968560 17132 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:18.970127 16924 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:18.970837 17132 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:18.971179 17132 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.971482 17132 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:18.973196 16924 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:18.973246 17131 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:18.974591 17131 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:18.975131 16924 consensus_peers.cc:597] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:18.975497 17121 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:18.983044 17082 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:18.958002 16882 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:18.996973 17001 tablet_bootstrap.cc:492] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:18.997445 17001 ts_tablet_manager.cc:1403] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.168s	user 0.012s	sys 0.014s
I20260709 13:18:18.999888 16775 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:19.001643 17073 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.002290 17073 raft_consensus.cc:697] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:19.003088 17073 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.000946 17132 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.017107 17004 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.025882 17001 raft_consensus.cc:359] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.029711 17002 tablet_bootstrap.cc:492] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:19.030535 16999 tablet_bootstrap.cc:492] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:19.031334 17002 ts_tablet_manager.cc:1403] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.154s	user 0.011s	sys 0.007s
I20260709 13:18:19.031394 16999 ts_tablet_manager.cc:1403] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.241s	user 0.017s	sys 0.028s
I20260709 13:18:19.032518 17001 raft_consensus.cc:385] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.032796 17001 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.033298 17001 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.035527 17132 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:19.036211 16999 raft_consensus.cc:359] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.036840 16999 raft_consensus.cc:385] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.037108 16999 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.040019 17001 ts_tablet_manager.cc:1434] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:18:19.037613 16999 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.040886 17001 tablet_bootstrap.cc:492] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:19.041711 16999 ts_tablet_manager.cc:1434] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:18:19.042546 16999 tablet_bootstrap.cc:492] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:19.042578 16924 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:19.053866 17073 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.054028 17135 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.054332 17073 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.056234 16705 catalog_manager.cc:5697] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.061342 17001 tablet_bootstrap.cc:654] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.062945 16999 tablet_bootstrap.cc:654] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.064349 17004 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.066217 17002 raft_consensus.cc:359] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.066865 17002 raft_consensus.cc:385] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.067093 17002 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.068388 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:19.068993 16809 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.070458 17002 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.072753 17002 ts_tablet_manager.cc:1434] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260709 13:18:19.072868 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:19.073436 16881 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.073858 17082 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.074296 17082 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.075111 17073 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.076223 17082 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.081728 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:19.084004 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:19.085008 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:19.073644 17002 tablet_bootstrap.cc:492] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:19.086113 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:19.086669 16957 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
W20260709 13:18:19.087641 16850 leader_election.cc:343] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:19.088331 16850 leader_election.cc:343] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.088667 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:19.089701 17125 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:19.091063 17125 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.091399 17125 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.091802 17125 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.088728 16850 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:19.092856 17082 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:19.093557 16775 leader_election.cc:343] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.098819 16809 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:19.099948 16924 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:19.100486 17002 tablet_bootstrap.cc:654] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.100720 17135 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.101197 17135 raft_consensus.cc:697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:19.102126 16881 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:19.102044 17135 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.110246 17125 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.113026 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:18:19.114365 16775 leader_election.cc:343] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.118012 17125 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.118276 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:19.118986 16957 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.124020 17001 tablet_bootstrap.cc:492] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:19.124564 17001 ts_tablet_manager.cc:1403] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.004s
I20260709 13:18:19.127344 17001 raft_consensus.cc:359] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.128000 17001 raft_consensus.cc:385] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.128261 17001 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.128902 17001 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.130401 16957 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:19.131078 17001 ts_tablet_manager.cc:1434] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:18:19.134872 16999 tablet_bootstrap.cc:492] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:19.132921 17002 tablet_bootstrap.cc:492] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:19.135295 16999 ts_tablet_manager.cc:1403] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.001s
I20260709 13:18:19.135389 17002 ts_tablet_manager.cc:1403] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.002s
I20260709 13:18:19.136353 17001 tablet_bootstrap.cc:492] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:19.138259 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:19.139612 17125 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:19.133525 16756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:19.141390 17002 raft_consensus.cc:359] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.141916 17002 raft_consensus.cc:385] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.142191 17002 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.140142 17125 raft_consensus.cc:697] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:19.141762 16999 raft_consensus.cc:359] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.142795 16999 raft_consensus.cc:385] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.143240 16999 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.142807 17002 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.143041 17125 consensus_queue.cc:237] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.133231 16708 catalog_manager.cc:5697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.144992 17002 ts_tablet_manager.cc:1434] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:19.144783 17073 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.144737 16999 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.145898 17002 tablet_bootstrap.cc:492] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:19.146950 16999 ts_tablet_manager.cc:1434] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:18:19.147864 16999 tablet_bootstrap.cc:492] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:19.151774 17002 tablet_bootstrap.cc:654] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.153571 16999 tablet_bootstrap.cc:654] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.143070 17001 tablet_bootstrap.cc:654] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.181641 17001 tablet_bootstrap.cc:492] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:19.182108 17001 ts_tablet_manager.cc:1403] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.046s	user 0.004s	sys 0.008s
I20260709 13:18:19.182973 16707 catalog_manager.cc:5697] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.183931 17002 tablet_bootstrap.cc:492] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:19.184392 17002 ts_tablet_manager.cc:1403] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.018s
I20260709 13:18:19.186960 17002 raft_consensus.cc:359] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.187768 17002 raft_consensus.cc:385] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.188071 17002 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.184511 17001 raft_consensus.cc:359] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.188932 17001 raft_consensus.cc:385] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.188917 17002 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.189360 17001 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.190164 17001 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.191237 17002 ts_tablet_manager.cc:1434] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:19.192138 17002 tablet_bootstrap.cc:492] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:19.192176 16999 tablet_bootstrap.cc:492] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:19.192544 17001 ts_tablet_manager.cc:1434] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:18:19.193044 16999 ts_tablet_manager.cc:1403] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.008s
I20260709 13:18:19.193392 17001 tablet_bootstrap.cc:492] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:19.196231 16999 raft_consensus.cc:359] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.196936 16999 raft_consensus.cc:385] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.197247 16999 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.197911 16999 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.198691 17002 tablet_bootstrap.cc:654] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.200206 16999 ts_tablet_manager.cc:1434] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:19.201375 16999 tablet_bootstrap.cc:492] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:19.207285 17001 tablet_bootstrap.cc:654] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.207285 16999 tablet_bootstrap.cc:654] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.220118 17001 tablet_bootstrap.cc:492] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:19.220377 16999 tablet_bootstrap.cc:492] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:19.220578 17001 ts_tablet_manager.cc:1403] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.006s
I20260709 13:18:19.220880 16999 ts_tablet_manager.cc:1403] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 13:18:19.226436 16999 raft_consensus.cc:359] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.227263 16999 raft_consensus.cc:385] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.227586 16999 raft_consensus.cc:740] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.228986 17057 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.229432 17057 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.231377 17057 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:19.223235 17001 raft_consensus.cc:359] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.232013 17001 raft_consensus.cc:385] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.232286 17001 raft_consensus.cc:740] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.232990 17001 consensus_queue.cc:260] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.233753 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:19.234344 16883 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:19.234190 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:19.234946 17001 ts_tablet_manager.cc:1434] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:18:19.235766 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:18:19.236771 16924 leader_election.cc:343] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.237990 17135 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.238193 17001 tablet_bootstrap.cc:492] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:19.238380 17135 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.238696 17135 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.243968 17132 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.244421 17132 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.246121 17081 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.228399 16999 consensus_queue.cc:260] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.246394 17132 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:19.246599 17081 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.248144 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:19.248554 17081 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.248642 16999 ts_tablet_manager.cc:1434] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:18:19.249758 16999 tablet_bootstrap.cc:492] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
W20260709 13:18:19.250114 16924 leader_election.cc:343] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.244380 17001 tablet_bootstrap.cc:654] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.246140 17135 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.250598 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:19.251623 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:19.252332 16850 leader_election.cc:343] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.250770 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:19.253140 16957 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:19.252626 17135 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:19.257177 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:19.257704 16883 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.260253 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:19.261660 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:19.263087 17081 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:18:19.263441 16924 leader_election.cc:343] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.263584 17081 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.264107 17081 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.264911 16883 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
W20260709 13:18:19.281750 16924 leader_election.cc:343] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.282231 16924 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:19.283232 17135 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.283349 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:19.284116 17135 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.284569 17135 raft_consensus.cc:697] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:19.285399 17135 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.273651 17081 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.298813 17081 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.300172 17132 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.300483 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:19.300640 17132 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.301044 16957 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.302489 17132 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:19.303894 17125 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.304345 17125 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.305514 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:19.310783 16999 tablet_bootstrap.cc:654] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:19.311282 16850 leader_election.cc:343] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.306255 17125 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.314347 16957 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:19.308225 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:19.307482 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:19.309970 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:19.307459 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:19.318857 16807 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:19.317310 17125 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.319866 17125 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.322997 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:19.323026 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:19.323812 16881 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:19.325538 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:19.325830 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:19.326442 17121 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.326689 16958 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:19.327359 17135 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.326889 17121 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.329108 17121 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.325526 17125 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.332772 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:19.340250 17135 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.342167 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:19.343274 17125 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.346069 17001 tablet_bootstrap.cc:492] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:19.346696 17001 ts_tablet_manager.cc:1403] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.111s	user 0.023s	sys 0.023s
I20260709 13:18:19.349572 16999 tablet_bootstrap.cc:492] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:19.350001 16999 ts_tablet_manager.cc:1403] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.000s
I20260709 13:18:19.349805 17001 raft_consensus.cc:359] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.350556 17001 raft_consensus.cc:385] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.350466 17077 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.351231 17077 raft_consensus.cc:697] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:19.352051 17077 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.352711 16999 raft_consensus.cc:359] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.353307 16999 raft_consensus.cc:385] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.353574 16999 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.354264 16999 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.356487 17001 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.357198 16999 ts_tablet_manager.cc:1434] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:19.358268 16999 tablet_bootstrap.cc:492] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:19.357652 16706 catalog_manager.cc:5697] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.358134 17001 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.361018 17001 ts_tablet_manager.cc:1434] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:18:19.362704 17082 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:19.364166 17001 tablet_bootstrap.cc:492] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:19.365212 16999 tablet_bootstrap.cc:654] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.369789 17082 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:19.376226 17001 tablet_bootstrap.cc:654] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.389010 16999 tablet_bootstrap.cc:492] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:19.389588 16999 ts_tablet_manager.cc:1403] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.011s
I20260709 13:18:19.393026 16999 raft_consensus.cc:359] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.393709 16999 raft_consensus.cc:385] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.394047 16999 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.394627 17001 tablet_bootstrap.cc:492] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:19.394687 16999 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.395818 17001 ts_tablet_manager.cc:1403] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.003s
I20260709 13:18:19.399053 16999 ts_tablet_manager.cc:1434] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:18:19.401844 17001 raft_consensus.cc:359] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.404253 17001 raft_consensus.cc:385] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.404901 17001 raft_consensus.cc:740] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.406240 17001 consensus_queue.cc:260] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.409162 17001 ts_tablet_manager.cc:1434] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 13:18:19.409302 16999 tablet_bootstrap.cc:492] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:19.411827 17001 tablet_bootstrap.cc:492] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:19.414361 17121 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.420094 16807 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.423889 17001 tablet_bootstrap.cc:654] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.424079 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:19.425271 16883 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.431803 16883 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:19.433111 16999 tablet_bootstrap.cc:654] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.433936 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:19.437753 17125 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.438320 17125 raft_consensus.cc:697] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:19.439321 17125 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.444976 17001 tablet_bootstrap.cc:492] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:19.448585 17001 ts_tablet_manager.cc:1403] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.002s
I20260709 13:18:19.454767 17001 raft_consensus.cc:359] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.456686 17001 raft_consensus.cc:385] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.457329 17001 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.458640 17001 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.462570 17001 ts_tablet_manager.cc:1434] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:18:19.466286 17001 tablet_bootstrap.cc:492] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:19.469105 17135 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.469775 17135 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.473610 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:19.475239 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:19.475488 16924 leader_election.cc:343] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.476715 17135 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:18:19.477626 16924 leader_election.cc:343] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.478226 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:19.479839 17135 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.482473 17001 tablet_bootstrap.cc:654] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.499498 17002 tablet_bootstrap.cc:492] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:19.499992 17002 ts_tablet_manager.cc:1403] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.308s	user 0.100s	sys 0.181s
I20260709 13:18:19.501780 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:19.502373 16959 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.502553 17002 raft_consensus.cc:359] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.503217 17002 raft_consensus.cc:385] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.503472 17002 raft_consensus.cc:740] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.504066 17002 consensus_queue.cc:260] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.507341 17002 ts_tablet_manager.cc:1434] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:19.508227 17002 tablet_bootstrap.cc:492] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:19.509450 16959 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:19.513419 17001 tablet_bootstrap.cc:492] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:19.513926 17002 tablet_bootstrap.cc:654] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.514065 17001 ts_tablet_manager.cc:1403] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.005s
I20260709 13:18:19.515502 17121 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.517585 17001 raft_consensus.cc:359] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.518538 17001 raft_consensus.cc:385] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.518949 17001 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.520000 17001 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.522035 17001 ts_tablet_manager.cc:1434] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:19.523753 17001 tablet_bootstrap.cc:492] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:19.527212 17002 tablet_bootstrap.cc:492] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:19.527659 17002 ts_tablet_manager.cc:1403] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 13:18:19.530601 17002 raft_consensus.cc:359] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.531246 17002 raft_consensus.cc:385] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.531507 17002 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.532183 17002 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.532793 17001 tablet_bootstrap.cc:654] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.534289 17002 ts_tablet_manager.cc:1434] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:19.535171 17002 tablet_bootstrap.cc:492] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:19.540835 17002 tablet_bootstrap.cc:654] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.541453 17121 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.542522 16999 tablet_bootstrap.cc:492] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:19.542971 16999 ts_tablet_manager.cc:1403] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.134s	user 0.034s	sys 0.026s
I20260709 13:18:19.544704 16707 catalog_manager.cc:5697] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.545627 16999 raft_consensus.cc:359] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.546480 16999 raft_consensus.cc:385] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.546830 16999 raft_consensus.cc:740] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.547591 16999 consensus_queue.cc:260] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.551723 17002 tablet_bootstrap.cc:492] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:19.552240 17002 ts_tablet_manager.cc:1403] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 13:18:19.553828 16999 ts_tablet_manager.cc:1434] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:18:19.554771 17002 raft_consensus.cc:359] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.555418 17002 raft_consensus.cc:385] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.555665 17002 raft_consensus.cc:740] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.556298 17002 consensus_queue.cc:260] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.556957 16999 tablet_bootstrap.cc:492] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:19.558403 17121 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.558956 17002 ts_tablet_manager.cc:1434] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:19.558977 17121 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.560483 17002 tablet_bootstrap.cc:492] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:19.560424 17132 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.563439 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:19.564878 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:19.566040 16959 raft_consensus.cc:2393] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:19.568950 17132 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:19.572576 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:19.567767 17121 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.573355 17121 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.589764 17121 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.594911 17121 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.616590 17001 tablet_bootstrap.cc:492] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:19.625586 17077 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.626159 17077 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.628391 16885 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.651398 17135 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.636199 17132 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.654659 17002 tablet_bootstrap.cc:654] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.654455 17135 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.654568 17132 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.655215 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:19.656699 17077 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.650907 17001 ts_tablet_manager.cc:1403] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.127s	user 0.021s	sys 0.014s
I20260709 13:18:19.659189 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:19.663734 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:19.658727 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:19.665766 16924 leader_election.cc:343] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:19.666419 16924 leader_election.cc:343] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.657334 17073 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:18:19.667697 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:19.667841 17135 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:18:19.669446 16850 leader_election.cc:343] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.632565 17074 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.670708 17132 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:19.666301 17001 raft_consensus.cc:359] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.672319 17001 raft_consensus.cc:385] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.672617 17001 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.648947 17082 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.673328 17082 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.673234 17001 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.676860 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:19.677506 17001 ts_tablet_manager.cc:1434] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:18:19.678401 17001 tablet_bootstrap.cc:492] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
W20260709 13:18:19.678500 16850 leader_election.cc:343] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.676155 16708 catalog_manager.cc:5697] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.678427 17082 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.670581 17074 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.692117 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:19.692835 16957 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:19.693792 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:19.695353 17082 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.701535 17082 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.701963 17082 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.702538 16999 tablet_bootstrap.cc:654] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.704021 16809 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
W20260709 13:18:19.695783 16924 leader_election.cc:343] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.708130 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:19.708941 17077 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.709304 17077 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.709635 17077 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.716519 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:19.719648 17074 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.711287 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:19.721068 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:19.722030 17184 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.722960 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:19.723227 16775 leader_election.cc:343] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.726814 17077 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.730209 16883 raft_consensus.cc:2393] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:19.732209 16775 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:19.733834 17074 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.737560 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:19.737803 17001 tablet_bootstrap.cc:654] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.738123 17002 tablet_bootstrap.cc:492] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:19.764457 17002 ts_tablet_manager.cc:1403] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.204s	user 0.012s	sys 0.023s
I20260709 13:18:19.773531 17082 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.775481 16882 raft_consensus.cc:2393] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:19.775399 17125 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.775954 17082 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.776095 17125 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.777303 17077 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.778744 17074 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:19.778169 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:19.777208 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:19.783638 16958 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.778108 17125 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.779866 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:19.780640 17002 raft_consensus.cc:359] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.783314 17124 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.785066 17002 raft_consensus.cc:385] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.785422 17002 raft_consensus.cc:740] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.785465 17124 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.786134 17002 consensus_queue.cc:260] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:19.786726 16850 leader_election.cc:343] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.787420 17124 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.788182 17002 ts_tablet_manager.cc:1434] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:18:19.792181 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:19.796711 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:19.797308 16957 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:19.797422 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:19.798031 16882 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
W20260709 13:18:19.796722 16775 leader_election.cc:343] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.798728 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:19.799431 16959 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
W20260709 13:18:19.800554 16850 leader_election.cc:343] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.799659 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:19.791368 17002 tablet_bootstrap.cc:492] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:19.801929 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:19.803040 17124 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.803382 17124 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.803741 17124 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.804376 17073 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:19.804746 17073 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.805073 17073 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.800967 16958 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:19.810048 17057 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.813380 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:19.814239 17077 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.815500 17073 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.815899 17077 raft_consensus.cc:697] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:19.816285 16999 tablet_bootstrap.cc:492] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:19.816762 16999 ts_tablet_manager.cc:1403] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.260s	user 0.021s	sys 0.006s
I20260709 13:18:19.817991 17073 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.824326 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:19.824733 17082 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.824882 16959 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.826011 17073 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.824874 16999 raft_consensus.cc:359] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.827735 16999 raft_consensus.cc:385] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.827999 16999 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.828691 16809 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:19.829408 17001 tablet_bootstrap.cc:492] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:19.831727 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:19.884789 17001 ts_tablet_manager.cc:1403] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.207s	user 0.020s	sys 0.019s
I20260709 13:18:19.830920 17124 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.884997 16885 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.886777 17124 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:19.838534 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:19.884012 16999 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.888453 17082 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:19.888587 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 50197.4us
I20260709 13:18:19.889042 16999 ts_tablet_manager.cc:1434] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.072s	user 0.019s	sys 0.014s
I20260709 13:18:19.888942 17082 raft_consensus.cc:697] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:19.889966 16999 tablet_bootstrap.cc:492] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:19.890072 17082 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.895054 16885 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:19.896785 16999 tablet_bootstrap.cc:654] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.902258 16999 tablet_bootstrap.cc:492] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:19.901940 17001 raft_consensus.cc:359] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.902626 17001 raft_consensus.cc:385] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.835352 16959 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:19.902771 16999 ts_tablet_manager.cc:1403] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:18:19.902952 17001 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.903837 17001 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.905717 16999 raft_consensus.cc:359] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.909044 16999 raft_consensus.cc:385] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.909308 16999 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.909432 17001 ts_tablet_manager.cc:1434] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 13:18:19.820299 16924 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:19.910291 17001 tablet_bootstrap.cc:492] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:19.909965 16999 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.910346 17057 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:19.910506 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 99022.5us
I20260709 13:18:19.911463 16999 ts_tablet_manager.cc:1434] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.004s
I20260709 13:18:19.912272 16999 tablet_bootstrap.cc:492] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:19.916752 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:19.917302 16958 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:19.917311 17001 tablet_bootstrap.cc:654] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.918421 16999 tablet_bootstrap.cc:654] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.816735 17077 consensus_queue.cc:237] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.924823 16958 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:19.927878 17001 tablet_bootstrap.cc:492] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:19.928571 17001 ts_tablet_manager.cc:1403] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.001s
I20260709 13:18:19.930975 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:19.931763 17124 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.933614 16999 tablet_bootstrap.cc:492] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:19.934033 16999 ts_tablet_manager.cc:1403] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.012s
I20260709 13:18:19.933779 16708 catalog_manager.cc:5697] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.934418 17001 raft_consensus.cc:359] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.935226 17001 raft_consensus.cc:385] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.935295 17073 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:19.935592 17001 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.936123 17124 raft_consensus.cc:697] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:19.936416 16999 raft_consensus.cc:359] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.937059 16999 raft_consensus.cc:385] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:19.936721 17001 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.936980 17124 consensus_queue.cc:237] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.938957 17001 ts_tablet_manager.cc:1434] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:18:19.939853 17001 tablet_bootstrap.cc:492] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:19.937412 16999 raft_consensus.cc:740] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:19.944427 16999 consensus_queue.cc:260] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:19.946043 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:18:19.934854 16924 consensus_peers.cc:597] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:19.946704 17001 tablet_bootstrap.cc:654] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.948156 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:19.951879 17124 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:19.952708 17124 raft_consensus.cc:697] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:19.953768 17124 consensus_queue.cc:237] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:19.957728 16775 leader_election.cc:343] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:19.964500 16999 ts_tablet_manager.cc:1434] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:18:19.963037 16707 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.965934 17002 tablet_bootstrap.cc:654] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:19.966823 16999 tablet_bootstrap.cc:492] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:19.996531 17002 tablet_bootstrap.cc:492] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:19.996933 17002 ts_tablet_manager.cc:1403] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.206s	user 0.007s	sys 0.005s
I20260709 13:18:19.997085 16999 tablet_bootstrap.cc:654] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.000771 17077 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.002885 17057 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.003336 17057 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.005385 17057 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:20.006881 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.008013 17073 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.008946 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.009857 17002 raft_consensus.cc:359] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:20.010317 16924 leader_election.cc:343] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.010475 17002 raft_consensus.cc:385] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.010787 17002 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
W20260709 13:18:20.010999 16924 leader_election.cc:343] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.011425 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:20.013063 17057 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.014647 17002 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.016184 17002 ts_tablet_manager.cc:1434] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:18:20.019148 17001 tablet_bootstrap.cc:492] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:20.019701 17001 ts_tablet_manager.cc:1403] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.018s
I20260709 13:18:20.021380 17002 tablet_bootstrap.cc:492] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:20.022421 17001 raft_consensus.cc:359] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.023301 17001 raft_consensus.cc:385] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.023631 17001 raft_consensus.cc:740] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.033949 16707 catalog_manager.cc:5697] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.035811 16707 catalog_manager.cc:5697] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.034976 17001 consensus_queue.cc:260] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.040979 17001 ts_tablet_manager.cc:1434] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:18:20.043016 17001 tablet_bootstrap.cc:492] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:20.043661 16999 tablet_bootstrap.cc:492] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:20.044086 17073 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.044557 17073 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.046515 17073 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.044126 16999 ts_tablet_manager.cc:1403] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.019s
I20260709 13:18:20.048965 17001 tablet_bootstrap.cc:654] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.050278 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.047506 17002 tablet_bootstrap.cc:654] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.052073 17135 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.052016 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:20.052773 16957 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:20.052666 17135 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:20.054031 16775 leader_election.cc:343] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.054713 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:20.054821 16999 raft_consensus.cc:359] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.055708 16999 raft_consensus.cc:385] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.055902 17121 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.056078 16999 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.056329 17121 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.056721 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.056722 17121 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.058319 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:20.058518 16924 leader_election.cc:343] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.054875 17135 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:20.057008 16999 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.056959 17183 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.059546 16924 leader_election.cc:343] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.059737 17183 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.059975 16924 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:20.060933 16999 ts_tablet_manager.cc:1434] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:18:20.061103 17135 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.061631 17183 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:20.061832 16999 tablet_bootstrap.cc:492] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:20.062973 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.063745 16807 raft_consensus.cc:2393] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:20.065497 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.065387 17121 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.067919 16924 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:20.068033 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:20.068985 17183 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.069484 17002 tablet_bootstrap.cc:492] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
W20260709 13:18:20.069439 16775 leader_election.cc:343] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.070024 17002 ts_tablet_manager.cc:1403] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.000s
I20260709 13:18:20.072675 17121 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.075148 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:20.075729 16958 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.075778 17002 raft_consensus.cc:359] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.075802 17124 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.076516 17002 raft_consensus.cc:385] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.076826 17002 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.076777 17124 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.077584 17002 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.078747 17124 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.075503 17183 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.079581 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.080253 17002 ts_tablet_manager.cc:1434] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:18:20.081419 17002 tablet_bootstrap.cc:492] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:20.081746 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:20.082440 16957 raft_consensus.cc:2393] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:20.083254 16958 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:20.083882 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:20.085170 17124 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.090436 17124 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.090837 17002 tablet_bootstrap.cc:654] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.095032 16999 tablet_bootstrap.cc:654] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.095563 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:20.097604 17124 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.098102 17124 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:20.098709 17001 tablet_bootstrap.cc:492] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:20.099149 17001 ts_tablet_manager.cc:1403] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.008s
I20260709 13:18:20.099010 17124 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.101251 17002 tablet_bootstrap.cc:492] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:20.101711 17002 ts_tablet_manager.cc:1403] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:18:20.104667 17001 raft_consensus.cc:359] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.105341 17001 raft_consensus.cc:385] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.105604 17001 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.106235 17001 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.108249 17001 ts_tablet_manager.cc:1434] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:18:20.109203 17001 tablet_bootstrap.cc:492] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:20.120955 17002 raft_consensus.cc:359] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.121541 17002 raft_consensus.cc:385] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.121770 17002 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.122260 17002 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.126346 17002 ts_tablet_manager.cc:1434] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 13:18:20.124048 16706 catalog_manager.cc:5697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.131731 17001 tablet_bootstrap.cc:654] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.133486 17002 tablet_bootstrap.cc:492] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:20.136669 17001 tablet_bootstrap.cc:492] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:20.137132 17001 ts_tablet_manager.cc:1403] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.001s
I20260709 13:18:20.139360 17001 raft_consensus.cc:359] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.140020 17001 raft_consensus.cc:385] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.140268 17001 raft_consensus.cc:740] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.136695 16999 tablet_bootstrap.cc:492] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:20.141217 16999 ts_tablet_manager.cc:1403] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.009s
I20260709 13:18:20.141498 17002 tablet_bootstrap.cc:654] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.143374 16999 raft_consensus.cc:359] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.143927 16999 raft_consensus.cc:385] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.144198 16999 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.143932 17001 consensus_queue.cc:260] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.144929 16999 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.146477 17001 ts_tablet_manager.cc:1434] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:18:20.147657 17183 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.147842 17001 tablet_bootstrap.cc:492] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:20.148218 17183 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.150740 17183 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:20.154093 17001 tablet_bootstrap.cc:654] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.154376 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.155359 16999 ts_tablet_manager.cc:1434] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:18:20.155979 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:20.158246 16924 leader_election.cc:343] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:20.159116 16924 leader_election.cc:343] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.159629 16924 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:20.160701 17135 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.196725 16999 tablet_bootstrap.cc:492] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:20.205232 16999 tablet_bootstrap.cc:654] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.209100 17002 tablet_bootstrap.cc:492] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:20.209559 17002 ts_tablet_manager.cc:1403] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.076s	user 0.035s	sys 0.035s
I20260709 13:18:20.211082 17001 tablet_bootstrap.cc:492] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:20.211639 17001 ts_tablet_manager.cc:1403] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.064s	user 0.044s	sys 0.012s
I20260709 13:18:20.212168 16999 tablet_bootstrap.cc:492] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:20.212100 17002 raft_consensus.cc:359] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.212689 16999 ts_tablet_manager.cc:1403] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.000s
I20260709 13:18:20.212888 17002 raft_consensus.cc:385] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.213201 17002 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.213879 17002 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.214463 17001 raft_consensus.cc:359] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.215232 17001 raft_consensus.cc:385] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.215552 17001 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.215615 16999 raft_consensus.cc:359] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.216269 16999 raft_consensus.cc:385] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.216552 16999 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
W20260709 13:18:20.216689 16756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:20.217197 16999 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.216379 17001 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.218655 17002 ts_tablet_manager.cc:1434] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:18:20.219451 17001 ts_tablet_manager.cc:1434] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:20.219564 17002 tablet_bootstrap.cc:492] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:20.220314 17001 tablet_bootstrap.cc:492] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:20.225006 17002 tablet_bootstrap.cc:654] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.226227 17001 tablet_bootstrap.cc:654] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.229480 16999 ts_tablet_manager.cc:1434] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:18:20.230309 16999 tablet_bootstrap.cc:492] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:20.236864 17121 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.243930 17121 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.236253 17124 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.246531 17124 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.249215 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.251186 17124 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.252627 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:20.240732 16999 tablet_bootstrap.cc:654] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.254029 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:20.254868 17124 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.255271 17002 tablet_bootstrap.cc:492] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:20.255748 17002 ts_tablet_manager.cc:1403] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.009s
I20260709 13:18:20.256505 17121 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.257040 17001 tablet_bootstrap.cc:492] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:20.257153 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.257642 17001 ts_tablet_manager.cc:1403] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.018s
I20260709 13:18:20.257740 16881 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:20.258638 17002 raft_consensus.cc:359] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.259374 16775 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:20.259517 17002 raft_consensus.cc:385] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.259933 17002 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.260088 17121 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.260489 17121 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.260172 17001 raft_consensus.cc:359] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.261356 17001 raft_consensus.cc:385] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.260763 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:20.260708 17002 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.260874 17121 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.262151 16958 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:20.263590 17002 ts_tablet_manager.cc:1434] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:20.263756 16999 tablet_bootstrap.cc:492] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:20.264210 16999 ts_tablet_manager.cc:1403] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.001s
I20260709 13:18:20.264616 17002 tablet_bootstrap.cc:492] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:20.266645 16999 raft_consensus.cc:359] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.267275 16999 raft_consensus.cc:385] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.267621 16999 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.268321 16999 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.270491 16999 ts_tablet_manager.cc:1434] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:20.261762 17001 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.272213 17002 tablet_bootstrap.cc:654] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.272047 17121 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.275830 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:20.276341 16958 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.277273 16999 tablet_bootstrap.cc:492] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:20.277561 17183 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.277985 17183 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.280561 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:20.281935 16924 leader_election.cc:343] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.271219 17001 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.283159 16999 tablet_bootstrap.cc:654] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.283772 17001 ts_tablet_manager.cc:1434] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:18:20.284374 17121 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.286893 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:20.287887 16881 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.295830 17002 tablet_bootstrap.cc:492] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:20.296267 17002 ts_tablet_manager.cc:1403] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.003s
I20260709 13:18:20.299239 17002 raft_consensus.cc:359] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.299917 17002 raft_consensus.cc:385] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.300225 17002 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.300858 17002 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.302915 17002 ts_tablet_manager.cc:1434] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:20.303798 17002 tablet_bootstrap.cc:492] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:20.304414 17057 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.305047 17057 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.308557 16881 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:20.309340 17002 tablet_bootstrap.cc:654] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.309610 16775 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:20.311259 17121 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.309252 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.311756 17121 raft_consensus.cc:697] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:20.313045 16999 tablet_bootstrap.cc:492] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:20.289027 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.284425 17183 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:20.291893 16958 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:20.289978 17202 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.293313 17001 tablet_bootstrap.cc:492] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:20.313882 16999 ts_tablet_manager.cc:1403] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.017s
I20260709 13:18:20.314606 17202 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.307575 17057 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:20.317550 16999 raft_consensus.cc:359] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.318173 16999 raft_consensus.cc:385] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.318434 16999 raft_consensus.cc:740] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.318557 17002 tablet_bootstrap.cc:492] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:20.318996 17002 ts_tablet_manager.cc:1403] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:18:20.319016 16999 consensus_queue.cc:260] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.320310 17001 tablet_bootstrap.cc:654] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.320169 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.321398 16999 ts_tablet_manager.cc:1434] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:20.323375 16999 tablet_bootstrap.cc:492] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:20.313691 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.321993 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:20.324438 16958 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:20.325552 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:20.325930 17001 tablet_bootstrap.cc:492] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:20.326408 17001 ts_tablet_manager.cc:1403] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:18:20.326363 17077 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.321586 17002 raft_consensus.cc:359] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.312597 17121 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.327127 17002 raft_consensus.cc:385] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.327440 17002 raft_consensus.cc:740] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.327535 17124 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.327992 17124 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.328118 17002 consensus_queue.cc:260] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.329883 17124 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.330053 17002 ts_tablet_manager.cc:1434] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:18:20.330875 17002 tablet_bootstrap.cc:492] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:20.330015 17202 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.333532 17001 raft_consensus.cc:359] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.334225 17001 raft_consensus.cc:385] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.334488 17001 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
W20260709 13:18:20.334674 16924 leader_election.cc:343] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:20.336035 16924 leader_election.cc:343] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.335800 17001 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.337320 16924 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:20.337723 16999 tablet_bootstrap.cc:654] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.338264 17183 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.338703 17001 ts_tablet_manager.cc:1434] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 13:18:20.339454 16924 leader_election.cc:343] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.339911 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:20.340092 17001 tablet_bootstrap.cc:492] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:20.340795 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.341115 17002 tablet_bootstrap.cc:654] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.341400 16884 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:20.338814 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:20.343307 16958 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:20.342711 16775 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:20.343873 17183 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.344940 17074 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.345289 17074 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.345660 17074 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.346967 17202 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:20.363591 17077 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.372861 17074 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.374781 17077 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.375375 17077 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.376273 17082 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.376929 17082 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.377703 17077 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.385011 16809 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.386346 17074 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.398979 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:20.399816 16958 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.404887 16999 tablet_bootstrap.cc:492] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:20.405332 16999 ts_tablet_manager.cc:1403] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.012s
I20260709 13:18:20.379385 17082 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.406982 17001 tablet_bootstrap.cc:654] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.408946 16999 raft_consensus.cc:359] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.409371 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:20.409631 16999 raft_consensus.cc:385] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.409888 16999 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.409967 17121 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.410694 16999 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.411214 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:20.411244 17121 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.411810 16959 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:20.412839 16999 ts_tablet_manager.cc:1434] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:18:20.412984 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:20.413713 16999 tablet_bootstrap.cc:492] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:20.413591 16959 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:20.414288 17073 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.415974 17121 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.416246 17073 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.409916 16884 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.420859 16999 tablet_bootstrap.cc:654] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.423020 17001 tablet_bootstrap.cc:492] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:20.423514 17001 ts_tablet_manager.cc:1403] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.020s
I20260709 13:18:20.426362 17001 raft_consensus.cc:359] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.427305 17001 raft_consensus.cc:385] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.427736 17001 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.428522 17001 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.431190 17001 ts_tablet_manager.cc:1434] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:18:20.432492 17001 tablet_bootstrap.cc:492] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:20.439421 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.440344 16807 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:20.441462 17001 tablet_bootstrap.cc:654] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.445150 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.446125 16807 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:20.451480 17082 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:20.456001 17001 tablet_bootstrap.cc:492] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:20.456621 17001 ts_tablet_manager.cc:1403] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.008s
I20260709 13:18:20.458024 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:20.458834 16957 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:20.460110 17001 raft_consensus.cc:359] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.460927 17001 raft_consensus.cc:385] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.461257 17001 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.462136 17001 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.464773 17001 ts_tablet_manager.cc:1434] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:18:20.465967 17001 tablet_bootstrap.cc:492] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:20.473271 17001 tablet_bootstrap.cc:654] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:20.480273 16884 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:20.483889 17057 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.483750 16850 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:20.484452 17057 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.484870 17082 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.485404 17082 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.485491 16775 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:20.485914 17082 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.486338 17121 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.486439 17057 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:20.486763 17121 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.487092 17121 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.488597 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:20.490027 16924 leader_election.cc:343] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.492118 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:20.496718 17202 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.497103 17202 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.497452 17202 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.498903 17001 tablet_bootstrap.cc:492] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:20.499361 17001 ts_tablet_manager.cc:1403] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.000s
I20260709 13:18:20.500520 17121 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.501827 17001 raft_consensus.cc:359] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.502651 17183 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.528071 17001 raft_consensus.cc:385] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.528391 17001 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.528183 17183 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.497112 17082 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.504659 17202 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.511978 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.528606 17233 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:20.645347 17121 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.646751 17001 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.596446 17124 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.648144 17124 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:20.538918 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 53504.5us
I20260709 13:18:20.660080 17001 ts_tablet_manager.cc:1434] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.160s	user 0.015s	sys 0.010s
I20260709 13:18:20.661278 17001 tablet_bootstrap.cc:492] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:20.650046 17124 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.541567 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.567863 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.669019 16775 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:20.671244 17073 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.672525 17073 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.672987 17073 raft_consensus.cc:697] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:20.673763 17073 consensus_queue.cc:237] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.532275 17183 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:18:20.678241 16924 leader_election.cc:343] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.540727 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.549685 17232 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.737871 17001 tablet_bootstrap.cc:654] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:20.688855 16924 leader_election.cc:343] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.740327 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:18:20.741263 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 52436.9us
I20260709 13:18:20.569763 16958 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:20.705468 16885 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:20.723490 17082 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.724716 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:20.711984 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:20.700606 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:18:20.753072 16924 leader_election.cc:343] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.753625 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:20.746467 17232 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.744287 17135 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.750479 16954 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:20.742056 17237 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.758215 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.762087 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:20.762019 17073 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:20.747951 17234 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.766522 16999 tablet_bootstrap.cc:492] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:20.777756 16999 ts_tablet_manager.cc:1403] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.364s	user 0.027s	sys 0.062s
I20260709 13:18:20.747545 17057 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.781271 17057 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.783865 16999 raft_consensus.cc:359] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.784716 16999 raft_consensus.cc:385] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.785029 16999 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.785778 16999 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.770972 16810 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:20.764753 16951 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.763423 17183 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.764024 17082 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:18:20.805505 17239 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.805922 17239 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.765753 17135 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.807314 16879 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:20.830891 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.837888 17124 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:20.838514 17002 tablet_bootstrap.cc:492] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:20.839108 17002 ts_tablet_manager.cc:1403] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.508s	user 0.080s	sys 0.130s
I20260709 13:18:20.841472 17001 tablet_bootstrap.cc:492] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:20.841889 17001 ts_tablet_manager.cc:1403] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.181s	user 0.012s	sys 0.018s
I20260709 13:18:20.790458 17234 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.855718 16999 ts_tablet_manager.cc:1434] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.040s
I20260709 13:18:20.856986 16999 tablet_bootstrap.cc:492] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:20.863364 17202 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.853094 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:20.864269 16808 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.864001 17002 raft_consensus.cc:359] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.864656 17002 raft_consensus.cc:385] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.864907 17002 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.865486 17002 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.867445 17002 ts_tablet_manager.cc:1434] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.003s
I20260709 13:18:20.858312 16880 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:20.869576 16951 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:20.857481 17001 raft_consensus.cc:359] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.871380 17001 raft_consensus.cc:385] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:20.871659 17001 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:20.872404 17002 tablet_bootstrap.cc:492] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:20.874852 17232 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.873785 17001 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.881596 17001 ts_tablet_manager.cc:1434] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:18:20.882944 17234 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.888785 17239 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.901798 17237 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.900408 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:20.904160 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:20.904894 17237 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.905319 16958 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:20.907871 17121 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:20.908254 17121 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.908440 17237 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:20.908625 17121 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.910676 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.914407 17057 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:20.917544 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.919519 16883 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.913699 16808 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:20.926698 17001 tablet_bootstrap.cc:492] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
W20260709 13:18:20.929968 16775 leader_election.cc:343] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.922286 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.933893 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:20.934144 16775 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:20.936858 17073 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:20.940941 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.942471 17241 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:18:20.937381 17234 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:18:20.948386 16924 leader_election.cc:343] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.946575 17073 raft_consensus.cc:697] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:20.949184 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:20.950001 16924 leader_election.cc:343] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.950695 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.950582 17073 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.956529 17135 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:20.960270 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:20.962061 16999 tablet_bootstrap.cc:654] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:20.965325 16924 leader_election.cc:343] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.970024 17121 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.971554 16804 raft_consensus.cc:2393] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:18:20.971899 16924 leader_election.cc:343] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.972307 16924 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:20.972958 17135 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:20.974031 16924 leader_election.cc:343] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:20.974388 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:20.955464 17234 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:20.976197 17077 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.976823 17077 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.976903 17234 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:20.977202 16706 catalog_manager.cc:5697] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:20.979328 17135 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:20.988236 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:20.988765 16880 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:20.996706 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:20.997655 16957 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:20.998759 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:20.996687 16850 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:20.982008 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:21.006366 17121 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:20.992313 17077 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:18:21.010242 16850 leader_election.cc:343] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.004506 17233 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:18:21.026163 16924 leader_election.cc:343] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.026585 17002 tablet_bootstrap.cc:654] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.026592 16924 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:21.027815 17135 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.029152 17135 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.029578 17135 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.061954 17001 tablet_bootstrap.cc:654] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.024199 17121 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:18:21.065757 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:21.066506 16951 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.035195 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:21.035159 17135 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:21.055960 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:21.070055 16924 leader_election.cc:343] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:21.070714 16924 leader_election.cc:343] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.071040 16924 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:21.034780 17241 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:18:21.073547 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:21.076272 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:21.076817 16953 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:21.072695 17135 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.081087 16880 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:21.082217 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:21.084664 17002 tablet_bootstrap.cc:492] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:21.085036 17002 ts_tablet_manager.cc:1403] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.213s	user 0.023s	sys 0.013s
I20260709 13:18:21.084213 17239 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.085740 17239 raft_consensus.cc:697] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:21.086562 17239 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.088917 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:21.089565 16953 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:21.093448 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:21.094257 17121 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.096271 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:21.094678 17121 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.101361 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:21.101974 16957 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.103087 16951 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:21.105376 17202 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.105748 16850 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:21.106479 17202 raft_consensus.cc:2764] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:18:21.107575 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:21.116379 17234 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.121318 17234 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.121688 17234 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.100673 17121 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.143028 16957 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:21.143813 17002 raft_consensus.cc:359] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.145254 17002 raft_consensus.cc:385] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.145576 17002 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.146404 17002 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.148507 17002 ts_tablet_manager.cc:1434] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:18:21.149351 17002 tablet_bootstrap.cc:492] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:21.158113 16999 tablet_bootstrap.cc:492] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:21.158577 16999 ts_tablet_manager.cc:1403] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.302s	user 0.009s	sys 0.020s
I20260709 13:18:21.163718 16999 raft_consensus.cc:359] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.164368 16999 raft_consensus.cc:385] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.164639 16999 raft_consensus.cc:740] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.165295 16999 consensus_queue.cc:260] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.167891 16999 ts_tablet_manager.cc:1434] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:18:21.167706 17234 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.168772 16999 tablet_bootstrap.cc:492] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:21.168845 17001 tablet_bootstrap.cc:492] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:21.170621 17001 ts_tablet_manager.cc:1403] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.244s	user 0.014s	sys 0.008s
I20260709 13:18:21.182602 17121 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.183813 17001 raft_consensus.cc:359] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.184564 17001 raft_consensus.cc:385] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.184659 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:21.184912 17001 raft_consensus.cc:740] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.185463 17002 tablet_bootstrap.cc:654] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:21.185793 16850 leader_election.cc:343] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.185907 17001 consensus_queue.cc:260] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.189431 17234 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.189643 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:21.190070 17001 ts_tablet_manager.cc:1434] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:18:21.190212 16958 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.190697 16999 tablet_bootstrap.cc:654] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.191355 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:21.190959 17001 tablet_bootstrap.cc:492] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:21.191942 16880 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.198318 16958 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:21.198928 16880 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:21.199430 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:21.207031 17121 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.213603 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:21.214651 17121 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.215205 17121 raft_consensus.cc:697] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:21.216439 17121 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.211165 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:21.235977 16958 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.213089 17234 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.240377 17234 raft_consensus.cc:697] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:21.241516 17234 consensus_queue.cc:237] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.254583 17241 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:21.256999 17001 tablet_bootstrap.cc:654] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.257755 17002 tablet_bootstrap.cc:492] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:21.258185 17002 ts_tablet_manager.cc:1403] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.020s
I20260709 13:18:21.261555 17002 raft_consensus.cc:359] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.262223 17002 raft_consensus.cc:385] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.270711 16999 tablet_bootstrap.cc:492] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:21.271198 16999 ts_tablet_manager.cc:1403] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.021s
I20260709 13:18:21.272933 17001 tablet_bootstrap.cc:492] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:21.273442 17001 ts_tablet_manager.cc:1403] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.002s
I20260709 13:18:21.273923 16999 raft_consensus.cc:359] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.274593 16999 raft_consensus.cc:385] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.274902 16999 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.275532 16999 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.276350 17001 raft_consensus.cc:359] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.277058 17001 raft_consensus.cc:385] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.277501 16999 ts_tablet_manager.cc:1434] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:18:21.277380 17001 raft_consensus.cc:740] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.277320 17073 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:21.262473 17002 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.278532 17001 consensus_queue.cc:260] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.279376 17002 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.283026 16708 catalog_manager.cc:5697] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:18:21.284024 17002 ts_tablet_manager.cc:1434] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:18:21.285017 17002 tablet_bootstrap.cc:492] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:21.285023 17001 ts_tablet_manager.cc:1434] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:18:21.286336 17001 tablet_bootstrap.cc:492] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
W20260709 13:18:21.287838 16756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:21.278545 16999 tablet_bootstrap.cc:492] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:21.297327 17001 tablet_bootstrap.cc:654] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.299299 16999 tablet_bootstrap.cc:654] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.301280 16958 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:21.303292 17002 tablet_bootstrap.cc:654] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.315656 17001 tablet_bootstrap.cc:492] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:21.303903 16706 catalog_manager.cc:5697] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.319275 16706 catalog_manager.cc:5697] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.321310 16706 catalog_manager.cc:5697] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.323813 17001 ts_tablet_manager.cc:1403] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.001s
I20260709 13:18:21.326402 17001 raft_consensus.cc:359] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.327108 17001 raft_consensus.cc:385] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.327376 17001 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.328421 16999 tablet_bootstrap.cc:492] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:21.328621 17002 tablet_bootstrap.cc:492] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:21.328894 16999 ts_tablet_manager.cc:1403] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.051s	user 0.021s	sys 0.008s
I20260709 13:18:21.329020 17002 ts_tablet_manager.cc:1403] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.002s
I20260709 13:18:21.333938 17002 raft_consensus.cc:359] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.334553 17002 raft_consensus.cc:385] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.334792 17002 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.340162 17001 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.331606 16999 raft_consensus.cc:359] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.341150 16999 raft_consensus.cc:385] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.341454 16999 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.341702 17073 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.342344 16999 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.345220 17001 ts_tablet_manager.cc:1434] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:18:21.344657 16707 catalog_manager.cc:5697] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.346956 16707 catalog_manager.cc:5697] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.348450 17001 tablet_bootstrap.cc:492] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:21.356727 16999 ts_tablet_manager.cc:1434] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:18:21.357651 16999 tablet_bootstrap.cc:492] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:21.340324 17002 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.362691 17002 ts_tablet_manager.cc:1434] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:18:21.363543 17002 tablet_bootstrap.cc:492] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:21.367851 17001 tablet_bootstrap.cc:654] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.371526 17002 tablet_bootstrap.cc:654] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.374370 17241 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:21.381708 17001 tablet_bootstrap.cc:492] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:21.382220 17001 ts_tablet_manager.cc:1403] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.005s
I20260709 13:18:21.384907 17001 raft_consensus.cc:359] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.388502 17001 raft_consensus.cc:385] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.388904 17001 raft_consensus.cc:740] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.397277 17002 tablet_bootstrap.cc:492] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:21.397734 17002 ts_tablet_manager.cc:1403] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.010s
I20260709 13:18:21.389591 17001 consensus_queue.cc:260] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.400228 17002 raft_consensus.cc:359] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.401973 17002 raft_consensus.cc:385] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.402248 17002 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.402328 17234 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.402889 17002 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.407038 17001 ts_tablet_manager.cc:1434] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:18:21.408079 17001 tablet_bootstrap.cc:492] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:21.367465 16999 tablet_bootstrap.cc:654] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.416558 17121 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.417091 17121 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.420668 17002 ts_tablet_manager.cc:1434] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 13:18:21.421697 17121 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.423115 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:21.423074 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:21.423799 16958 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:21.424018 16883 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:21.425207 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:21.421695 17002 tablet_bootstrap.cc:492] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:21.428164 17121 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.428612 17121 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.429613 17121 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.436719 17121 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.439146 17121 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.439695 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:21.440941 17234 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.441227 16880 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.441448 17234 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.442257 17001 tablet_bootstrap.cc:654] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.447276 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:21.447872 16951 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.449203 17234 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.449379 16880 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:21.450170 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:21.450906 16958 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:21.452769 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:21.453449 17234 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.453788 17234 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.454123 17234 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.454661 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:21.456461 16951 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:21.462046 17002 tablet_bootstrap.cc:654] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.462528 17121 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.464037 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:21.465862 16999 tablet_bootstrap.cc:492] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:21.466279 16999 ts_tablet_manager.cc:1403] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.109s	user 0.005s	sys 0.005s
I20260709 13:18:21.463799 17121 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:21.467765 17121 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.470610 17202 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.466321 17234 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.473073 17234 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.474823 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:21.475492 16958 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.476030 16999 raft_consensus.cc:359] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.476678 16999 raft_consensus.cc:385] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.476923 16999 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.477989 17002 tablet_bootstrap.cc:492] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:21.478408 17002 ts_tablet_manager.cc:1403] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.005s
I20260709 13:18:21.479161 16999 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.481264 16999 ts_tablet_manager.cc:1434] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:18:21.482177 16999 tablet_bootstrap.cc:492] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:21.482456 17002 raft_consensus.cc:359] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.483069 17002 raft_consensus.cc:385] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.483323 17002 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.489563 16958 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
W20260709 13:18:21.492179 16850 leader_election.cc:343] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.483952 17002 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.495496 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:21.494549 16704 catalog_manager.cc:5697] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.496110 16810 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.496378 17001 tablet_bootstrap.cc:492] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:21.496784 17001 ts_tablet_manager.cc:1403] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.089s	user 0.006s	sys 0.007s
I20260709 13:18:21.497313 17002 ts_tablet_manager.cc:1434] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:18:21.498109 17002 tablet_bootstrap.cc:492] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:21.499287 17001 raft_consensus.cc:359] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.500046 17001 raft_consensus.cc:385] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.500324 17001 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.508250 16999 tablet_bootstrap.cc:654] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.510321 16810 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:21.516045 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:21.515787 17001 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.522218 17135 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.522675 17135 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.517556 17202 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.527274 17001 ts_tablet_manager.cc:1434] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:18:21.528313 17202 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:21.528590 17246 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.528174 17001 tablet_bootstrap.cc:492] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:21.528999 17246 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.532086 17135 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:21.529179 17202 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.533831 17246 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:21.535660 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:21.535966 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:21.536568 16883 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
W20260709 13:18:21.537976 16924 leader_election.cc:343] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.543207 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:21.547817 17241 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.548285 17241 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.552814 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:21.552975 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:21.554273 16804 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:21.554920 17241 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:18:21.555505 16924 leader_election.cc:343] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.556334 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:21.556736 17002 tablet_bootstrap.cc:654] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.556066 17250 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:21.557909 17135 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.558282 17135 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.558632 17135 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.564567 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:21.565291 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:21.547084 17246 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.566290 17246 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.566660 17246 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.567759 17237 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:21.569813 16775 leader_election.cc:343] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.568239 17237 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.575150 17250 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.575584 17250 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.587885 17250 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.589176 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:21.589457 16704 catalog_manager.cc:5697] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.591110 17237 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:18:21.595983 16775 leader_election.cc:343] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.604177 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:21.605193 16999 tablet_bootstrap.cc:492] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:21.605968 16999 ts_tablet_manager.cc:1403] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.000s
W20260709 13:18:21.608354 16924 leader_election.cc:343] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.610819 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:21.611392 16958 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:21.619899 17135 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.621004 16957 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:18:21.608796 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:21.625326 16924 leader_election.cc:343] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.625699 16924 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:21.626766 17057 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.631959 16999 raft_consensus.cc:359] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.632705 16999 raft_consensus.cc:385] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.632833 16804 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.632961 16999 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.633955 17001 tablet_bootstrap.cc:654] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.633822 16999 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.635322 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:21.637161 16999 ts_tablet_manager.cc:1434] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:18:21.638581 17135 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:21.639994 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:21.639561 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:21.648452 17250 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.648916 17250 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.638074 16999 tablet_bootstrap.cc:492] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:21.646924 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:21.648490 16810 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.653143 17121 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.655299 17002 tablet_bootstrap.cc:492] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:21.655766 17002 ts_tablet_manager.cc:1403] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.158s	user 0.022s	sys 0.015s
I20260709 13:18:21.650395 17250 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.658457 17202 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:21.662002 16924 leader_election.cc:343] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.668787 17246 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.684643 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:21.685837 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:21.686364 16883 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:21.686456 16924 leader_election.cc:343] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.679800 16810 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:21.702069 17135 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.702332 17073 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.670748 17246 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:21.702595 17135 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.703260 17002 raft_consensus.cc:359] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.703914 17002 raft_consensus.cc:385] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.704176 17002 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.704550 17135 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:21.704782 17002 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.706686 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:21.707294 16999 tablet_bootstrap.cc:654] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.707165 16883 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:21.708942 17001 tablet_bootstrap.cc:492] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:21.710719 17001 ts_tablet_manager.cc:1403] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.183s	user 0.028s	sys 0.000s
I20260709 13:18:21.709213 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:21.709337 17135 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.715008 17002 ts_tablet_manager.cc:1434] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
W20260709 13:18:21.716569 16924 leader_election.cc:343] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.719966 17002 tablet_bootstrap.cc:492] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:21.722637 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:21.720350 17135 raft_consensus.cc:697] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:21.725397 17135 consensus_queue.cc:237] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.724131 17057 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.728289 17057 raft_consensus.cc:697] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:21.729087 17057 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.713968 17233 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:18:21.735394 17239 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.735914 17239 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.730022 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:21.737699 16924 leader_election.cc:343] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.737862 17239 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.738108 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:21.738060 17250 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.739444 17237 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:21.740763 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:21.744750 17001 raft_consensus.cc:359] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.745409 17001 raft_consensus.cc:385] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.745668 17001 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.746325 17001 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.752429 17250 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.753751 17002 tablet_bootstrap.cc:654] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.755537 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:21.758705 17001 ts_tablet_manager.cc:1434] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:18:21.759600 17001 tablet_bootstrap.cc:492] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:21.758253 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:21.762706 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:21.762890 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:21.763422 16958 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:21.765265 16775 leader_election.cc:343] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.761132 17250 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:18:21.775550 16958 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:21.776765 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:21.781404 17073 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.788501 17073 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:21.789330 17073 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.815088 17233 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.815546 17233 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.817512 17233 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.819538 17002 tablet_bootstrap.cc:492] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:21.820068 17002 ts_tablet_manager.cc:1403] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.005s
I20260709 13:18:21.822075 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:21.822753 16957 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:21.827688 17002 raft_consensus.cc:359] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.828451 17002 raft_consensus.cc:385] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.828737 17002 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.829408 17002 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.831447 17002 ts_tablet_manager.cc:1434] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 13:18:21.823917 17121 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:21.832434 17002 tablet_bootstrap.cc:492] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:21.833405 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:21.834235 17202 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.834596 17202 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.834908 17202 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.835460 17001 tablet_bootstrap.cc:654] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.840174 16999 tablet_bootstrap.cc:492] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:21.840700 16999 ts_tablet_manager.cc:1403] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.203s	user 0.020s	sys 0.013s
I20260709 13:18:21.848860 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:21.849785 17202 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.850418 16999 raft_consensus.cc:359] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.851052 16999 raft_consensus.cc:385] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.851321 16999 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
W20260709 13:18:21.856926 16850 leader_election.cc:343] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.858156 17202 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.858582 16999 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.860693 17121 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.864059 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:21.864601 16957 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.867811 17121 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.868577 17121 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.870877 17121 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.871891 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:21.873281 16999 ts_tablet_manager.cc:1434] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:18:21.874183 16999 tablet_bootstrap.cc:492] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
W20260709 13:18:21.876613 16850 leader_election.cc:343] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:21.878203 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:21.878844 16878 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:21.880069 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:21.883962 17121 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:21.884246 17121 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.884500 17121 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.879652 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:21.888041 16954 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:21.892395 16957 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:21.892545 17121 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.893095 17001 tablet_bootstrap.cc:492] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:21.893667 17001 ts_tablet_manager.cc:1403] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.134s	user 0.009s	sys 0.007s
I20260709 13:18:21.893617 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:21.894423 17077 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.895064 17121 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:21.875525 16704 catalog_manager.cc:5697] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:21.896423 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:21.896981 16878 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.897420 17077 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:21.898866 17077 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.898535 16704 catalog_manager.cc:5697] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:21.900625 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:21.901106 17002 tablet_bootstrap.cc:654] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.901177 16954 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:21.904070 17001 raft_consensus.cc:359] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.904699 17001 raft_consensus.cc:385] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:21.904989 17001 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:21.905592 17001 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.907593 17001 ts_tablet_manager.cc:1434] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.000s
I20260709 13:18:21.909125 17001 tablet_bootstrap.cc:492] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:21.912565 16999 tablet_bootstrap.cc:654] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:21.913848 16878 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:21.918736 16954 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:21.920127 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:21.923454 17301 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:21.938997 16708 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.941979 17301 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:21.945690 17301 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:21.948624 17121 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:21.955029 16707 catalog_manager.cc:5697] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.962327 17234 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:21.973624 17073 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:22.076552 17135 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.078125 17135 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:22.082662 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 112287us
I20260709 13:18:22.091456 17001 tablet_bootstrap.cc:700] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent opening tablet: real 0.105s	user 0.005s	sys 0.001s
I20260709 13:18:22.092670 17001 tablet_bootstrap.cc:654] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.093456 17002 tablet_bootstrap.cc:492] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:22.095117 17002 ts_tablet_manager.cc:1403] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.263s	user 0.015s	sys 0.017s
I20260709 13:18:22.121802 16999 tablet_bootstrap.cc:492] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:22.122730 16999 ts_tablet_manager.cc:1403] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.249s	user 0.012s	sys 0.006s
I20260709 13:18:22.139845 17135 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:22.146797 17002 raft_consensus.cc:359] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.156715 17002 raft_consensus.cc:385] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.158912 17002 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.168903 17301 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.169661 17301 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.172996 17001 tablet_bootstrap.cc:492] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:22.172817 17301 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:22.179400 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:22.185592 16924 leader_election.cc:343] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.187743 16999 raft_consensus.cc:359] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.188366 16999 raft_consensus.cc:385] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.188539 16999 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.189654 17001 ts_tablet_manager.cc:1403] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.281s	user 0.024s	sys 0.006s
I20260709 13:18:22.193192 17001 raft_consensus.cc:359] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.193948 17001 raft_consensus.cc:385] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.194262 17001 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.194993 17001 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.198727 17001 ts_tablet_manager.cc:1434] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:18:22.198832 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:22.188971 16999 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.200760 17001 tablet_bootstrap.cc:492] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:22.208461 17002 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.210280 17002 ts_tablet_manager.cc:1434] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.115s	user 0.010s	sys 0.001s
I20260709 13:18:22.211597 17002 tablet_bootstrap.cc:492] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:22.215653 16999 ts_tablet_manager.cc:1434] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.093s	user 0.003s	sys 0.004s
I20260709 13:18:22.217075 16999 tablet_bootstrap.cc:492] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:22.216223 16707 catalog_manager.cc:5697] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:22.254101 16924 leader_election.cc:343] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.254587 16924 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:22.255391 17237 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.260001 17135 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.260522 17135 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.263202 17233 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.264271 17233 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.267616 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:22.266140 17237 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:18:22.269174 16881 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:18:22.261049 16804 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.267181 17233 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:22.274688 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:22.273860 17057 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:22.280650 17001 tablet_bootstrap.cc:654] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.283262 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:22.285903 16924 consensus_peers.cc:597] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:22.302716 16924 leader_election.cc:343] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.304338 16999 tablet_bootstrap.cc:654] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.312887 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:22.282748 17135 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:22.316223 16951 raft_consensus.cc:2393] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 1: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:22.333221 17002 tablet_bootstrap.cc:654] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.337389 17135 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.337900 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:22.353787 16924 leader_election.cc:343] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.354214 16924 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:22.355388 17057 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.364289 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:22.367970 17234 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:22.372651 16880 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.380069 17135 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.380690 17135 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.385739 17057 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.386258 17057 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.388263 17057 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:22.389133 17135 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:22.409035 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:22.411585 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:22.412201 16804 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:22.413281 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:22.415824 17318 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.417547 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:22.418308 17057 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:22.418653 17057 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.418977 17057 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.416302 17318 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.423689 17318 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:22.424484 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:22.424588 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:22.425352 16951 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
W20260709 13:18:22.426131 16924 leader_election.cc:343] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.427626 16850 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:18:22.427019 16924 leader_election.cc:343] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.428736 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:18:22.429980 16924 leader_election.cc:343] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.430315 16924 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:22.428887 17318 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:22.431700 17237 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.435132 17318 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.435519 17318 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:22.440663 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 71843.9us
I20260709 13:18:22.442435 17239 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.444049 17239 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.447150 17001 tablet_bootstrap.cc:492] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:22.447929 17002 tablet_bootstrap.cc:492] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:22.452013 17002 ts_tablet_manager.cc:1403] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.241s	user 0.010s	sys 0.007s
I20260709 13:18:22.453959 17002 raft_consensus.cc:359] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.454324 17121 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.454581 17002 raft_consensus.cc:385] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.454836 17002 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.456027 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:22.448094 16999 tablet_bootstrap.cc:492] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:22.457166 16999 ts_tablet_manager.cc:1403] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.240s	user 0.026s	sys 0.013s
I20260709 13:18:22.459908 16999 raft_consensus.cc:359] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.460531 16999 raft_consensus.cc:385] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.460798 16999 raft_consensus.cc:740] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.462239 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:22.464351 16999 consensus_queue.cc:260] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.455448 17002 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.467331 16999 ts_tablet_manager.cc:1434] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:18:22.467990 17002 ts_tablet_manager.cc:1434] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:18:22.471285 17002 tablet_bootstrap.cc:492] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
W20260709 13:18:22.472692 16850 leader_election.cc:343] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.449898 17318 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.472978 17077 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:22.473551 16850 consensus_peers.cc:597] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:22.474954 17318 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:22.471791 17001 ts_tablet_manager.cc:1403] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.271s	user 0.011s	sys 0.017s
I20260709 13:18:22.448446 17057 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.468451 16999 tablet_bootstrap.cc:492] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:22.480593 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:22.481191 16951 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.481747 17057 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:18:22.479024 16756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:22.476838 17233 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.482981 17233 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.485327 17233 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:22.486800 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:22.487452 16957 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:22.489444 16850 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:22.491829 17233 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:22.492597 17233 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.492910 17233 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.496037 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:22.496640 16810 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.496764 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:22.498281 17001 raft_consensus.cc:359] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.499585 17318 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:22.499888 17001 raft_consensus.cc:385] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.500262 17001 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.502144 17001 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.502506 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:22.499428 16951 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:22.502396 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:22.501520 17002 tablet_bootstrap.cc:654] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.505167 17001 ts_tablet_manager.cc:1434] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.002s
I20260709 13:18:22.505589 17233 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.506274 17001 tablet_bootstrap.cc:492] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:22.509158 16850 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:22.512235 17234 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:22.512883 17234 raft_consensus.cc:697] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:22.513761 17234 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.514508 17002 tablet_bootstrap.cc:492] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:22.514926 17002 ts_tablet_manager.cc:1403] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.005s
I20260709 13:18:22.519343 17241 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:22.522392 16999 tablet_bootstrap.cc:654] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:22.525310 16924 leader_election.cc:343] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.528084 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:22.528627 16957 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:22.533071 16850 leader_election.cc:343] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.527773 17001 tablet_bootstrap.cc:654] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:22.534432 16850 leader_election.cc:343] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.540215 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:18:22.542584 16850 leader_election.cc:343] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.538626 17233 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:22.547776 16810 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:22.572144 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:22.580541 17002 raft_consensus.cc:359] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.587610 17002 raft_consensus.cc:385] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.588001 17002 raft_consensus.cc:740] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.586764 17135 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:22.601814 17002 consensus_queue.cc:260] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.608223 17135 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:22.609226 16957 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:22.609436 17135 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.635556 17001 tablet_bootstrap.cc:492] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:22.636134 17001 ts_tablet_manager.cc:1403] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.130s	user 0.008s	sys 0.013s
I20260709 13:18:22.644351 17002 ts_tablet_manager.cc:1434] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.002s
W20260709 13:18:22.648694 17328 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:22.656005 17002 tablet_bootstrap.cc:492] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:22.655911 17057 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.660763 16850 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:22.665063 16999 tablet_bootstrap.cc:492] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:22.665712 16999 ts_tablet_manager.cc:1403] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.197s	user 0.037s	sys 0.023s
I20260709 13:18:22.666087 17334 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:22.668785 17334 raft_consensus.cc:697] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:22.670181 16999 raft_consensus.cc:359] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.669628 17334 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.662190 17057 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.672413 16999 raft_consensus.cc:385] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.672722 16999 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.675163 16999 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.676851 17001 raft_consensus.cc:359] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.677510 17001 raft_consensus.cc:385] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.677755 17001 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.678404 16999 ts_tablet_manager.cc:1434] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:18:22.673812 17057 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:22.679430 16999 tablet_bootstrap.cc:492] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:22.678356 17001 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.680703 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:22.681824 17001 ts_tablet_manager.cc:1434] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:18:22.682633 17246 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.683066 17246 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.689034 17246 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:22.689666 16999 tablet_bootstrap.cc:654] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:22.698348 16924 leader_election.cc:343] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.702278 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:22.706693 16924 leader_election.cc:343] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.709033 17002 tablet_bootstrap.cc:654] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.720242 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:22.721889 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:22.730394 16924 leader_election.cc:343] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.730958 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:18:22.733909 16924 leader_election.cc:343] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.734287 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:22.734642 17246 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.735257 17246 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.745539 17001 tablet_bootstrap.cc:492] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:22.755203 17313 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:18:22.761072 16707 catalog_manager.cc:5697] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.787478 17001 tablet_bootstrap.cc:654] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.800222 16999 tablet_bootstrap.cc:492] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:22.800700 16999 ts_tablet_manager.cc:1403] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.016s
I20260709 13:18:22.803627 16999 raft_consensus.cc:359] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.804313 17002 tablet_bootstrap.cc:492] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:22.804301 16999 raft_consensus.cc:385] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.804785 16999 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.804951 17002 ts_tablet_manager.cc:1403] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.150s	user 0.020s	sys 0.012s
I20260709 13:18:22.805656 17001 tablet_bootstrap.cc:492] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:22.805544 16999 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.806222 17001 ts_tablet_manager.cc:1403] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.006s
I20260709 13:18:22.807611 16999 ts_tablet_manager.cc:1434] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:18:22.807802 17002 raft_consensus.cc:359] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.808425 17002 raft_consensus.cc:385] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.808622 16999 tablet_bootstrap.cc:492] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:22.808691 17002 raft_consensus.cc:740] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.809501 17002 consensus_queue.cc:260] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.811751 17002 ts_tablet_manager.cc:1434] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:18:22.812780 17002 tablet_bootstrap.cc:492] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:22.815327 16999 tablet_bootstrap.cc:654] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.818845 17002 tablet_bootstrap.cc:654] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.809424 17001 raft_consensus.cc:359] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.822335 17001 raft_consensus.cc:385] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.822678 17001 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.823549 17001 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.826306 17001 ts_tablet_manager.cc:1434] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:18:22.827562 17001 tablet_bootstrap.cc:492] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:22.835502 17001 tablet_bootstrap.cc:654] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.836283 16999 tablet_bootstrap.cc:492] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:22.836757 16999 ts_tablet_manager.cc:1403] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.013s
I20260709 13:18:22.837713 17002 tablet_bootstrap.cc:492] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:22.838150 17002 ts_tablet_manager.cc:1403] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.007s
I20260709 13:18:22.840428 16999 raft_consensus.cc:359] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.842458 17121 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.842929 17121 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.844753 17121 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:22.846771 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:22.840950 17002 raft_consensus.cc:359] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.847129 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:22.847370 16885 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:22.847497 17002 raft_consensus.cc:385] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.847862 17002 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.848574 17002 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.847841 16952 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:22.850136 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:22.850962 17002 ts_tablet_manager.cc:1434] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:18:22.851020 17121 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:22.851410 17121 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.851783 17121 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.852231 17002 tablet_bootstrap.cc:492] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:22.855105 16704 catalog_manager.cc:5697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.859253 17002 tablet_bootstrap.cc:654] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.861240 17121 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.864246 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:22.841069 16999 raft_consensus.cc:385] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.864260 17001 tablet_bootstrap.cc:492] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:22.873624 17001 ts_tablet_manager.cc:1403] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 13:18:22.864981 16885 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.876763 16707 catalog_manager.cc:5697] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.865689 16999 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.880081 17001 raft_consensus.cc:359] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.880951 17001 raft_consensus.cc:385] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.881227 17001 raft_consensus.cc:740] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.880760 16999 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.867203 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:22.882084 16952 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.882999 16999 ts_tablet_manager.cc:1434] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.002s
I20260709 13:18:22.884099 16999 tablet_bootstrap.cc:492] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:22.884161 17001 consensus_queue.cc:260] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.886466 17001 ts_tablet_manager.cc:1434] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:18:22.887491 17001 tablet_bootstrap.cc:492] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:22.869350 17002 tablet_bootstrap.cc:492] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:22.888967 17002 ts_tablet_manager.cc:1403] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.005s
I20260709 13:18:22.889326 17295 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.889796 17295 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.891804 16999 tablet_bootstrap.cc:654] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.892110 17002 raft_consensus.cc:359] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.892901 17002 raft_consensus.cc:385] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.893208 17002 raft_consensus.cc:740] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.893903 17002 consensus_queue.cc:260] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.902161 17002 ts_tablet_manager.cc:1434] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:18:22.903074 17002 tablet_bootstrap.cc:492] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:22.903321 17301 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.895946 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:22.903836 17301 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.896817 17295 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:22.906102 17301 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:22.867274 17121 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:22.898880 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:22.906754 16951 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 0.
I20260709 13:18:22.907505 16952 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:22.909262 17002 tablet_bootstrap.cc:654] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:22.912703 16775 leader_election.cc:343] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.912699 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:22.913688 17002 tablet_bootstrap.cc:492] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:22.914094 17002 ts_tablet_manager.cc:1403] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:18:22.915033 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:22.915766 16951 raft_consensus.cc:2393] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:22.917523 17002 raft_consensus.cc:359] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.918145 17002 raft_consensus.cc:385] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.918392 17002 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.919091 17002 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.920771 17002 ts_tablet_manager.cc:1434] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:18:22.921613 17002 tablet_bootstrap.cc:492] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:22.923193 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:22.923913 17295 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:22.924254 17295 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.924582 17295 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.927286 17002 tablet_bootstrap.cc:654] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.932217 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:22.933199 17121 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:22.933594 17121 raft_consensus.cc:697] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:22.934310 17121 consensus_queue.cc:237] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.937999 17002 tablet_bootstrap.cc:492] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:22.938501 17002 ts_tablet_manager.cc:1403] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:18:22.941287 17002 raft_consensus.cc:359] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.941915 17002 raft_consensus.cc:385] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.942166 17002 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.942775 17002 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.944355 17002 ts_tablet_manager.cc:1434] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:18:22.945250 17002 tablet_bootstrap.cc:492] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:22.946712 16999 tablet_bootstrap.cc:492] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:22.946950 16775 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:22.900451 17001 tablet_bootstrap.cc:654] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.947155 16999 ts_tablet_manager.cc:1403] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.063s	user 0.006s	sys 0.008s
I20260709 13:18:22.898960 16885 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:22.949754 17239 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:22.950687 16999 raft_consensus.cc:359] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.951366 16999 raft_consensus.cc:385] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.951623 16999 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.952265 16999 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.954315 16999 ts_tablet_manager.cc:1434] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:18:22.954550 17341 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.955412 16999 tablet_bootstrap.cc:492] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:22.955030 17341 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.956452 17301 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.957580 17341 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:22.959350 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:22.961607 16924 leader_election.cc:343] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.961824 16999 tablet_bootstrap.cc:654] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.962601 17002 tablet_bootstrap.cc:654] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.967360 17001 tablet_bootstrap.cc:492] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:22.967801 17001 ts_tablet_manager.cc:1403] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.003s
I20260709 13:18:22.970804 17239 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.972019 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:22.972759 17001 raft_consensus.cc:359] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:22.973299 16924 leader_election.cc:343] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:22.973382 17001 raft_consensus.cc:385] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:22.973049 16707 catalog_manager.cc:5697] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:22.973752 16924 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:22.974680 17341 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:22.973750 17001 raft_consensus.cc:740] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:22.976045 17001 consensus_queue.cc:260] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.978318 17001 ts_tablet_manager.cc:1434] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:18:22.980309 17001 tablet_bootstrap.cc:492] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:22.931141 17295 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.983894 17301 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:22.986471 17301 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:22.990621 17001 tablet_bootstrap.cc:654] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:22.994596 17295 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.010664 17002 tablet_bootstrap.cc:492] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:23.011138 17002 ts_tablet_manager.cc:1403] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.066s	user 0.003s	sys 0.013s
I20260709 13:18:23.013797 17002 raft_consensus.cc:359] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.014290 17002 raft_consensus.cc:385] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.014519 17002 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.015074 17002 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.016407 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:23.017228 17002 ts_tablet_manager.cc:1434] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:18:23.018446 17002 tablet_bootstrap.cc:492] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:23.018800 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:23.019387 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:23.020030 16885 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.022300 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:23.022822 16951 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.029595 17337 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.030063 17337 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.032138 17337 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.033396 16885 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:23.035032 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:23.035610 16952 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:23.038264 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:23.039692 17337 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:23.040024 17337 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.040318 17337 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.044982 17001 tablet_bootstrap.cc:492] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:23.045401 17001 ts_tablet_manager.cc:1403] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.065s	user 0.006s	sys 0.012s
I20260709 13:18:23.046353 17318 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.046793 17318 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.046949 16775 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:23.047945 17001 raft_consensus.cc:359] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.048597 17001 raft_consensus.cc:385] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.048851 17001 raft_consensus.cc:740] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.048902 17318 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.049113 17295 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.050439 16999 tablet_bootstrap.cc:492] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:23.050864 16999 ts_tablet_manager.cc:1403] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.096s	user 0.022s	sys 0.040s
I20260709 13:18:23.052193 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:23.052492 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:23.053710 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:23.055804 17334 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.056226 17334 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.054878 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:23.057296 17337 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.058051 17301 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:23.058501 17301 raft_consensus.cc:697] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:23.058765 17334 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.059182 17337 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.059721 17337 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.059422 17301 consensus_queue.cc:237] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.060120 17337 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.061247 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:23.061904 16954 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.061995 17337 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.061069 16999 raft_consensus.cc:359] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.063026 16999 raft_consensus.cc:385] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.063088 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:23.063374 16999 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.064110 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:23.064994 17002 tablet_bootstrap.cc:654] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.064043 16999 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.066815 17001 consensus_queue.cc:260] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.053926 16951 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:23.067358 16999 ts_tablet_manager.cc:1434] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:18:23.068527 16999 tablet_bootstrap.cc:492] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:23.069120 16957 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:23.072309 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:23.073433 17233 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:23.073800 17233 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.074133 17233 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.076608 17001 ts_tablet_manager.cc:1434] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:18:23.077240 17341 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:23.078486 16999 tablet_bootstrap.cc:654] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.080667 17002 tablet_bootstrap.cc:492] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:23.081876 17002 ts_tablet_manager.cc:1403] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.000s
I20260709 13:18:23.084448 17002 raft_consensus.cc:359] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.085042 17002 raft_consensus.cc:385] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.085287 17002 raft_consensus.cc:740] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.085886 17002 consensus_queue.cc:260] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.081442 17001 tablet_bootstrap.cc:492] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:23.089810 16999 tablet_bootstrap.cc:492] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:23.090245 16999 ts_tablet_manager.cc:1403] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.001s
I20260709 13:18:23.090224 16883 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.093026 16999 raft_consensus.cc:359] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.093672 16999 raft_consensus.cc:385] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.093932 16999 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.094501 17001 tablet_bootstrap.cc:654] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.094599 16999 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.096069 17121 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.096494 17121 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.097312 17002 ts_tablet_manager.cc:1434] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:18:23.098161 17121 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.100641 16999 ts_tablet_manager.cc:1434] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:18:23.100953 17001 tablet_bootstrap.cc:492] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:23.101400 17001 ts_tablet_manager.cc:1403] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 13:18:23.101725 16999 tablet_bootstrap.cc:492] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:23.115293 17318 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:18:23.105126 17341 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:18:23.103940 17233 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.104723 17002 tablet_bootstrap.cc:492] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:23.109539 16999 tablet_bootstrap.cc:654] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.115290 17342 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.103848 17001 raft_consensus.cc:359] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.119776 17001 raft_consensus.cc:385] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.119537 17342 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.120049 17001 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.120745 17001 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.122835 17337 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:18:23.131299 16850 leader_election.cc:343] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.134899 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:23.135756 17337 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.142726 17001 ts_tablet_manager.cc:1434] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.041s	user 0.014s	sys 0.007s
I20260709 13:18:23.143134 17233 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.144184 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:23.145473 16999 tablet_bootstrap.cc:492] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
W20260709 13:18:23.145551 16924 leader_election.cc:343] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.145937 16999 ts_tablet_manager.cc:1403] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.044s	user 0.005s	sys 0.020s
I20260709 13:18:23.147109 17342 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:23.147737 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:23.148736 17002 tablet_bootstrap.cc:654] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:23.148917 16924 leader_election.cc:343] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.148622 16999 raft_consensus.cc:359] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.149384 16999 raft_consensus.cc:385] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.149317 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:23.149695 16999 raft_consensus.cc:740] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.150265 17342 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.150578 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:23.150583 16999 consensus_queue.cc:260] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.151324 16951 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.153003 16999 ts_tablet_manager.cc:1434] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:18:23.150960 16954 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:23.153925 16999 tablet_bootstrap.cc:492] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:23.160089 17337 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:23.161038 17002 tablet_bootstrap.cc:492] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:23.161480 17002 ts_tablet_manager.cc:1403] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.021s
I20260709 13:18:23.161893 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:23.162127 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:23.162686 16803 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.163086 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:23.163872 17337 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:23.164348 17337 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:23.165321 17001 tablet_bootstrap.cc:492] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:23.165241 17337 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.164476 17002 raft_consensus.cc:359] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.166936 17002 raft_consensus.cc:385] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.167207 17002 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.168839 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:23.180294 17301 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.180843 17301 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.200485 17002 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.202208 17301 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.208093 16999 tablet_bootstrap.cc:654] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.210547 17001 tablet_bootstrap.cc:654] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.209762 16704 catalog_manager.cc:5697] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.211118 17342 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.211570 17342 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.212399 16803 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:23.213500 17342 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:23.215579 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:23.162693 16810 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:23.216360 16876 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 0.
I20260709 13:18:23.220026 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:23.220595 16804 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.220918 16924 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:23.221958 17057 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:23.222319 17057 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.222651 17057 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.202515 17002 ts_tablet_manager.cc:1434] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:18:23.226263 17002 tablet_bootstrap.cc:492] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:23.227273 16804 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:23.228109 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:23.228781 17057 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.229974 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:23.230710 16954 raft_consensus.cc:2393] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:23.230836 17057 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:23.233304 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:23.234894 16951 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:23.235703 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:23.236409 16876 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.239436 17002 tablet_bootstrap.cc:654] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:23.240370 16924 leader_election.cc:343] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.241864 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:23.245060 17318 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.258216 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:23.268569 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:23.277866 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:23.284117 16885 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:23.288252 16924 leader_election.cc:343] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:23.297722 16775 leader_election.cc:343] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.310303 16999 tablet_bootstrap.cc:492] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:23.310782 16999 ts_tablet_manager.cc:1403] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.157s	user 0.018s	sys 0.005s
I20260709 13:18:23.310688 16876 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:23.326527 17342 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.327145 17339 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.327633 17339 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.329571 16999 raft_consensus.cc:359] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.330518 16999 raft_consensus.cc:385] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.330847 16999 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.333129 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:23.335037 16924 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:23.336027 17057 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:23.336512 17057 raft_consensus.cc:697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:23.334471 16999 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.337342 17057 consensus_queue.cc:237] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.342005 16999 ts_tablet_manager.cc:1434] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.001s
I20260709 13:18:23.343312 17001 tablet_bootstrap.cc:492] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:23.343768 17001 ts_tablet_manager.cc:1403] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.179s	user 0.010s	sys 0.049s
I20260709 13:18:23.340282 17233 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:23.346050 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:23.347234 17121 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.349885 16999 tablet_bootstrap.cc:492] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:23.350521 17339 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.351892 17233 raft_consensus.cc:697] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:23.352355 16810 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.352751 17233 consensus_queue.cc:237] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.327174 17342 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.356240 17342 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:23.357342 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:23.357820 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:23.357995 16806 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:23.358268 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:23.359300 16924 leader_election.cc:343] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:23.359951 16924 leader_election.cc:343] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.360306 16924 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:23.361389 17341 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:18:23.361547 16775 leader_election.cc:343] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:23.361953 16775 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:23.363118 17001 raft_consensus.cc:359] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.365096 17002 tablet_bootstrap.cc:492] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:23.366415 17001 raft_consensus.cc:385] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.366667 17002 ts_tablet_manager.cc:1403] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.141s	user 0.009s	sys 0.003s
I20260709 13:18:23.366807 17001 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.373062 17001 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.375056 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:23.377416 17002 raft_consensus.cc:359] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.371028 17301 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:23.378062 17002 raft_consensus.cc:385] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.378369 17002 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.375720 16957 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:23.379940 17002 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.382339 17002 ts_tablet_manager.cc:1434] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:18:23.386463 17002 tablet_bootstrap.cc:492] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:23.387471 17001 ts_tablet_manager.cc:1434] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:18:23.388386 17001 tablet_bootstrap.cc:492] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:23.389742 16850 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:23.392021 17376 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:23.395887 16999 tablet_bootstrap.cc:654] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.392386 17376 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.398208 17376 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.417119 17001 tablet_bootstrap.cc:654] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.450979 17337 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:23.453023 16810 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.450599 17376 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.456374 17376 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.456408 16707 catalog_manager.cc:5697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:23.463078 17002 tablet_bootstrap.cc:654] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:23.466320 17295 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.466784 17295 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.463027 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:23.468228 16951 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.468690 17295 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.472894 17334 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.479646 16951 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:23.481794 17334 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.490121 16850 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:23.491691 17233 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:23.492182 17233 raft_consensus.cc:697] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:23.493024 17233 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.494225 17318 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.494736 17318 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.491570 17334 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.499028 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:23.499647 16951 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:23.500830 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:23.501515 17339 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:23.501823 17339 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.502120 17339 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.506137 17318 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.480726 17295 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:18:23.557873 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:23.539954 16707 catalog_manager.cc:5697] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.688899 17339 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.691005 17339 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:23.692981 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:23.699599 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:23.700187 16804 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.700667 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:23.711092 16999 tablet_bootstrap.cc:492] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:23.711714 16999 ts_tablet_manager.cc:1403] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.362s	user 0.020s	sys 0.012s
I20260709 13:18:23.711426 16707 catalog_manager.cc:5697] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:23.739785 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:23.749094 16952 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.724309 16951 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:23.777351 17001 tablet_bootstrap.cc:492] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
W20260709 13:18:23.777592 16756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:23.777807 17001 ts_tablet_manager.cc:1403] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.390s	user 0.023s	sys 0.044s
I20260709 13:18:23.782711 16999 raft_consensus.cc:359] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.783581 16999 raft_consensus.cc:385] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.783934 16999 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.784657 16999 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.775053 17326 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.787652 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:23.796494 16806 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:23.796247 17326 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.805176 16999 ts_tablet_manager.cc:1434] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 13:18:23.814842 17002 tablet_bootstrap.cc:492] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:23.815318 17002 ts_tablet_manager.cc:1403] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.429s	user 0.012s	sys 0.055s
I20260709 13:18:23.824642 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:23.825693 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:23.826341 16808 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:23.826406 17002 raft_consensus.cc:359] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.827359 17002 raft_consensus.cc:385] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.828279 17002 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.822842 17001 raft_consensus.cc:359] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.830834 17001 raft_consensus.cc:385] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:23.831202 17001 raft_consensus.cc:740] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:23.832263 16999 tablet_bootstrap.cc:492] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:23.829579 17002 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:23.834532 16775 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:23.843873 17001 consensus_queue.cc:260] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:23.848081 17386 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:23.851531 17326 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:23.853538 17002 ts_tablet_manager.cc:1434] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 13:18:23.854734 17002 tablet_bootstrap.cc:492] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:23.856318 16804 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:23.883209 17001 ts_tablet_manager.cc:1434] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.105s	user 0.004s	sys 0.004s
W20260709 13:18:23.905030 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 64697.7us
I20260709 13:18:23.911204 16808 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:23.939807 17001 tablet_bootstrap.cc:492] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:23.946969 17389 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:18:23.996578 16999 tablet_bootstrap.cc:654] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:23.997043 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 46744.7us
I20260709 13:18:24.002391 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:24.025383 17002 tablet_bootstrap.cc:654] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.034823 17001 tablet_bootstrap.cc:654] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.041704 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:24.020954 17393 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.046486 17393 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.046926 17393 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.062400 16952 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
W20260709 13:18:24.070467 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 52753.2us
W20260709 13:18:24.071316 16850 leader_election.cc:343] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.083148 16999 tablet_bootstrap.cc:492] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:24.083642 16999 ts_tablet_manager.cc:1403] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.275s	user 0.035s	sys 0.018s
I20260709 13:18:24.087604 16999 raft_consensus.cc:359] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.088281 16999 raft_consensus.cc:385] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.088557 16999 raft_consensus.cc:740] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.089275 16999 consensus_queue.cc:260] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.091032 16999 ts_tablet_manager.cc:1434] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:18:24.119803 17121 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.115383 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:24.094146 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:24.146943 17376 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.147480 17376 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:24.126634 17387 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.097259 16924 leader_election.cc:343] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:18:24.148150 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 50920us
W20260709 13:18:24.148231 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 54145.4us
I20260709 13:18:24.148322 17376 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.148125 17387 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.116285 17393 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.150998 17387 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:24.151737 17393 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:24.151836 17341 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.121266 16999 tablet_bootstrap.cc:492] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:24.169081 17001 tablet_bootstrap.cc:492] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:24.169513 17001 ts_tablet_manager.cc:1403] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.264s	user 0.004s	sys 0.015s
I20260709 13:18:24.173024 16808 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.173898 17002 tablet_bootstrap.cc:492] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:24.174311 17002 ts_tablet_manager.cc:1403] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.320s	user 0.013s	sys 0.008s
I20260709 13:18:24.176702 17002 raft_consensus.cc:359] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.177310 17002 raft_consensus.cc:385] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.177556 17002 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.179225 17001 raft_consensus.cc:359] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.179862 17001 raft_consensus.cc:385] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.180117 17001 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.180895 17001 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.181830 17002 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.184732 17001 ts_tablet_manager.cc:1434] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:18:24.185678 17001 tablet_bootstrap.cc:492] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Bootstrap starting.
I20260709 13:18:24.186211 17121 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.186513 17393 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.186916 17002 ts_tablet_manager.cc:1434] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:18:24.186961 17393 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.189256 17002 tablet_bootstrap.cc:492] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:24.199813 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:24.200870 16959 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
W20260709 13:18:24.201583 16924 leader_election.cc:343] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.202013 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:24.202646 17402 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.202905 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:24.203563 16959 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.211781 17393 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:24.211584 17387 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.217039 16959 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:24.215567 16707 catalog_manager.cc:5697] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.220038 17341 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.221517 17341 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.221812 16707 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.223454 17341 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:24.223812 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:24.224090 17393 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.224555 17339 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.224944 17339 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.225267 17339 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.226248 17001 tablet_bootstrap.cc:654] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.219645 17002 tablet_bootstrap.cc:654] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.220393 17387 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.229228 16999 tablet_bootstrap.cc:654] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.236394 17339 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.240089 17402 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.241798 17387 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.245739 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:24.245920 17339 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:24.247475 17405 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.250000 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:24.257136 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:24.257777 16959 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:24.266891 16999 tablet_bootstrap.cc:492] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:24.267359 16999 ts_tablet_manager.cc:1403] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.007s
I20260709 13:18:24.269955 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:24.270557 16956 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.270257 16999 raft_consensus.cc:359] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.270983 16999 raft_consensus.cc:385] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.271267 16999 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.274893 17002 tablet_bootstrap.cc:492] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:24.275338 17002 ts_tablet_manager.cc:1403] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.000s
I20260709 13:18:24.278261 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:24.278573 16999 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.283967 17339 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.285545 17339 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:24.286477 17339 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:24.284044 16924 leader_election.cc:343] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.290547 16956 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:24.293146 17002 raft_consensus.cc:359] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.294070 17002 raft_consensus.cc:385] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.294852 17002 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.280386 16850 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:24.295655 17002 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.298990 17376 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.299949 17376 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.300386 17376 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.303787 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:24.304392 16806 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:24.304945 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:24.305642 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:24.306795 17002 ts_tablet_manager.cc:1434] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:18:24.307813 17002 tablet_bootstrap.cc:492] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
W20260709 13:18:24.313712 16924 leader_election.cc:343] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.315145 17002 tablet_bootstrap.cc:654] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.314312 16924 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:24.321965 16999 ts_tablet_manager.cc:1434] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:18:24.325376 17001 tablet_bootstrap.cc:492] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: No bootstrap required, opened a new log
I20260709 13:18:24.325830 17001 ts_tablet_manager.cc:1403] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent bootstrapping tablet: real 0.140s	user 0.010s	sys 0.025s
I20260709 13:18:24.314421 17393 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.319321 17341 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.328094 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:24.340472 17393 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:24.329617 17376 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.359220 16999 tablet_bootstrap.cc:492] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:24.363150 16707 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.351879 17337 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20260709 13:18:24.439007 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 94076.5us
W20260709 13:18:24.448455 16850 leader_election.cc:343] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.474989 16999 tablet_bootstrap.cc:654] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
W20260709 13:18:24.522755 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 74329.8us
I20260709 13:18:24.450649 17001 raft_consensus.cc:359] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.542127 17001 raft_consensus.cc:385] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.542450 17001 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.542964 17001 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.463156 17376 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:24.550278 17001 ts_tablet_manager.cc:1434] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent starting tablet: real 0.224s	user 0.014s	sys 0.025s
I20260709 13:18:24.461949 17388 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.204s
I20260709 13:18:24.571142 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:24.571868 16958 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.465760 17393 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.576946 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:24.577575 16808 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:24.618723 17422 log.cc:927] Time spent T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.202s	user 0.004s	sys 0.000s
I20260709 13:18:24.632983 16958 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:24.615504 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:18:24.643440 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 78442.5us
I20260709 13:18:24.646201 17002 tablet_bootstrap.cc:492] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:24.647886 17002 ts_tablet_manager.cc:1403] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.340s	user 0.022s	sys 0.011s
W20260709 13:18:24.637562 17435 log.cc:927] Time spent T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:24.660908 16999 tablet_bootstrap.cc:492] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:24.661371 16999 ts_tablet_manager.cc:1403] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.315s	user 0.015s	sys 0.013s
I20260709 13:18:24.668339 16808 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:24.670009 16999 raft_consensus.cc:359] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.671075 16999 raft_consensus.cc:385] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.671346 16999 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.673377 17002 raft_consensus.cc:359] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.674017 17002 raft_consensus.cc:385] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.672004 16999 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.674294 17002 raft_consensus.cc:740] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.676113 16999 ts_tablet_manager.cc:1434] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:18:24.677021 16999 tablet_bootstrap.cc:492] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:24.676007 17002 consensus_queue.cc:260] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.682899 17002 ts_tablet_manager.cc:1434] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:18:24.683768 17002 tablet_bootstrap.cc:492] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
W20260709 13:18:24.686703 17420 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.324s	user 0.000s	sys 0.002s
I20260709 13:18:24.697867 16999 tablet_bootstrap.cc:654] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.699620 17002 tablet_bootstrap.cc:654] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.706202 16850 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:24.707547 17334 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.708125 17334 raft_consensus.cc:697] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:24.708950 17334 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.711252 17441 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.712985 17002 tablet_bootstrap.cc:492] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:24.713416 17002 ts_tablet_manager.cc:1403] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.002s
I20260709 13:18:24.715879 17002 raft_consensus.cc:359] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.716495 17002 raft_consensus.cc:385] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.716775 17002 raft_consensus.cc:740] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.717484 17002 consensus_queue.cc:260] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.723213 17002 ts_tablet_manager.cc:1434] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:18:24.724233 17002 tablet_bootstrap.cc:492] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:24.730111 17002 tablet_bootstrap.cc:654] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.734023 17121 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.734499 17121 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.736656 17121 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:24.741636 17002 tablet_bootstrap.cc:492] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:24.742086 17002 ts_tablet_manager.cc:1403] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:18:24.744688 17002 raft_consensus.cc:359] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.745325 17002 raft_consensus.cc:385] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.745590 17002 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.746376 17002 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.748749 17002 ts_tablet_manager.cc:1434] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:18:24.749625 16999 tablet_bootstrap.cc:492] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:24.749646 17002 tablet_bootstrap.cc:492] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Bootstrap starting.
I20260709 13:18:24.750206 16999 ts_tablet_manager.cc:1403] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.009s
I20260709 13:18:24.754822 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:24.755501 16958 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 1: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:18:24.755558 16850 leader_election.cc:343] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:18:24.756070 17002 tablet_bootstrap.cc:654] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.732929 16704 catalog_manager.cc:5697] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.762804 16999 raft_consensus.cc:359] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.763711 16999 raft_consensus.cc:385] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.764056 16999 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.765000 16999 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.768023 17002 tablet_bootstrap.cc:492] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: No bootstrap required, opened a new log
I20260709 13:18:24.768173 16999 ts_tablet_manager.cc:1434] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:18:24.768461 17002 ts_tablet_manager.cc:1403] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 13:18:24.769369 16999 tablet_bootstrap.cc:492] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:24.770859 17002 raft_consensus.cc:359] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.771464 17002 raft_consensus.cc:385] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.772152 17002 raft_consensus.cc:740] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.772149 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:24.773063 17002 consensus_queue.cc:260] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.774968 17002 ts_tablet_manager.cc:1434] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:24.775363 16999 tablet_bootstrap.cc:654] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.800379 17388 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.800882 17388 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.802955 17388 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:24.804714 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:24.805330 16959 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:24.806547 16850 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:24.807248 17388 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:24.807629 17388 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.808029 17388 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:18:24.814322 16985 tablet.cc:2406] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:18:24.832624 17388 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.843096 17388 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:24.844588 16775 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:24.844712 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:24.847332 16953 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.854367 16953 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:24.855482 16850 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:24.856169 17388 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:24.856854 17388 raft_consensus.cc:697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:24.857806 17388 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.858773 17408 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.861958 16704 catalog_manager.cc:5697] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.863948 17405 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.864423 17405 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.865728 17408 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:18:24.866439 17405 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:24.890393 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:24.890942 16810 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.892673 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:24.897302 16810 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:24.898932 16801 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:24.906100 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:24.912396 16999 tablet_bootstrap.cc:492] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:24.912922 16999 ts_tablet_manager.cc:1403] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.144s	user 0.046s	sys 0.056s
I20260709 13:18:24.915433 16999 raft_consensus.cc:359] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.916103 16999 raft_consensus.cc:385] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.916627 16999 raft_consensus.cc:740] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.917335 16999 consensus_queue.cc:260] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.919291 16999 ts_tablet_manager.cc:1434] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:24.920491 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:24.926090 17387 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:18:24.930908 16756 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:18:24.932940 17395 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:24.934262 16999 tablet_bootstrap.cc:492] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:24.946794 16707 catalog_manager.cc:5697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.949103 16999 tablet_bootstrap.cc:654] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:24.951298 16775 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:24.953588 17121 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:24.971251 17395 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:24.974567 16999 tablet_bootstrap.cc:492] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:24.975066 16999 ts_tablet_manager.cc:1403] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.010s
I20260709 13:18:24.977655 16999 raft_consensus.cc:359] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.978344 16999 raft_consensus.cc:385] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:24.978611 16999 raft_consensus.cc:740] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:24.980010 16999 consensus_queue.cc:260] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:24.989522 16999 ts_tablet_manager.cc:1434] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 13:18:24.990518 16999 tablet_bootstrap.cc:492] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:25.003644 16999 tablet_bootstrap.cc:654] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:25.007018 17318 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.007499 17318 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.009274 17395 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.009400 17318 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:25.009881 17318 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.009810 17395 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.010365 17318 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.012003 17395 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:25.012183 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:25.012887 16958 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:25.013108 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:25.013722 16959 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:25.017817 17318 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:25.017910 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:25.018756 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:25.019011 17318 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:25.019708 17318 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.020112 17318 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.026463 16999 tablet_bootstrap.cc:492] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:25.026942 16999 ts_tablet_manager.cc:1403] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.007s
I20260709 13:18:25.027298 17395 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:25.028657 17395 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.029132 17395 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.028580 17318 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.030972 17318 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:25.036484 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:25.037099 16953 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.046407 16953 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:25.047044 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:25.047776 16959 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:25.036487 17395 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.050551 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:25.051131 16801 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:25.051692 17395 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:25.053215 16999 raft_consensus.cc:359] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.053889 16999 raft_consensus.cc:385] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.054188 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:25.054148 16999 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.056499 16999 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.059602 16999 ts_tablet_manager.cc:1434] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:18:25.059895 16801 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:25.060559 16999 tablet_bootstrap.cc:492] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: Bootstrap starting.
I20260709 13:18:25.061786 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:25.062419 16801 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:25.065835 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:25.066376 16959 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.067492 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:25.068890 16801 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.075290 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:25.075857 16808 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.077268 16959 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:25.081051 16999 tablet_bootstrap.cc:654] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: Neither blocks nor log segments found. Creating new log.
I20260709 13:18:25.084007 16808 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:25.091163 16801 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:25.092060 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:25.092746 17318 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:25.092851 16850 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:25.094260 17395 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:25.095353 17395 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.093358 17318 raft_consensus.cc:697] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:25.095790 17395 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.096415 17318 consensus_queue.cc:237] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.102325 17395 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.104535 16999 tablet_bootstrap.cc:492] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: No bootstrap required, opened a new log
I20260709 13:18:25.104622 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:25.106608 16999 ts_tablet_manager.cc:1403] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.004s
I20260709 13:18:25.107774 17388 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:25.108443 17388 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:25.109368 16999 raft_consensus.cc:359] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.109776 17395 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:25.110143 16999 raft_consensus.cc:385] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:18:25.109545 17388 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.110473 16999 raft_consensus.cc:740] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Initialized, Role: FOLLOWER
I20260709 13:18:25.111267 16999 consensus_queue.cc:260] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.113404 16999 ts_tablet_manager.cc:1434] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:18:25.117715 17387 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.118175 17387 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.120604 17387 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:25.131006 16707 catalog_manager.cc:5697] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:25.134625 17334 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.138119 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:25.138650 16958 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.138792 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:25.139034 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:25.139439 16808 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:25.139618 16953 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 0.
I20260709 13:18:25.139339 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:25.148265 16801 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.153628 16958 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:25.155834 16707 catalog_manager.cc:5697] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:25.159785 16801 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:25.166873 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:25.167833 17334 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:18:25.168192 17334 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.168525 17334 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.168624 16850 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:25.169368 17388 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:25.169848 17388 raft_consensus.cc:697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:25.170622 17388 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.176863 17334 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.180841 17334 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:25.183003 17395 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.200217 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:25.200770 16808 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.202095 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:25.202644 16953 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:18:25.205138 16707 catalog_manager.cc:5697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:25.207190 16808 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:25.208848 16953 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:25.215662 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:25.216704 17388 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:18:25.217268 17388 raft_consensus.cc:697] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:25.218298 17388 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:25.232308 17334 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.249306 16704 catalog_manager.cc:5697] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:25.258320 17388 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.415889 17432 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.428622 17432 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.519181 17388 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.532037 17388 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:18:25.636498 17334 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.645768 17387 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.726074 17387 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.730119 17334 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.750262 17334 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:25.754693 17334 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:18:26.811980 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:18:26.845558 17480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:26.845633 17479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:18:26.846639 17482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:18:26.849107 15720 server_base.cc:1061] running on GCE node
I20260709 13:18:26.852440 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:18:26.854171 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:18:26.855599 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603106855570 us; error 0 us; skew 500 ppm
I20260709 13:18:26.856302 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:18:26.860321 15720 webserver.cc:533] Webserver started at http://127.15.90.4:38303/ using document root <none> and password file <none>
I20260709 13:18:26.860922 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:18:26.861183 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:18:26.861593 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:18:26.862735 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-3-root/instance:
uuid: "599f9a88b6cd4e818a1c59a0b4522480"
format_stamp: "Formatted at 2026-07-09 13:18:26 on dist-test-slave-fpp7"
I20260709 13:18:26.867760 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.006s
I20260709 13:18:26.872217 17489 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:26.873029 15720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:18:26.873422 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-3-root
uuid: "599f9a88b6cd4e818a1c59a0b4522480"
format_stamp: "Formatted at 2026-07-09 13:18:26 on dist-test-slave-fpp7"
I20260709 13:18:26.873724 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:18:26.889477 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:18:26.890791 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:18:26.892603 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:18:26.895210 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:18:26.895411 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:18:26.895678 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:18:26.895913 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:18:26.947172 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.4:35369
I20260709 13:18:26.947260 17551 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.4:35369 every 8 connection(s)
I20260709 13:18:26.951244 15720 auto_leader_rebalancer-test.cc:384] add a tserver: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:26.966388 17552 heartbeater.cc:344] Connected to a master server at 127.15.90.62:35161
I20260709 13:18:26.966794 17552 heartbeater.cc:461] Registering TS with master...
I20260709 13:18:26.967489 17552 heartbeater.cc:507] Master 127.15.90.62:35161 requested a full tablet report, sending...
I20260709 13:18:26.969326 16707 ts_manager.cc:194] Registered new tserver with Master: 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:26.970829 16707 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51366
I20260709 13:18:27.065424 16885 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:27.072196 16959 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.075122 16808 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.076560 17432 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.077878 17478 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:27.088061 17334 raft_consensus.cc:2955] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.110025 16808 raft_consensus.cc:2955] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.128387 16953 raft_consensus.cc:2955] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.128803 16707 catalog_manager.cc:5697] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:27.132274 16848 consensus_peers.cc:597] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dbad0fc0e5714f879e763bb34b5f172f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.151945 16808 consensus_queue.cc:237] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:27.162104 16959 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.164703 16880 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.166749 17563 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.167760 17408 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.183353 17239 raft_consensus.cc:2955] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.188707 16880 raft_consensus.cc:2955] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
W20260709 13:18:27.190412 16773 consensus_peers.cc:597] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd1d35ba148544669e52d7293ac9bd82. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.196621 16808 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:27.200079 16706 catalog_manager.cc:5697] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:27.213133 16885 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:27.215797 16773 consensus_peers.cc:597] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 32f35f41a8f1466fb1831fe03e474c4d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.218621 16953 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.222299 17563 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.223418 17239 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.266301 16959 raft_consensus.cc:2955] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.295040 17563 raft_consensus.cc:2955] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.296988 16885 raft_consensus.cc:2955] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.298561 16959 raft_consensus.cc:2955] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.344673 16706 catalog_manager.cc:5697] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.348023 16801 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:18:27.378538 16773 consensus_peers.cc:597] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efa7919f3d1c40e096823aab461b0e25. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:27.380249 16959 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.380618 16885 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:27.382428 17574 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:27.383453 17578 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:27.390980 17578 raft_consensus.cc:2955] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.392500 16885 raft_consensus.cc:2955] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.400414 16959 raft_consensus.cc:2955] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.406337 16706 catalog_manager.cc:5697] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:27.533489 17585 ts_tablet_manager.cc:933] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:27.537082 17585 tablet_copy_client.cc:323] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:27.553321 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet dbad0fc0e5714f879e763bb34b5f172f from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:27.553869 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet dbad0fc0e5714f879e763bb34b5f172f from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-dbad0fc0e5714f879e763bb34b5f172f
I20260709 13:18:27.559620 16895 tablet_copy_source_session.cc:215] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:27.562809 17585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbad0fc0e5714f879e763bb34b5f172f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:27.581445 17585 tablet_copy_client.cc:806] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:27.582022 17585 tablet_copy_client.cc:670] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:27.587407 17585 tablet_copy_client.cc:538] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:27.597328 17585 tablet_bootstrap.cc:492] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:27.617661 17585 tablet_bootstrap.cc:492] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.618572 17585 tablet_bootstrap.cc:492] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:27.619200 17585 ts_tablet_manager.cc:1403] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:18:27.621654 17585 raft_consensus.cc:359] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:27.622303 17585 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:27.622809 17585 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:27.670882 17552 heartbeater.cc:499] Master 127.15.90.62:35161 was elected leader, sending a full tablet report...
I20260709 13:18:27.671437 17585 ts_tablet_manager.cc:1434] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.052s	user 0.024s	sys 0.026s
I20260709 13:18:27.673416 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-dbad0fc0e5714f879e763bb34b5f172f received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:27.673895 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-dbad0fc0e5714f879e763bb34b5f172f on tablet dbad0fc0e5714f879e763bb34b5f172f with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:27.753700 17585 ts_tablet_manager.cc:933] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:27.755297 17585 tablet_copy_client.cc:323] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:27.765041 16820 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet cd1d35ba148544669e52d7293ac9bd82 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:27.765595 16820 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet cd1d35ba148544669e52d7293ac9bd82 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-cd1d35ba148544669e52d7293ac9bd82
I20260709 13:18:27.773010 16820 tablet_copy_source_session.cc:215] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:27.774129 17592 ts_tablet_manager.cc:933] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:27.776376 17592 tablet_copy_client.cc:323] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:27.776501 17585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1d35ba148544669e52d7293ac9bd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:27.778806 16820 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet efa7919f3d1c40e096823aab461b0e25 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:27.779313 16820 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet efa7919f3d1c40e096823aab461b0e25 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-efa7919f3d1c40e096823aab461b0e25
I20260709 13:18:27.795907 17594 ts_tablet_manager.cc:933] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:27.800273 16820 tablet_copy_source_session.cc:215] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:27.800859 17585 tablet_copy_client.cc:806] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:27.801852 17585 tablet_copy_client.cc:670] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:27.804564 17594 tablet_copy_client.cc:323] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:27.806190 17592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa7919f3d1c40e096823aab461b0e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:27.807251 16820 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet 32f35f41a8f1466fb1831fe03e474c4d from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:27.807578 17585 tablet_copy_client.cc:538] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:27.807935 16820 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet 32f35f41a8f1466fb1831fe03e474c4d from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-32f35f41a8f1466fb1831fe03e474c4d
I20260709 13:18:27.819391 17585 tablet_bootstrap.cc:492] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:27.820258 16820 tablet_copy_source_session.cc:215] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:27.821070 17592 tablet_copy_client.cc:806] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:27.821647 17592 tablet_copy_client.cc:670] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:27.823266 17594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32f35f41a8f1466fb1831fe03e474c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:27.827792 17592 tablet_copy_client.cc:538] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:27.838093 17592 tablet_bootstrap.cc:492] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:27.839994 17594 tablet_copy_client.cc:806] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:27.840838 17594 tablet_copy_client.cc:670] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:27.854454 17594 tablet_copy_client.cc:538] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:27.866417 17594 tablet_bootstrap.cc:492] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:27.871833 17585 tablet_bootstrap.cc:492] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.872845 17585 tablet_bootstrap.cc:492] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:27.873533 17585 ts_tablet_manager.cc:1403] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.008s
I20260709 13:18:27.876871 17585 raft_consensus.cc:359] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:27.877715 17585 raft_consensus.cc:740] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:27.879405 17585 consensus_queue.cc:260] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:27.885610 17585 ts_tablet_manager.cc:1434] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:18:27.885965 17592 tablet_bootstrap.cc:492] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.887456 16820 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-cd1d35ba148544669e52d7293ac9bd82 received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:27.888504 16820 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-cd1d35ba148544669e52d7293ac9bd82 on tablet cd1d35ba148544669e52d7293ac9bd82 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:27.890244 17592 tablet_bootstrap.cc:492] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:27.891013 17592 ts_tablet_manager.cc:1403] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.001s
I20260709 13:18:27.896018 17592 raft_consensus.cc:359] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:27.897456 17592 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:27.898116 17592 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:27.900630 17592 ts_tablet_manager.cc:1434] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:18:27.902446 16820 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-efa7919f3d1c40e096823aab461b0e25 received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:27.902827 16820 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-efa7919f3d1c40e096823aab461b0e25 on tablet efa7919f3d1c40e096823aab461b0e25 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:27.912796 17594 tablet_bootstrap.cc:492] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:27.913749 17594 tablet_bootstrap.cc:492] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:27.914384 17594 ts_tablet_manager.cc:1403] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.004s
I20260709 13:18:27.917197 17594 raft_consensus.cc:359] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:27.918825 17594 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:27.919423 17594 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:27.921615 17594 ts_tablet_manager.cc:1434] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:18:27.923182 16820 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-32f35f41a8f1466fb1831fe03e474c4d received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:27.923574 16820 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-32f35f41a8f1466fb1831fe03e474c4d on tablet 32f35f41a8f1466fb1831fe03e474c4d with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:28.014568 17527 raft_consensus.cc:1217] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:28.210988 17527 raft_consensus.cc:1217] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:28.233901 17527 raft_consensus.cc:1217] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:28.399317 17527 raft_consensus.cc:1217] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:28.499401 17334 raft_consensus.cc:1064] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:28.501149 17334 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:28.507810 17527 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.508245 16953 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.509146 16808 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.509703 17576 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:28.511117 17478 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:28.514472 17334 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:28.536486 17576 raft_consensus.cc:2955] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.543444 16806 raft_consensus.cc:2955] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.549167 17527 raft_consensus.cc:2955] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.562330 16953 raft_consensus.cc:2955] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.573138 16704 catalog_manager.cc:5697] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:28.603469 16878 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:28.608682 17527 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:28.609297 16953 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:28.610669 17334 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:28.611387 17605 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:28.616880 17605 raft_consensus.cc:2955] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.620707 16953 raft_consensus.cc:2955] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.620805 17527 raft_consensus.cc:2955] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.634594 16708 catalog_manager.cc:5697] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.637745 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dbad0fc0e5714f879e763bb34b5f172f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:28.650609 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet dbad0fc0e5714f879e763bb34b5f172f with delete_type TABLET_DATA_TOMBSTONED (TS 96eaa6dafb3e4bbe914e54dc12507912 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:28.658425 17610 tablet_replica.cc:333] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:18:28.659201 17610 raft_consensus.cc:2243] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:28.659845 17610 raft_consensus.cc:2272] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:28.662812 17610 ts_tablet_manager.cc:1916] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:28.675547 17610 ts_tablet_manager.cc:1929] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:28.676044 17610 log.cc:1199] T dbad0fc0e5714f879e763bb34b5f172f P 96eaa6dafb3e4bbe914e54dc12507912: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/wals/dbad0fc0e5714f879e763bb34b5f172f
I20260709 13:18:28.677448 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet dbad0fc0e5714f879e763bb34b5f172f (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:28.806495 17574 raft_consensus.cc:1064] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:28.806782 17579 raft_consensus.cc:1064] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:28.808519 17574 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:28.809216 17579 consensus_queue.cc:237] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:28.825623 17526 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.828073 17578 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:28.829381 17526 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.832188 16959 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.831569 17578 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:18:28.839490 16878 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.840019 16959 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.842157 16878 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.842922 17611 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:28.844224 17578 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:28.848578 17578 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:28.849352 17574 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:28.863526 17579 raft_consensus.cc:1064] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:28.866286 17579 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:28.874742 17578 raft_consensus.cc:2955] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.881340 16959 raft_consensus.cc:2955] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.884888 17574 raft_consensus.cc:2955] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.888240 17526 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.889909 17611 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:28.890353 17526 raft_consensus.cc:2955] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.913723 16707 catalog_manager.cc:5697] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.925537 16878 raft_consensus.cc:2955] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.927248 16959 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.930075 16880 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:28.928299 16885 raft_consensus.cc:2955] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.935702 17578 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:28.942587 16806 consensus_queue.cc:237] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:28.944216 16958 raft_consensus.cc:2955] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.954842 17526 raft_consensus.cc:2955] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.949807 17579 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:18:28.949661 16707 catalog_manager.cc:5697] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:28.962425 16877 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:28.963603 17611 raft_consensus.cc:2955] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.970944 17574 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:28.976181 16953 raft_consensus.cc:2955] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.976645 17525 raft_consensus.cc:2955] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.986377 17574 raft_consensus.cc:2955] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:28.988541 16885 raft_consensus.cc:2955] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.011009 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cd1d35ba148544669e52d7293ac9bd82 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:29.021165 16707 catalog_manager.cc:5697] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.022085 17527 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:29.046058 17614 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:29.058758 16704 catalog_manager.cc:5697] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.059191 16877 raft_consensus.cc:2955] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.060814 17527 raft_consensus.cc:2955] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.077863 16942 tablet_service.cc:1558] Processing DeleteTablet for tablet cd1d35ba148544669e52d7293ac9bd82 with delete_type TABLET_DATA_TOMBSTONED (TS ca1b60a074dc47cd8e68cc57a33a94a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34326
I20260709 13:18:29.087806 16806 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:29.096287 17527 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:29.101167 17623 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:29.108265 17574 raft_consensus.cc:2955] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.109791 17525 raft_consensus.cc:2955] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.098479 16806 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:29.122591 16959 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:29.125988 17527 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:29.129786 17611 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:29.128387 16707 catalog_manager.cc:5697] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:29.137892 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 32f35f41a8f1466fb1831fe03e474c4d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:29.143725 16958 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:29.145960 17579 raft_consensus.cc:2955] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.148818 17527 raft_consensus.cc:2955] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.150904 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet 32f35f41a8f1466fb1831fe03e474c4d with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:29.153273 17614 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:29.154121 17629 tablet_replica.cc:333] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:18:29.155081 17629 raft_consensus.cc:2243] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:29.155705 17629 raft_consensus.cc:2272] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:29.165643 16707 catalog_manager.cc:5697] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.167363 17629 ts_tablet_manager.cc:1916] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:29.175465 17614 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:18:29.177560 17630 tablet_replica.cc:333] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:18:29.179450 17630 raft_consensus.cc:2243] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:29.180662 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet efa7919f3d1c40e096823aab461b0e25 with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:29.182236 16959 raft_consensus.cc:2955] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.183902 17630 raft_consensus.cc:2272] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:29.187125 17630 ts_tablet_manager.cc:1916] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:29.187788 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet efa7919f3d1c40e096823aab461b0e25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:29.195137 16958 raft_consensus.cc:2955] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:29.215471 17629 ts_tablet_manager.cc:1929] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:29.215969 17629 log.cc:1199] T cd1d35ba148544669e52d7293ac9bd82 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/wals/cd1d35ba148544669e52d7293ac9bd82
I20260709 13:18:29.217451 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet cd1d35ba148544669e52d7293ac9bd82 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:29.223847 17630 ts_tablet_manager.cc:1929] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:29.224318 17630 log.cc:1199] T 32f35f41a8f1466fb1831fe03e474c4d P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/32f35f41a8f1466fb1831fe03e474c4d
I20260709 13:18:29.225888 17630 tablet_replica.cc:333] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:18:29.225788 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet 32f35f41a8f1466fb1831fe03e474c4d (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:29.226727 17630 raft_consensus.cc:2243] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:29.227240 17630 raft_consensus.cc:2272] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:29.229563 17630 ts_tablet_manager.cc:1916] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:29.238262 17630 ts_tablet_manager.cc:1929] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:29.238556 17630 log.cc:1199] T efa7919f3d1c40e096823aab461b0e25 P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/efa7919f3d1c40e096823aab461b0e25
I20260709 13:18:29.239604 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet efa7919f3d1c40e096823aab461b0e25 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:30.243393 16878 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:30.249022 16959 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:30.249477 16848 consensus_peers.cc:597] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c61e860f8a8d481aa272d36c7e4a93e0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:30.249794 16801 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:30.250841 17631 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.251645 17478 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.259820 17478 raft_consensus.cc:2955] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:30.261236 16959 raft_consensus.cc:2955] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:30.275627 16801 raft_consensus.cc:2955] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:30.278450 16807 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:30.279130 16707 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:30.300143 16773 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8b8274145134eaa8f14229eceeca799. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:30.302284 16959 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:30.303542 16878 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:30.305289 17579 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.311815 17614 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:30.317898 17640 raft_consensus.cc:2955] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:30.327622 16877 raft_consensus.cc:2955] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:30.348133 16708 catalog_manager.cc:5697] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.362833 16958 consensus_queue.cc:237] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:30.369877 16959 raft_consensus.cc:2955] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:30.374395 16801 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:30.376598 16877 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:30.378131 17396 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.416813 17484 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:18:30.439894 17648 raft_consensus.cc:2955] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:30.442588 16807 raft_consensus.cc:2955] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:30.455307 16958 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:30.460067 16704 catalog_manager.cc:5697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:30.465576 16922 consensus_peers.cc:597] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fd370afa4144ee3b93ac6dc4ae63e07. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:30.468583 16877 raft_consensus.cc:2955] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
W20260709 13:18:30.479319 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 61410.1us
W20260709 13:18:30.480316 16922 consensus_peers.cc:597] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17115e8a13c346f1998df3bc8f52ec52. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:30.482246 16878 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:30.489600 17654 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.490564 16807 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:30.492115 17648 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:30.506076 17396 raft_consensus.cc:2955] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:30.509008 16807 raft_consensus.cc:2955] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:30.519706 16877 raft_consensus.cc:2955] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:30.528679 16708 catalog_manager.cc:5697] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.711643 17658 ts_tablet_manager.cc:933] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:30.713521 17658 tablet_copy_client.cc:323] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:30.714962 16820 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet f8b8274145134eaa8f14229eceeca799 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:30.715479 16820 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet f8b8274145134eaa8f14229eceeca799 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-f8b8274145134eaa8f14229eceeca799
I20260709 13:18:30.721946 16820 tablet_copy_source_session.cc:215] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:30.724586 17658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8b8274145134eaa8f14229eceeca799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:30.738176 17658 tablet_copy_client.cc:806] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:30.738674 17658 tablet_copy_client.cc:670] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:30.743108 17658 tablet_copy_client.cc:538] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:30.748579 17658 tablet_bootstrap.cc:492] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:30.766117 17658 tablet_bootstrap.cc:492] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.767020 17658 tablet_bootstrap.cc:492] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:30.767711 17658 ts_tablet_manager.cc:1403] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.014s
I20260709 13:18:30.770429 17661 ts_tablet_manager.cc:933] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:30.770768 17658 raft_consensus.cc:359] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:30.771782 17658 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:30.774318 17658 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:30.780437 17661 tablet_copy_client.cc:323] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.3:33725
I20260709 13:18:30.794219 17658 ts_tablet_manager.cc:1434] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.010s
I20260709 13:18:30.796958 16820 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-f8b8274145134eaa8f14229eceeca799 received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:30.797364 16820 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-f8b8274145134eaa8f14229eceeca799 on tablet f8b8274145134eaa8f14229eceeca799 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:30.808187 16969 tablet_copy_service.cc:140] P ca1b60a074dc47cd8e68cc57a33a94a3: Received BeginTabletCopySession request for tablet 0fd370afa4144ee3b93ac6dc4ae63e07 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:48222)
I20260709 13:18:30.808671 16969 tablet_copy_service.cc:161] P ca1b60a074dc47cd8e68cc57a33a94a3: Beginning new tablet copy session on tablet 0fd370afa4144ee3b93ac6dc4ae63e07 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:48222: session id = 599f9a88b6cd4e818a1c59a0b4522480-0fd370afa4144ee3b93ac6dc4ae63e07
I20260709 13:18:30.815094 16969 tablet_copy_source_session.cc:215] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:30.818833 17661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd370afa4144ee3b93ac6dc4ae63e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:30.833819 17661 tablet_copy_client.cc:806] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:30.834393 17661 tablet_copy_client.cc:670] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:30.837797 17661 tablet_copy_client.cc:538] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:30.846194 17661 tablet_bootstrap.cc:492] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:30.865605 17661 tablet_bootstrap.cc:492] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.866432 17661 tablet_bootstrap.cc:492] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:30.867074 17661 ts_tablet_manager.cc:1403] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:18:30.869729 17661 raft_consensus.cc:359] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:30.870524 17661 raft_consensus.cc:740] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:30.871135 17661 consensus_queue.cc:260] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:30.873473 17661 ts_tablet_manager.cc:1434] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:18:30.873559 17658 ts_tablet_manager.cc:933] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:30.875353 17658 tablet_copy_client.cc:323] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:30.875461 16969 tablet_copy_service.cc:342] P ca1b60a074dc47cd8e68cc57a33a94a3: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-0fd370afa4144ee3b93ac6dc4ae63e07 received from {username='slave'} at 127.0.0.1:48222
I20260709 13:18:30.875968 16969 tablet_copy_service.cc:434] P ca1b60a074dc47cd8e68cc57a33a94a3: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-0fd370afa4144ee3b93ac6dc4ae63e07 on tablet 0fd370afa4144ee3b93ac6dc4ae63e07 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:30.877017 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet c61e860f8a8d481aa272d36c7e4a93e0 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:30.877528 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet c61e860f8a8d481aa272d36c7e4a93e0 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-c61e860f8a8d481aa272d36c7e4a93e0
I20260709 13:18:30.885072 16895 tablet_copy_source_session.cc:215] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:30.888249 17658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61e860f8a8d481aa272d36c7e4a93e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:30.900787 17658 tablet_copy_client.cc:806] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:30.901298 17658 tablet_copy_client.cc:670] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:30.905432 17658 tablet_copy_client.cc:538] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:30.913734 17658 tablet_bootstrap.cc:492] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:30.940446 17661 ts_tablet_manager.cc:933] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:30.943468 17661 tablet_copy_client.cc:323] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.3:33725
I20260709 13:18:30.944922 16969 tablet_copy_service.cc:140] P ca1b60a074dc47cd8e68cc57a33a94a3: Received BeginTabletCopySession request for tablet 17115e8a13c346f1998df3bc8f52ec52 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:48222)
I20260709 13:18:30.945410 16969 tablet_copy_service.cc:161] P ca1b60a074dc47cd8e68cc57a33a94a3: Beginning new tablet copy session on tablet 17115e8a13c346f1998df3bc8f52ec52 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:48222: session id = 599f9a88b6cd4e818a1c59a0b4522480-17115e8a13c346f1998df3bc8f52ec52
I20260709 13:18:30.953513 17658 tablet_bootstrap.cc:492] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:30.954479 17658 tablet_bootstrap.cc:492] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:30.955169 17658 ts_tablet_manager.cc:1403] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.021s
I20260709 13:18:30.958055 17658 raft_consensus.cc:359] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:30.958902 17658 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:30.959580 17658 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:30.964057 17658 ts_tablet_manager.cc:1434] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:30.966416 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-c61e860f8a8d481aa272d36c7e4a93e0 received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:30.966784 16969 tablet_copy_source_session.cc:215] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:30.966818 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-c61e860f8a8d481aa272d36c7e4a93e0 on tablet c61e860f8a8d481aa272d36c7e4a93e0 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:30.973969 17661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17115e8a13c346f1998df3bc8f52ec52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:30.987237 17661 tablet_copy_client.cc:806] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:30.987802 17661 tablet_copy_client.cc:670] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:30.992270 17661 tablet_copy_client.cc:538] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:30.999636 17661 tablet_bootstrap.cc:492] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:31.019289 17661 tablet_bootstrap.cc:492] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:31.020143 17661 tablet_bootstrap.cc:492] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:31.020768 17661 ts_tablet_manager.cc:1403] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.013s
I20260709 13:18:31.023423 17661 raft_consensus.cc:359] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:31.024228 17661 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:31.024883 17661 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:31.026904 17661 ts_tablet_manager.cc:1434] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:18:31.028488 16969 tablet_copy_service.cc:342] P ca1b60a074dc47cd8e68cc57a33a94a3: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-17115e8a13c346f1998df3bc8f52ec52 received from {username='slave'} at 127.0.0.1:48222
I20260709 13:18:31.028826 16969 tablet_copy_service.cc:434] P ca1b60a074dc47cd8e68cc57a33a94a3: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-17115e8a13c346f1998df3bc8f52ec52 on tablet 17115e8a13c346f1998df3bc8f52ec52 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:31.094861 17527 raft_consensus.cc:1217] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:31.260001 17527 raft_consensus.cc:1217] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:31.318657 17527 raft_consensus.cc:1217] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:31.390573 17527 raft_consensus.cc:1217] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:31.616042 17643 raft_consensus.cc:1064] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:31.618197 17643 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:31.626710 17527 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.629043 17674 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:31.630132 16959 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.631084 16878 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.633419 17652 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:31.634645 17643 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:31.668511 17675 raft_consensus.cc:2955] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.671905 16959 raft_consensus.cc:2955] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.681231 16878 raft_consensus.cc:2955] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.681527 17527 raft_consensus.cc:2955] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.695920 16704 catalog_manager.cc:5697] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.726099 16806 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:31.730451 17527 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:31.732167 17643 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:31.738018 16878 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:31.739176 17679 raft_consensus.cc:1064] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:31.739356 17674 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:31.741650 17679 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:31.741400 17675 raft_consensus.cc:2955] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.743287 17527 raft_consensus.cc:2955] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.751395 17396 raft_consensus.cc:1064] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:31.753690 17396 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:31.755393 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8b8274145134eaa8f14229eceeca799 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:31.756491 16958 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.757194 16877 raft_consensus.cc:2955] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.757889 17631 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:31.766032 16707 catalog_manager.cc:5697] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.768265 16806 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.770761 17679 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:31.772075 17527 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.774883 17679 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:31.793280 16878 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.794659 17672 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:31.801424 17525 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.815949 16942 tablet_service.cc:1558] Processing DeleteTablet for tablet f8b8274145134eaa8f14229eceeca799 with delete_type TABLET_DATA_TOMBSTONED (TS ca1b60a074dc47cd8e68cc57a33a94a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34326
I20260709 13:18:31.816368 17648 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:31.820832 17690 tablet_replica.cc:333] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:18:31.822502 17679 raft_consensus.cc:2955] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.829072 17527 raft_consensus.cc:2955] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.823633 16807 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.834803 17672 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:31.825564 16959 raft_consensus.cc:2955] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.840904 16807 raft_consensus.cc:2955] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.843954 17690 raft_consensus.cc:2243] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:31.845429 17690 raft_consensus.cc:2272] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:31.850044 17396 raft_consensus.cc:1064] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:31.852170 17396 consensus_queue.cc:237] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:31.874303 16706 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.887547 17525 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.890275 16877 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.884249 17648 raft_consensus.cc:2955] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.894075 16806 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:31.898411 17695 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:31.916679 16877 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:31.921834 17690 ts_tablet_manager.cc:1916] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:31.953233 17527 raft_consensus.cc:2955] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.955399 16958 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:31.955401 17526 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:18:31.956853 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 61299.2us
I20260709 13:18:31.957666 17478 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:31.964709 17679 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:31.965633 17698 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:31.972519 16880 raft_consensus.cc:2955] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.974746 16801 raft_consensus.cc:2955] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.951979 16706 catalog_manager.cc:5697] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.981745 17631 raft_consensus.cc:2955] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.987799 17524 raft_consensus.cc:2955] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:31.988713 17698 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:32.000236 16959 raft_consensus.cc:2955] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.018949 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c61e860f8a8d481aa272d36c7e4a93e0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:32.038681 17698 raft_consensus.cc:2955] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.042567 16704 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.044884 16806 raft_consensus.cc:2955] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.053416 17690 ts_tablet_manager.cc:1929] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:32.053903 17690 log.cc:1199] T f8b8274145134eaa8f14229eceeca799 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/wals/f8b8274145134eaa8f14229eceeca799
I20260709 13:18:32.055872 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet f8b8274145134eaa8f14229eceeca799 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:32.055531 16877 raft_consensus.cc:2955] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.060415 17524 raft_consensus.cc:2955] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.079746 16954 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:32.086453 16705 catalog_manager.cc:5697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.087888 17525 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:32.092064 17696 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:32.092759 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet c61e860f8a8d481aa272d36c7e4a93e0 with delete_type TABLET_DATA_TOMBSTONED (TS 96eaa6dafb3e4bbe914e54dc12507912 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:32.100649 16806 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:32.107874 17396 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:32.107149 17648 raft_consensus.cc:2955] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.114604 17702 tablet_replica.cc:333] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:18:32.115651 17702 raft_consensus.cc:2243] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:32.116293 17702 raft_consensus.cc:2272] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:32.116521 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17115e8a13c346f1998df3bc8f52ec52 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:32.120164 17702 ts_tablet_manager.cc:1916] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:32.120842 17525 raft_consensus.cc:2955] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.134852 16705 catalog_manager.cc:5697] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.138274 17702 ts_tablet_manager.cc:1929] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:32.138772 17702 log.cc:1199] T c61e860f8a8d481aa272d36c7e4a93e0 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/wals/c61e860f8a8d481aa272d36c7e4a93e0
I20260709 13:18:32.139164 16954 consensus_queue.cc:237] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:32.141633 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet c61e860f8a8d481aa272d36c7e4a93e0 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:32.145877 17524 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:32.147605 16877 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:32.149022 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet 17115e8a13c346f1998df3bc8f52ec52 with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:32.149052 16806 raft_consensus.cc:2955] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.153071 17704 tablet_replica.cc:333] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:18:32.152977 17696 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:32.154089 17704 raft_consensus.cc:2243] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:32.154769 17704 raft_consensus.cc:2272] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:32.158119 17704 ts_tablet_manager.cc:1916] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:32.163021 17396 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:32.168941 17698 raft_consensus.cc:2955] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.175215 17704 ts_tablet_manager.cc:1929] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:32.178192 17524 raft_consensus.cc:2955] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.184279 16880 raft_consensus.cc:2955] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:32.186313 17704 log.cc:1199] T 17115e8a13c346f1998df3bc8f52ec52 P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/17115e8a13c346f1998df3bc8f52ec52
I20260709 13:18:32.224740 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0fd370afa4144ee3b93ac6dc4ae63e07 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:32.227200 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet 17115e8a13c346f1998df3bc8f52ec52 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:32.265491 16707 catalog_manager.cc:5697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:32.313467 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fd370afa4144ee3b93ac6dc4ae63e07 with delete_type TABLET_DATA_TOMBSTONED (TS 96eaa6dafb3e4bbe914e54dc12507912 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:32.316154 17702 tablet_replica.cc:333] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:18:32.318804 17702 raft_consensus.cc:2243] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:32.320760 17702 raft_consensus.cc:2272] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:32.327996 17702 ts_tablet_manager.cc:1916] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:32.349063 17702 ts_tablet_manager.cc:1929] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:32.349711 17702 log.cc:1199] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/wals/0fd370afa4144ee3b93ac6dc4ae63e07
I20260709 13:18:32.351472 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet 0fd370afa4144ee3b93ac6dc4ae63e07 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:33.389771 16880 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:33.394868 16953 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:33.395830 16848 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 406d9b96060f4833ba26879d81f73bdc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:33.396112 17707 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:33.397188 16801 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:33.398655 17707 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:33.403244 17631 raft_consensus.cc:2955] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.404702 16953 raft_consensus.cc:2955] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.421490 16704 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.426589 16801 raft_consensus.cc:2955] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.428263 16808 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:18:33.448920 16773 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d757b655f89a468ab8fc0ad2914716b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:33.451444 16953 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:33.451545 16877 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:33.453332 17708 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:33.454563 17675 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:33.471722 16877 raft_consensus.cc:2955] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.470793 17708 raft_consensus.cc:2955] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.473047 16953 raft_consensus.cc:2955] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.493433 16707 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.497956 16808 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:33.506489 16953 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:33.506999 16773 consensus_peers.cc:597] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e37840a1d83b4fe5be57618ff85b8a47. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:33.507712 16880 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:33.508594 17708 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:33.511080 17706 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:33.517760 17708 raft_consensus.cc:2955] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.519552 16953 raft_consensus.cc:2955] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.527309 16880 raft_consensus.cc:2955] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.535351 16877 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:33.536000 16707 catalog_manager.cc:5697] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.545965 16953 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:33.548269 17707 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:33.549585 16848 consensus_peers.cc:597] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6fb5156c6c9245bfaeffc22854718789. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:33.555469 16801 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:33.558002 17707 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:33.579236 17707 raft_consensus.cc:2955] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.582919 16801 raft_consensus.cc:2955] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.587349 16958 raft_consensus.cc:2955] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.608436 16704 catalog_manager.cc:5697] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:33.846405 17725 ts_tablet_manager.cc:933] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:33.848316 17725 tablet_copy_client.cc:323] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:33.849902 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 406d9b96060f4833ba26879d81f73bdc from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:33.850354 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 406d9b96060f4833ba26879d81f73bdc from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-406d9b96060f4833ba26879d81f73bdc
I20260709 13:18:33.855882 16895 tablet_copy_source_session.cc:215] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:33.858880 17725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406d9b96060f4833ba26879d81f73bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.889545 17725 tablet_copy_client.cc:806] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:33.890228 17725 tablet_copy_client.cc:670] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:33.898438 17725 tablet_copy_client.cc:538] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:33.907469 17725 tablet_bootstrap.cc:492] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:33.927591 17725 tablet_bootstrap.cc:492] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:33.929522 17725 tablet_bootstrap.cc:492] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:33.931339 17725 ts_tablet_manager.cc:1403] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.009s
I20260709 13:18:33.934978 17725 raft_consensus.cc:359] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:33.935806 17725 raft_consensus.cc:740] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:33.936367 17725 consensus_queue.cc:260] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:33.940876 17725 ts_tablet_manager.cc:1434] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:18:33.945833 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-406d9b96060f4833ba26879d81f73bdc received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:33.946274 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-406d9b96060f4833ba26879d81f73bdc on tablet 406d9b96060f4833ba26879d81f73bdc with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:33.950925 17725 ts_tablet_manager.cc:933] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:33.952697 17725 tablet_copy_client.cc:323] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:33.954413 16820 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet e37840a1d83b4fe5be57618ff85b8a47 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:33.954944 16820 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet e37840a1d83b4fe5be57618ff85b8a47 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-e37840a1d83b4fe5be57618ff85b8a47
I20260709 13:18:33.955658 17730 ts_tablet_manager.cc:933] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:33.958091 17730 tablet_copy_client.cc:323] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:33.959831 16819 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet d757b655f89a468ab8fc0ad2914716b7 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:33.960343 16819 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet d757b655f89a468ab8fc0ad2914716b7 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-d757b655f89a468ab8fc0ad2914716b7
I20260709 13:18:33.970124 16820 tablet_copy_source_session.cc:215] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:33.973455 17725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37840a1d83b4fe5be57618ff85b8a47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.975524 16819 tablet_copy_source_session.cc:215] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:33.978906 17730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d757b655f89a468ab8fc0ad2914716b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:33.991050 17725 tablet_copy_client.cc:806] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:33.991650 17725 tablet_copy_client.cc:670] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:33.995527 17725 tablet_copy_client.cc:538] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:34.004377 17725 tablet_bootstrap.cc:492] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:34.012149 17730 tablet_copy_client.cc:806] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:34.013002 17730 tablet_copy_client.cc:670] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:34.019471 17730 tablet_copy_client.cc:538] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:34.028198 17730 tablet_bootstrap.cc:492] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:34.028318 17725 tablet_bootstrap.cc:492] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:34.029067 17725 tablet_bootstrap.cc:492] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:34.029693 17725 ts_tablet_manager.cc:1403] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.002s
I20260709 13:18:34.033569 17725 raft_consensus.cc:359] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:34.034166 17725 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:34.034737 17725 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:34.039573 17725 ts_tablet_manager.cc:1434] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:18:34.043995 16819 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-e37840a1d83b4fe5be57618ff85b8a47 received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:34.044397 16819 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-e37840a1d83b4fe5be57618ff85b8a47 on tablet e37840a1d83b4fe5be57618ff85b8a47 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:34.066867 17730 tablet_bootstrap.cc:492] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:34.067770 17730 tablet_bootstrap.cc:492] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:34.068317 17730 ts_tablet_manager.cc:1403] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.040s	user 0.026s	sys 0.010s
I20260709 13:18:34.070978 17730 raft_consensus.cc:359] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:34.072851 17730 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:34.073478 17730 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:34.075750 17730 ts_tablet_manager.cc:1434] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:18:34.077543 16819 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-d757b655f89a468ab8fc0ad2914716b7 received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:34.077936 16819 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-d757b655f89a468ab8fc0ad2914716b7 on tablet d757b655f89a468ab8fc0ad2914716b7 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:34.137862 17730 ts_tablet_manager.cc:933] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:34.146525 17730 tablet_copy_client.cc:323] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:34.150012 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 6fb5156c6c9245bfaeffc22854718789 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:34.150537 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 6fb5156c6c9245bfaeffc22854718789 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-6fb5156c6c9245bfaeffc22854718789
I20260709 13:18:34.156116 16895 tablet_copy_source_session.cc:215] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:34.158690 17730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fb5156c6c9245bfaeffc22854718789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:34.170594 17730 tablet_copy_client.cc:806] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:34.171128 17730 tablet_copy_client.cc:670] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:34.174299 17730 tablet_copy_client.cc:538] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:34.182526 17730 tablet_bootstrap.cc:492] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:34.207528 17730 tablet_bootstrap.cc:492] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:34.208493 17730 tablet_bootstrap.cc:492] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:34.209123 17730 ts_tablet_manager.cc:1403] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 13:18:34.211946 17730 raft_consensus.cc:359] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:34.212970 17730 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:34.213562 17730 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:34.215797 17730 ts_tablet_manager.cc:1434] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:18:34.217350 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-6fb5156c6c9245bfaeffc22854718789 received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:34.217754 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-6fb5156c6c9245bfaeffc22854718789 on tablet 6fb5156c6c9245bfaeffc22854718789 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:34.354650 17524 raft_consensus.cc:1217] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:34.417546 17524 raft_consensus.cc:1217] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:34.549531 17524 raft_consensus.cc:1217] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:34.619009 17524 raft_consensus.cc:1217] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:34.767092 17737 raft_consensus.cc:1064] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:34.770068 17737 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:34.782691 17524 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:34.784601 17708 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:34.787365 16958 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:34.789361 16877 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:34.789297 17706 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:34.790722 17708 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:34.797991 17708 raft_consensus.cc:2955] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:34.811219 16877 raft_consensus.cc:2955] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:34.817672 16958 raft_consensus.cc:2955] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:34.828047 16707 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:34.829540 17524 raft_consensus.cc:2955] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:34.837707 17631 raft_consensus.cc:1064] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:34.843230 17631 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:34.867995 16954 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:34.868221 17524 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:34.868589 16801 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:34.869908 17727 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:34.872526 17727 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:34.874398 17707 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:34.897958 17631 raft_consensus.cc:2955] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:34.899883 17524 raft_consensus.cc:2955] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:34.905699 16808 raft_consensus.cc:2955] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:34.913518 16958 raft_consensus.cc:2955] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:34.936720 16708 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:34.960202 16877 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:34.969534 17524 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:34.971460 17707 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:34.972434 16801 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:34.973706 16808 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:34.975169 17707 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:34.978330 17525 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:34.981274 17742 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:34.982838 16877 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:34.986136 17707 raft_consensus.cc:2955] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:34.989069 17708 raft_consensus.cc:2955] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:34.991834 17737 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:34.993280 17525 raft_consensus.cc:2955] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.000700 16808 raft_consensus.cc:2955] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.002153 16877 raft_consensus.cc:2955] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.003902 17527 raft_consensus.cc:2955] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.014812 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 406d9b96060f4833ba26879d81f73bdc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:35.025441 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d757b655f89a468ab8fc0ad2914716b7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:35.026681 16705 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.030678 16704 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.041164 16942 tablet_service.cc:1558] Processing DeleteTablet for tablet 406d9b96060f4833ba26879d81f73bdc with delete_type TABLET_DATA_TOMBSTONED (TS ca1b60a074dc47cd8e68cc57a33a94a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34326
I20260709 13:18:35.056288 16946 tablet_service.cc:1558] Processing DeleteTablet for tablet d757b655f89a468ab8fc0ad2914716b7 with delete_type TABLET_DATA_TOMBSTONED (TS ca1b60a074dc47cd8e68cc57a33a94a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34326
I20260709 13:18:35.073890 17751 tablet_replica.cc:333] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:18:35.076499 17751 raft_consensus.cc:2243] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:35.078796 17751 raft_consensus.cc:2272] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:35.082146 17751 ts_tablet_manager.cc:1916] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:35.094991 17751 ts_tablet_manager.cc:1929] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:35.095356 17751 log.cc:1199] T 406d9b96060f4833ba26879d81f73bdc P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/wals/406d9b96060f4833ba26879d81f73bdc
I20260709 13:18:35.096647 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet 406d9b96060f4833ba26879d81f73bdc (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:35.096745 17751 tablet_replica.cc:333] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:18:35.097819 17751 raft_consensus.cc:2243] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:35.098402 17751 raft_consensus.cc:2272] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:35.101148 17751 ts_tablet_manager.cc:1916] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:35.110705 17751 ts_tablet_manager.cc:1929] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:35.111049 17751 log.cc:1199] T d757b655f89a468ab8fc0ad2914716b7 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/wals/d757b655f89a468ab8fc0ad2914716b7
I20260709 13:18:35.113094 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet d757b655f89a468ab8fc0ad2914716b7 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:35.129487 17727 raft_consensus.cc:1064] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:35.130333 17706 raft_consensus.cc:1064] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:35.132125 17727 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:35.132737 17706 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:35.139572 17527 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:35.142009 17742 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:35.142364 16958 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:35.144554 17527 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:35.146679 17727 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:35.148696 16808 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:35.148628 17707 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:35.151978 16958 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:35.154412 17708 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:35.160760 16877 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:35.165475 17631 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:35.166172 17706 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:35.173579 17742 raft_consensus.cc:2955] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.184491 16880 raft_consensus.cc:2955] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.187889 16958 raft_consensus.cc:2955] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.210157 16704 catalog_manager.cc:5697] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.220803 17525 raft_consensus.cc:2955] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.234746 17334 raft_consensus.cc:2955] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.245100 16801 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:35.248476 16806 raft_consensus.cc:2955] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.252820 17527 raft_consensus.cc:2955] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.258713 17525 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:35.263566 16958 raft_consensus.cc:2955] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.267262 17761 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:35.270105 16705 catalog_manager.cc:5697] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:35.271116 16959 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:35.274070 17742 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:18:35.285518 17708 raft_consensus.cc:2955] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.304512 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e37840a1d83b4fe5be57618ff85b8a47 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:35.306385 16959 raft_consensus.cc:2955] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.307157 16880 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:35.308488 16705 catalog_manager.cc:5697] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.306478 17525 raft_consensus.cc:2955] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.321318 17527 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:35.323096 16958 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:35.324463 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet e37840a1d83b4fe5be57618ff85b8a47 with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:35.324597 17727 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:35.326382 17727 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:35.335135 17762 tablet_replica.cc:333] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:18:35.347843 17334 raft_consensus.cc:2955] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.352969 17527 raft_consensus.cc:2955] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.353696 16959 raft_consensus.cc:2955] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.366119 16705 catalog_manager.cc:5697] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:35.367702 17762 raft_consensus.cc:2243] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:35.368482 17762 raft_consensus.cc:2272] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:35.371627 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6fb5156c6c9245bfaeffc22854718789 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:35.373055 17762 ts_tablet_manager.cc:1916] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:35.385037 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fb5156c6c9245bfaeffc22854718789 with delete_type TABLET_DATA_TOMBSTONED (TS 96eaa6dafb3e4bbe914e54dc12507912 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:35.395488 17762 ts_tablet_manager.cc:1929] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:35.396507 17762 log.cc:1199] T e37840a1d83b4fe5be57618ff85b8a47 P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/e37840a1d83b4fe5be57618ff85b8a47
I20260709 13:18:35.397583 17763 tablet_replica.cc:333] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:18:35.398110 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet e37840a1d83b4fe5be57618ff85b8a47 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:35.398448 17763 raft_consensus.cc:2243] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:35.398974 17763 raft_consensus.cc:2272] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:35.401501 17763 ts_tablet_manager.cc:1916] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:35.412693 17763 ts_tablet_manager.cc:1929] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:35.412949 17763 log.cc:1199] T 6fb5156c6c9245bfaeffc22854718789 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/wals/6fb5156c6c9245bfaeffc22854718789
I20260709 13:18:35.414207 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet 6fb5156c6c9245bfaeffc22854718789 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:36.464488 16880 consensus_queue.cc:237] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:36.471758 16959 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:36.472579 16806 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:36.473928 16848 consensus_peers.cc:597] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 778275eedaec440eb9d6de3b4984d656. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:36.474298 17768 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.476151 17767 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.485606 16808 raft_consensus.cc:2955] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.487651 16959 raft_consensus.cc:2955] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.483887 17768 raft_consensus.cc:2955] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.505256 16704 catalog_manager.cc:5697] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.513123 16880 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:36.529723 16958 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:36.530529 16848 consensus_peers.cc:597] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c50b9c8ead54558a785ce80fcc5fb62. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:36.531054 17767 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.533644 16808 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:36.535611 17767 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.548312 17727 raft_consensus.cc:2955] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.551972 16808 raft_consensus.cc:2955] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.553710 16958 raft_consensus.cc:2955] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.560986 16806 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:36.564848 16708 catalog_manager.cc:5697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.572774 16880 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:36.572947 16773 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e62b3fa7cbf498099f802cfe999bd65. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:36.573922 16959 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:36.574115 17706 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.575277 17765 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.592427 17761 raft_consensus.cc:2955] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.608806 16959 raft_consensus.cc:2955] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.613458 16880 raft_consensus.cc:2955] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.620824 16708 catalog_manager.cc:5697] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.622408 16877 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:36.629966 16959 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:36.631933 16848 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05d0b0f25f26402cb5f324812a9f12c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:36.633971 16808 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:36.635957 17768 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:36.638444 17768 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:36.644186 17767 raft_consensus.cc:2955] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.648910 16808 raft_consensus.cc:2955] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.653254 16959 raft_consensus.cc:2955] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.670159 16708 catalog_manager.cc:5697] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:36.868949 17785 ts_tablet_manager.cc:933] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:36.871040 17785 tablet_copy_client.cc:323] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:36.872442 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 778275eedaec440eb9d6de3b4984d656 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:36.872954 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 778275eedaec440eb9d6de3b4984d656 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-778275eedaec440eb9d6de3b4984d656
I20260709 13:18:36.880559 16895 tablet_copy_source_session.cc:215] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:36.885843 17785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 778275eedaec440eb9d6de3b4984d656. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:36.900715 17785 tablet_copy_client.cc:806] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:36.901297 17785 tablet_copy_client.cc:670] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:36.905038 17785 tablet_copy_client.cc:538] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:36.914960 17785 tablet_bootstrap.cc:492] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:36.932062 17785 tablet_bootstrap.cc:492] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:36.932814 17785 tablet_bootstrap.cc:492] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:36.933329 17785 ts_tablet_manager.cc:1403] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.019s	user 0.020s	sys 0.000s
I20260709 13:18:36.935420 17785 raft_consensus.cc:359] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:36.936146 17785 raft_consensus.cc:740] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:36.936712 17785 consensus_queue.cc:260] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:36.942117 17785 ts_tablet_manager.cc:1434] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:18:36.945160 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-778275eedaec440eb9d6de3b4984d656 received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:36.945561 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-778275eedaec440eb9d6de3b4984d656 on tablet 778275eedaec440eb9d6de3b4984d656 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:37.065856 17785 ts_tablet_manager.cc:933] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:37.070654 17785 tablet_copy_client.cc:323] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:37.072700 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 4c50b9c8ead54558a785ce80fcc5fb62 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:37.073169 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 4c50b9c8ead54558a785ce80fcc5fb62 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-4c50b9c8ead54558a785ce80fcc5fb62
I20260709 13:18:37.081003 16895 tablet_copy_source_session.cc:215] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:37.084725 17785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c50b9c8ead54558a785ce80fcc5fb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:37.099926 17785 tablet_copy_client.cc:806] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:37.100448 17785 tablet_copy_client.cc:670] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:37.103466 17785 tablet_copy_client.cc:538] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:37.111820 17785 tablet_bootstrap.cc:492] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:37.130455 17790 ts_tablet_manager.cc:933] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:37.133436 17790 tablet_copy_client.cc:323] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:37.134743 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 05d0b0f25f26402cb5f324812a9f12c4 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:37.135167 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 05d0b0f25f26402cb5f324812a9f12c4 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-05d0b0f25f26402cb5f324812a9f12c4
I20260709 13:18:37.138406 17785 tablet_bootstrap.cc:492] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:37.139344 17785 tablet_bootstrap.cc:492] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:37.140069 17785 ts_tablet_manager.cc:1403] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.009s
I20260709 13:18:37.140851 16895 tablet_copy_source_session.cc:215] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:37.143153 17785 raft_consensus.cc:359] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:37.144136 17790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05d0b0f25f26402cb5f324812a9f12c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:37.144164 17785 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:37.145100 17785 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:37.147735 17785 ts_tablet_manager.cc:1434] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:18:37.149632 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-4c50b9c8ead54558a785ce80fcc5fb62 received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:37.150038 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-4c50b9c8ead54558a785ce80fcc5fb62 on tablet 4c50b9c8ead54558a785ce80fcc5fb62 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:37.162050 17790 tablet_copy_client.cc:806] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:37.162685 17790 tablet_copy_client.cc:670] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:37.165822 17790 tablet_copy_client.cc:538] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:37.179028 17790 tablet_bootstrap.cc:492] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:37.183082 17785 ts_tablet_manager.cc:933] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:37.195647 17785 tablet_copy_client.cc:323] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:37.197487 16819 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet 2e62b3fa7cbf498099f802cfe999bd65 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:37.198024 16819 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet 2e62b3fa7cbf498099f802cfe999bd65 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-2e62b3fa7cbf498099f802cfe999bd65
I20260709 13:18:37.204164 17790 tablet_bootstrap.cc:492] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:37.205062 17790 tablet_bootstrap.cc:492] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:37.212227 16819 tablet_copy_source_session.cc:215] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:37.215206 17790 ts_tablet_manager.cc:1403] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.014s
I20260709 13:18:37.218132 17790 raft_consensus.cc:359] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:37.218966 17790 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:37.219622 17790 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:37.222198 17790 ts_tablet_manager.cc:1434] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:18:37.220633 17785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e62b3fa7cbf498099f802cfe999bd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:37.223888 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-05d0b0f25f26402cb5f324812a9f12c4 received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:37.224282 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-05d0b0f25f26402cb5f324812a9f12c4 on tablet 05d0b0f25f26402cb5f324812a9f12c4 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:37.238176 17785 tablet_copy_client.cc:806] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:37.238694 17785 tablet_copy_client.cc:670] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:37.241739 17785 tablet_copy_client.cc:538] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:37.247337 17785 tablet_bootstrap.cc:492] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:37.259613 17785 tablet_bootstrap.cc:492] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:37.260260 17785 tablet_bootstrap.cc:492] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:37.260713 17785 ts_tablet_manager.cc:1403] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.014s	user 0.015s	sys 0.001s
I20260709 13:18:37.262413 17785 raft_consensus.cc:359] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:37.262923 17785 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:37.263507 17785 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:37.265224 17785 ts_tablet_manager.cc:1434] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:18:37.266866 16819 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-2e62b3fa7cbf498099f802cfe999bd65 received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:37.267225 16819 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-2e62b3fa7cbf498099f802cfe999bd65 on tablet 2e62b3fa7cbf498099f802cfe999bd65 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:37.282678 17527 raft_consensus.cc:1217] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:37.513088 17527 raft_consensus.cc:1217] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:37.583745 17527 raft_consensus.cc:1217] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:37.708885 17527 raft_consensus.cc:1217] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:37.810206 17767 raft_consensus.cc:1064] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:37.812486 17767 consensus_queue.cc:237] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:37.818167 16954 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:37.818953 17527 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:37.820093 17767 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:37.820495 16806 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:37.820909 17727 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:37.821758 17768 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:37.842442 17768 raft_consensus.cc:2955] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:37.854027 17527 raft_consensus.cc:2955] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:37.862187 16704 catalog_manager.cc:5697] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.863168 16806 raft_consensus.cc:2955] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:37.874982 16958 raft_consensus.cc:2955] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:37.919477 16877 consensus_queue.cc:237] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:37.926265 16959 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:37.926450 17527 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:37.928946 17768 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:37.932644 17767 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:37.935308 17768 raft_consensus.cc:2955] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:37.936749 17525 raft_consensus.cc:2955] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:37.954530 16708 catalog_manager.cc:5697] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:37.957561 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 778275eedaec440eb9d6de3b4984d656 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:37.951433 16959 raft_consensus.cc:2955] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:37.969940 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet 778275eedaec440eb9d6de3b4984d656 with delete_type TABLET_DATA_TOMBSTONED (TS 96eaa6dafb3e4bbe914e54dc12507912 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:37.971856 17807 tablet_replica.cc:333] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:18:37.972857 17807 raft_consensus.cc:2243] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:37.973613 17807 raft_consensus.cc:2272] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:37.977108 17807 ts_tablet_manager.cc:1916] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:37.990281 17767 raft_consensus.cc:1064] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:37.993824 17767 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:38.008460 16958 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:38.010455 17807 ts_tablet_manager.cc:1929] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:38.010739 17767 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:38.011408 16806 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:38.011791 17807 log.cc:1199] T 778275eedaec440eb9d6de3b4984d656 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/wals/778275eedaec440eb9d6de3b4984d656
I20260709 13:18:38.012411 17525 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:38.013633 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet 778275eedaec440eb9d6de3b4984d656 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:38.014262 17727 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.015678 17806 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.033525 17806 raft_consensus.cc:2955] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.036861 16958 raft_consensus.cc:2955] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.037312 17525 raft_consensus.cc:2955] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.047211 16806 raft_consensus.cc:2955] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.052683 16708 catalog_manager.cc:5697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.071097 16877 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:38.076356 17525 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:38.076349 16806 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:38.077935 17806 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:38.079548 17808 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:38.088025 17767 raft_consensus.cc:2955] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.093082 17527 raft_consensus.cc:2955] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.095762 16806 raft_consensus.cc:2955] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.109071 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4c50b9c8ead54558a785ce80fcc5fb62 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:38.110911 16705 catalog_manager.cc:5697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.124572 17761 raft_consensus.cc:1064] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:38.126588 17761 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:38.134056 16942 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c50b9c8ead54558a785ce80fcc5fb62 with delete_type TABLET_DATA_TOMBSTONED (TS ca1b60a074dc47cd8e68cc57a33a94a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34326
I20260709 13:18:38.141163 17815 tablet_replica.cc:333] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:18:38.147444 17727 raft_consensus.cc:1064] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:38.149844 17727 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:38.157665 17815 raft_consensus.cc:2243] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:38.158561 17815 raft_consensus.cc:2272] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:38.163373 17527 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:38.166222 16958 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:38.167440 16877 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:38.164886 17781 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:18:38.163450 17815 ts_tablet_manager.cc:1916] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:38.171808 17765 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.174043 17765 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.181886 16959 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:38.183956 17806 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.192745 17524 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:38.194327 16806 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:38.195020 17727 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.196040 17806 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:38.200415 17765 raft_consensus.cc:2955] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.202519 16958 raft_consensus.cc:2955] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.219105 17527 raft_consensus.cc:2955] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.226132 16705 catalog_manager.cc:5697] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.240811 17768 raft_consensus.cc:2955] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.244100 16801 raft_consensus.cc:2955] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.249295 16808 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:38.251931 17524 raft_consensus.cc:2955] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.258023 17527 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:38.259438 17817 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:38.262605 16958 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:38.263900 17817 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:38.264320 17815 ts_tablet_manager.cc:1929] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:38.264904 17815 log.cc:1199] T 4c50b9c8ead54558a785ce80fcc5fb62 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/wals/4c50b9c8ead54558a785ce80fcc5fb62
I20260709 13:18:38.266687 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet 4c50b9c8ead54558a785ce80fcc5fb62 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:38.268186 17765 raft_consensus.cc:2955] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.278275 17525 raft_consensus.cc:2955] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.280350 16954 raft_consensus.cc:2955] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.289530 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2e62b3fa7cbf498099f802cfe999bd65 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:38.299816 16958 raft_consensus.cc:2955] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.311658 16705 catalog_manager.cc:5697] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.319522 16708 catalog_manager.cc:5697] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.326469 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e62b3fa7cbf498099f802cfe999bd65 with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:38.336972 17824 tablet_replica.cc:333] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:18:38.338361 17824 raft_consensus.cc:2243] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:38.338953 17824 pending_rounds.cc:70] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689: Trying to abort 1 pending ops.
I20260709 13:18:38.339294 17824 pending_rounds.cc:77] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305638371842097152 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } } }
I20260709 13:18:38.340627 17824 raft_consensus.cc:2917] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:18:38.341086 17824 raft_consensus.cc:2889] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:18:38.341509 17824 raft_consensus.cc:2272] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:38.344677 17824 ts_tablet_manager.cc:1916] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:38.353317 16878 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:38.370235 17525 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:38.370762 17824 ts_tablet_manager.cc:1929] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:38.371239 17824 log.cc:1199] T 2e62b3fa7cbf498099f802cfe999bd65 P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/2e62b3fa7cbf498099f802cfe999bd65
I20260709 13:18:38.373812 16801 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:38.374624 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet 2e62b3fa7cbf498099f802cfe999bd65 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:38.375698 17768 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:38.376588 17808 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:38.384481 17727 raft_consensus.cc:2955] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.388336 16801 raft_consensus.cc:2955] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.394950 17525 raft_consensus.cc:2955] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.402861 16704 catalog_manager.cc:5697] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:38.406668 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05d0b0f25f26402cb5f324812a9f12c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:38.413784 16942 tablet_service.cc:1558] Processing DeleteTablet for tablet 05d0b0f25f26402cb5f324812a9f12c4 with delete_type TABLET_DATA_TOMBSTONED (TS ca1b60a074dc47cd8e68cc57a33a94a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34326
I20260709 13:18:38.415376 17815 tablet_replica.cc:333] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:18:38.422924 17815 raft_consensus.cc:2243] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:38.423480 17815 raft_consensus.cc:2272] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:38.425824 17815 ts_tablet_manager.cc:1916] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:38.439347 17815 ts_tablet_manager.cc:1929] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:38.439725 17815 log.cc:1199] T 05d0b0f25f26402cb5f324812a9f12c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/wals/05d0b0f25f26402cb5f324812a9f12c4
I20260709 13:18:38.441025 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet 05d0b0f25f26402cb5f324812a9f12c4 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:39.487195 16877 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:39.496129 16954 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:39.497056 16848 consensus_peers.cc:597] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ea18b0f585149f0a5558b066b194a9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.497931 16808 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:39.498999 17825 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:39.500173 17727 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:39.509859 17828 raft_consensus.cc:2955] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.513600 16801 raft_consensus.cc:2955] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.515558 16954 raft_consensus.cc:2955] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.535061 16707 catalog_manager.cc:5697] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.536219 16808 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:39.544497 16877 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:39.545159 16954 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:39.545197 16773 consensus_peers.cc:597] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72998e8e2cff40f3be2ce73539159ecf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.546043 17834 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:39.547423 17765 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.564321 17765 raft_consensus.cc:2955] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.567113 16954 raft_consensus.cc:2955] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.573311 16877 raft_consensus.cc:2955] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.577106 16808 consensus_queue.cc:237] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:39.586199 16704 catalog_manager.cc:5697] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:39.626214 16773 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a7411023b914822890ea380b2bf8efc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.629201 16877 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:39.629204 16954 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:39.630640 17765 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:39.631563 17781 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.645020 17834 raft_consensus.cc:2955] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.647926 16877 raft_consensus.cc:2955] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.657114 16954 raft_consensus.cc:2955] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.658877 16880 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:18:39.668049 16848 consensus_peers.cc:597] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b0d07e74a6f4d4b9accba26620d27f9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.668619 16704 catalog_manager.cc:5697] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:39.670815 16958 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:39.672674 16808 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:39.673787 17831 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:39.675505 17831 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:39.684470 17831 raft_consensus.cc:2955] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.689386 16958 raft_consensus.cc:2955] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.698354 16808 raft_consensus.cc:2955] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:39.700292 16708 catalog_manager.cc:5697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:39.919611 17847 ts_tablet_manager.cc:933] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:39.922051 17847 tablet_copy_client.cc:323] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:39.923801 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 2ea18b0f585149f0a5558b066b194a9d from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:39.924214 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 2ea18b0f585149f0a5558b066b194a9d from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-2ea18b0f585149f0a5558b066b194a9d
I20260709 13:18:39.929155 16895 tablet_copy_source_session.cc:215] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:39.931551 17847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea18b0f585149f0a5558b066b194a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:39.945881 17847 tablet_copy_client.cc:806] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:39.946377 17847 tablet_copy_client.cc:670] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:39.949750 17847 tablet_copy_client.cc:538] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:39.958062 17847 tablet_bootstrap.cc:492] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:39.965598 17849 ts_tablet_manager.cc:933] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:39.967350 17849 tablet_copy_client.cc:323] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:39.968724 16819 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet 72998e8e2cff40f3be2ce73539159ecf from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:39.969223 16819 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet 72998e8e2cff40f3be2ce73539159ecf from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-72998e8e2cff40f3be2ce73539159ecf
I20260709 13:18:39.976609 16819 tablet_copy_source_session.cc:215] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:39.979874 17849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72998e8e2cff40f3be2ce73539159ecf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:39.985865 17847 tablet_bootstrap.cc:492] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:39.986809 17847 tablet_bootstrap.cc:492] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:39.987501 17847 ts_tablet_manager.cc:1403] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.009s
I20260709 13:18:39.991401 17847 raft_consensus.cc:359] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:40.050196 17847 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:40.051110 17847 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:18:40.054241 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 62076.6us
I20260709 13:18:40.063725 17849 tablet_copy_client.cc:806] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:40.065290 17849 tablet_copy_client.cc:670] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:40.067466 17847 ts_tablet_manager.cc:1434] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.080s	user 0.016s	sys 0.049s
I20260709 13:18:40.073513 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-2ea18b0f585149f0a5558b066b194a9d received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:40.073915 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-2ea18b0f585149f0a5558b066b194a9d on tablet 2ea18b0f585149f0a5558b066b194a9d with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:40.076571 17849 tablet_copy_client.cc:538] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:40.120219 17849 tablet_bootstrap.cc:492] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:40.126235 17847 ts_tablet_manager.cc:933] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:40.145893 17856 ts_tablet_manager.cc:933] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:40.154385 17847 tablet_copy_client.cc:323] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:40.156092 16819 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet 3a7411023b914822890ea380b2bf8efc from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:40.156567 16819 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet 3a7411023b914822890ea380b2bf8efc from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-3a7411023b914822890ea380b2bf8efc
I20260709 13:18:40.161266 17849 tablet_bootstrap.cc:492] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:40.162268 17849 tablet_bootstrap.cc:492] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:40.162953 17849 ts_tablet_manager.cc:1403] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.013s
I20260709 13:18:40.164065 16819 tablet_copy_source_session.cc:215] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:40.173566 17847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a7411023b914822890ea380b2bf8efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:40.182375 17849 raft_consensus.cc:359] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:40.185106 17849 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:40.188535 17847 tablet_copy_client.cc:806] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:40.189082 17856 tablet_copy_client.cc:323] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:40.189163 17847 tablet_copy_client.cc:670] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:40.186237 17849 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:40.195724 17849 ts_tablet_manager.cc:1434] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 13:18:40.195964 17847 tablet_copy_client.cc:538] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:40.197239 16819 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-72998e8e2cff40f3be2ce73539159ecf received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:40.197672 16819 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-72998e8e2cff40f3be2ce73539159ecf on tablet 72998e8e2cff40f3be2ce73539159ecf with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:40.197561 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 4b0d07e74a6f4d4b9accba26620d27f9 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:40.198184 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 4b0d07e74a6f4d4b9accba26620d27f9 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-4b0d07e74a6f4d4b9accba26620d27f9
I20260709 13:18:40.207255 16895 tablet_copy_source_session.cc:215] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:40.208532 17847 tablet_bootstrap.cc:492] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:40.212589 17856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0d07e74a6f4d4b9accba26620d27f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:40.238058 17856 tablet_copy_client.cc:806] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:40.240849 17856 tablet_copy_client.cc:670] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:40.262662 17856 tablet_copy_client.cc:538] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:40.268668 17847 tablet_bootstrap.cc:492] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:40.269523 17847 tablet_bootstrap.cc:492] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:40.270258 17847 ts_tablet_manager.cc:1403] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.062s	user 0.027s	sys 0.024s
I20260709 13:18:40.272778 17856 tablet_bootstrap.cc:492] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:40.274827 17847 raft_consensus.cc:359] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:40.275568 17847 raft_consensus.cc:740] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:40.276185 17847 consensus_queue.cc:260] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:40.278728 17847 ts_tablet_manager.cc:1434] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:18:40.280344 16819 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-3a7411023b914822890ea380b2bf8efc received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:40.280763 16819 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-3a7411023b914822890ea380b2bf8efc on tablet 3a7411023b914822890ea380b2bf8efc with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:40.304549 17856 tablet_bootstrap.cc:492] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:40.305419 17856 tablet_bootstrap.cc:492] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:40.306062 17856 ts_tablet_manager.cc:1403] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.012s
I20260709 13:18:40.308561 17856 raft_consensus.cc:359] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:40.309116 17856 raft_consensus.cc:740] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:40.309634 17856 consensus_queue.cc:260] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:40.311630 17856 ts_tablet_manager.cc:1434] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:18:40.313654 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-4b0d07e74a6f4d4b9accba26620d27f9 received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:40.314042 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-4b0d07e74a6f4d4b9accba26620d27f9 on tablet 4b0d07e74a6f4d4b9accba26620d27f9 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:40.460963 17524 raft_consensus.cc:1217] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:40.490293 17524 raft_consensus.cc:1217] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:40.586508 17525 raft_consensus.cc:1217] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:40.622967 17525 raft_consensus.cc:1217] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:41.031543 17831 raft_consensus.cc:1064] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:41.033890 17831 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:41.040897 16959 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.041003 17525 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.042361 17828 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.042717 16808 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.043162 17831 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.043958 17825 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.054179 17828 raft_consensus.cc:2955] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.056064 17525 raft_consensus.cc:2955] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.059994 16959 raft_consensus.cc:2955] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.069614 16808 raft_consensus.cc:2955] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.074584 16708 catalog_manager.cc:5697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.081627 17765 raft_consensus.cc:1064] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:41.084633 17765 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:41.096131 17727 raft_consensus.cc:1064] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:41.099776 17727 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:41.102617 17524 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.103360 16954 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.105543 16880 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.105703 17840 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.108013 17854 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.125919 17765 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:41.143507 16885 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:41.159003 16954 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.164566 17825 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.166604 17525 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.171351 17727 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.173125 16808 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.174443 17765 raft_consensus.cc:1064] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:41.173976 17854 raft_consensus.cc:2955] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.176985 17527 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:41.176651 17765 consensus_queue.cc:237] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:41.176012 16959 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:41.179811 17828 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:41.181466 17828 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:41.186486 17825 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.195423 17825 raft_consensus.cc:2955] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.203346 16959 raft_consensus.cc:2955] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.186988 17527 raft_consensus.cc:2955] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.207197 17526 raft_consensus.cc:2955] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.208389 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b0d07e74a6f4d4b9accba26620d27f9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:41.235606 17525 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.237062 17840 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.251195 16707 catalog_manager.cc:5697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.241822 16705 catalog_manager.cc:5697] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.280082 16953 raft_consensus.cc:2955] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.282454 16880 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.282620 16958 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:41.292434 16880 raft_consensus.cc:2955] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.312325 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b0d07e74a6f4d4b9accba26620d27f9 with delete_type TABLET_DATA_TOMBSTONED (TS 96eaa6dafb3e4bbe914e54dc12507912 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43930
W20260709 13:18:41.314445 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 150497us
I20260709 13:18:41.315620 17873 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:41.329139 17885 tablet_replica.cc:333] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:18:41.334057 17885 raft_consensus.cc:2243] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.334312 17828 raft_consensus.cc:2955] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.336103 17885 raft_consensus.cc:2272] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.341291 17885 ts_tablet_manager.cc:1916] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:41.342809 16953 raft_consensus.cc:2955] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.367278 17885 ts_tablet_manager.cc:1929] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:41.373145 17885 log.cc:1199] T 4b0d07e74a6f4d4b9accba26620d27f9 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/wals/4b0d07e74a6f4d4b9accba26620d27f9
W20260709 13:18:41.369238 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 73872.1us
I20260709 13:18:41.371937 16708 catalog_manager.cc:5697] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.376305 17873 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:41.376689 17527 raft_consensus.cc:2955] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.387164 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet 4b0d07e74a6f4d4b9accba26620d27f9 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:41.400523 16801 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:41.407188 17526 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:41.408644 17765 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:41.408325 17880 raft_consensus.cc:2955] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.425186 16950 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:41.426469 17525 raft_consensus.cc:2955] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.429648 17840 raft_consensus.cc:2955] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.431581 16806 raft_consensus.cc:2955] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.432337 16950 raft_consensus.cc:2955] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.438932 17526 raft_consensus.cc:2955] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.440280 16880 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:41.448416 17524 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:41.449584 16953 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:41.449738 17828 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:41.451293 17854 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:41.451421 17825 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:41.457535 16950 raft_consensus.cc:2955] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.461153 17888 raft_consensus.cc:2955] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.464264 16708 catalog_manager.cc:5697] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.467284 16954 raft_consensus.cc:2955] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.474336 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ea18b0f585149f0a5558b066b194a9d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:41.484061 17524 raft_consensus.cc:2955] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.496553 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72998e8e2cff40f3be2ce73539159ecf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:41.499486 16707 catalog_manager.cc:5697] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.516108 16878 raft_consensus.cc:2955] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.518270 16705 catalog_manager.cc:5697] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.523928 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ea18b0f585149f0a5558b066b194a9d with delete_type TABLET_DATA_TOMBSTONED (TS 96eaa6dafb3e4bbe914e54dc12507912 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:41.524833 17885 tablet_replica.cc:333] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:18:41.525750 17885 raft_consensus.cc:2243] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.526451 17885 raft_consensus.cc:2272] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.531594 17885 ts_tablet_manager.cc:1916] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:41.535607 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet 72998e8e2cff40f3be2ce73539159ecf with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:41.537315 17890 tablet_replica.cc:333] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:18:41.539144 17890 raft_consensus.cc:2243] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.553128 17890 raft_consensus.cc:2272] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.556653 17890 ts_tablet_manager.cc:1916] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:41.559877 16806 consensus_queue.cc:237] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:41.567140 17885 ts_tablet_manager.cc:1929] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:41.567571 17885 log.cc:1199] T 2ea18b0f585149f0a5558b066b194a9d P 96eaa6dafb3e4bbe914e54dc12507912: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/wals/2ea18b0f585149f0a5558b066b194a9d
I20260709 13:18:41.570087 17526 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:41.572171 17890 ts_tablet_manager.cc:1929] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:41.572587 17890 log.cc:1199] T 72998e8e2cff40f3be2ce73539159ecf P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/72998e8e2cff40f3be2ce73539159ecf
I20260709 13:18:41.572810 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet 2ea18b0f585149f0a5558b066b194a9d (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:41.572813 17840 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:41.576148 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet 72998e8e2cff40f3be2ce73539159ecf (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:41.578198 16880 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:41.582103 17854 raft_consensus.cc:2955] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.582737 17526 raft_consensus.cc:2955] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.593101 17840 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:41.600773 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3a7411023b914822890ea380b2bf8efc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:41.603199 16880 raft_consensus.cc:2955] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.606972 16707 catalog_manager.cc:5697] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:41.633978 16942 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a7411023b914822890ea380b2bf8efc with delete_type TABLET_DATA_TOMBSTONED (TS ca1b60a074dc47cd8e68cc57a33a94a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34326
I20260709 13:18:41.637234 17891 tablet_replica.cc:333] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:18:41.638131 17891 raft_consensus.cc:2243] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.639034 17891 raft_consensus.cc:2272] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:41.642419 17891 ts_tablet_manager.cc:1916] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:41.654311 17891 ts_tablet_manager.cc:1929] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:41.654649 17891 log.cc:1199] T 3a7411023b914822890ea380b2bf8efc P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/wals/3a7411023b914822890ea380b2bf8efc
I20260709 13:18:41.656045 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet 3a7411023b914822890ea380b2bf8efc (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:42.714159 16807 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:18:42.721943 16773 consensus_peers.cc:597] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efdef9f5ee0b4225ba140b5208412fde. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.723255 16954 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:42.723497 16878 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:42.725090 17873 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:42.726053 17896 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:42.737668 17873 raft_consensus.cc:2955] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.739671 16954 raft_consensus.cc:2955] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.741597 16878 raft_consensus.cc:2955] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.754107 16953 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:42.757352 16704 catalog_manager.cc:5697] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.770794 16880 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:42.772388 17894 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:18:42.775827 16922 consensus_peers.cc:597] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f6df2c313bf4b0a8bb4d3b4422f4da1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.778586 16807 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:42.781311 17894 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:42.793782 17875 raft_consensus.cc:2955] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.795632 16807 raft_consensus.cc:2955] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.800163 16885 raft_consensus.cc:2955] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.812093 16878 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:42.820294 16708 catalog_manager.cc:5697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.827999 16953 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:42.829512 16807 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:42.829833 16848 consensus_peers.cc:597] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: caf243a747f348a29b25b4642b64788e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.830430 17893 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:42.831357 17888 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:42.843467 17888 raft_consensus.cc:2955] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.858198 16807 raft_consensus.cc:2955] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.860731 16953 raft_consensus.cc:2955] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.868884 16704 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:42.873438 16885 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:42.890214 16806 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:42.890640 16950 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:42.891721 17888 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:42.892937 17909 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:42.894352 16848 consensus_peers.cc:597] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3291b51968ff4989a89ff1c802955900. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:42.905962 17888 raft_consensus.cc:2955] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.911042 16950 raft_consensus.cc:2955] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:42.926376 16704 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:42.930352 16807 raft_consensus.cc:2955] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:43.265983 17914 ts_tablet_manager.cc:933] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:43.268426 17914 tablet_copy_client.cc:323] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:43.270059 16819 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet efdef9f5ee0b4225ba140b5208412fde from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:43.270617 16819 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet efdef9f5ee0b4225ba140b5208412fde from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-efdef9f5ee0b4225ba140b5208412fde
I20260709 13:18:43.280488 16819 tablet_copy_source_session.cc:215] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:43.283411 17916 ts_tablet_manager.cc:933] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:43.285307 17914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdef9f5ee0b4225ba140b5208412fde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.296495 17916 tablet_copy_client.cc:323] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:43.298386 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 3291b51968ff4989a89ff1c802955900 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:43.299036 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 3291b51968ff4989a89ff1c802955900 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-3291b51968ff4989a89ff1c802955900
I20260709 13:18:43.306691 17914 tablet_copy_client.cc:806] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:43.306779 16895 tablet_copy_source_session.cc:215] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:43.307659 17914 tablet_copy_client.cc:670] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:43.311092 17916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3291b51968ff4989a89ff1c802955900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.312230 17914 tablet_copy_client.cc:538] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:43.320068 17914 tablet_bootstrap.cc:492] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:43.326526 17916 tablet_copy_client.cc:806] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:43.327121 17916 tablet_copy_client.cc:670] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:43.331112 17916 tablet_copy_client.cc:538] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:43.340538 17914 tablet_bootstrap.cc:492] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:43.341989 17914 tablet_bootstrap.cc:492] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:43.344321 17914 ts_tablet_manager.cc:1403] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 13:18:43.349304 17914 raft_consensus.cc:359] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:43.350191 17914 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:43.350983 17914 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:43.354113 17916 tablet_bootstrap.cc:492] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:43.370615 17914 ts_tablet_manager.cc:1434] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.010s
I20260709 13:18:43.371523 17919 ts_tablet_manager.cc:933] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:43.376927 16819 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-efdef9f5ee0b4225ba140b5208412fde received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:43.377409 16819 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-efdef9f5ee0b4225ba140b5208412fde on tablet efdef9f5ee0b4225ba140b5208412fde with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:43.392824 17923 ts_tablet_manager.cc:933] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:43.375406 17919 tablet_copy_client.cc:323] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:43.397965 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet caf243a747f348a29b25b4642b64788e from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:43.398454 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet caf243a747f348a29b25b4642b64788e from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-caf243a747f348a29b25b4642b64788e
I20260709 13:18:43.404654 17916 tablet_bootstrap.cc:492] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:43.408106 17916 tablet_bootstrap.cc:492] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:43.408802 17916 ts_tablet_manager.cc:1403] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.011s
I20260709 13:18:43.407140 16895 tablet_copy_source_session.cc:215] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:43.412282 17916 raft_consensus.cc:359] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:43.413146 17916 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:43.413821 17916 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:43.414647 17919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf243a747f348a29b25b4642b64788e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.416719 17916 ts_tablet_manager.cc:1434] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:18:43.437690 16894 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-3291b51968ff4989a89ff1c802955900 received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:43.438174 16894 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-3291b51968ff4989a89ff1c802955900 on tablet 3291b51968ff4989a89ff1c802955900 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:43.458030 17923 tablet_copy_client.cc:323] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.3:33725
I20260709 13:18:43.460018 16969 tablet_copy_service.cc:140] P ca1b60a074dc47cd8e68cc57a33a94a3: Received BeginTabletCopySession request for tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:48222)
I20260709 13:18:43.460520 16969 tablet_copy_service.cc:161] P ca1b60a074dc47cd8e68cc57a33a94a3: Beginning new tablet copy session on tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:48222: session id = 599f9a88b6cd4e818a1c59a0b4522480-6f6df2c313bf4b0a8bb4d3b4422f4da1
I20260709 13:18:43.461931 17919 tablet_copy_client.cc:806] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:43.462483 17919 tablet_copy_client.cc:670] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:43.466881 17919 tablet_copy_client.cc:538] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:43.468675 16969 tablet_copy_source_session.cc:215] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:43.471956 17923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.500711 17919 tablet_bootstrap.cc:492] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:43.513975 17923 tablet_copy_client.cc:806] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:43.514549 17923 tablet_copy_client.cc:670] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:43.519279 17923 tablet_copy_client.cc:538] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:43.530119 17923 tablet_bootstrap.cc:492] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:43.531800 17919 tablet_bootstrap.cc:492] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:43.533744 17919 tablet_bootstrap.cc:492] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:43.534382 17919 ts_tablet_manager.cc:1403] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.007s
I20260709 13:18:43.537408 17919 raft_consensus.cc:359] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:43.538192 17919 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:43.538823 17919 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:43.544867 17919 ts_tablet_manager.cc:1434] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:18:43.547295 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-caf243a747f348a29b25b4642b64788e received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:43.547731 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-caf243a747f348a29b25b4642b64788e on tablet caf243a747f348a29b25b4642b64788e with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:43.554839 17923 tablet_bootstrap.cc:492] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:43.555826 17923 tablet_bootstrap.cc:492] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:43.556468 17923 ts_tablet_manager.cc:1403] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.000s
I20260709 13:18:43.559861 17923 raft_consensus.cc:359] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:43.560580 17923 raft_consensus.cc:740] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:43.561239 17923 consensus_queue.cc:260] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:43.564746 17923 ts_tablet_manager.cc:1434] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:18:43.567273 16969 tablet_copy_service.cc:342] P ca1b60a074dc47cd8e68cc57a33a94a3: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-6f6df2c313bf4b0a8bb4d3b4422f4da1 received from {username='slave'} at 127.0.0.1:48222
I20260709 13:18:43.567771 16969 tablet_copy_service.cc:434] P ca1b60a074dc47cd8e68cc57a33a94a3: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-6f6df2c313bf4b0a8bb4d3b4422f4da1 on tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:43.681087 17526 raft_consensus.cc:1217] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:43.753899 17526 raft_consensus.cc:1217] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:43.838853 17524 raft_consensus.cc:1217] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:43.852742 17524 raft_consensus.cc:1217] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:44.130574 17913 raft_consensus.cc:1064] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:44.133106 17913 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:44.140805 17526 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.142138 16878 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.143688 17880 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:44.146034 17896 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:44.165001 16953 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.167086 17896 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:44.172533 17880 raft_consensus.cc:2955] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.174314 16885 raft_consensus.cc:2955] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.180941 16953 raft_consensus.cc:2955] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.191625 16707 catalog_manager.cc:5697] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.198764 17524 raft_consensus.cc:2955] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.242355 16801 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:44.254099 17524 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:44.255604 17880 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:44.263118 16953 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:44.263787 17896 raft_consensus.cc:2955] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.269906 17913 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:44.272384 17524 raft_consensus.cc:2955] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.302619 17926 raft_consensus.cc:1064] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:44.305457 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet efdef9f5ee0b4225ba140b5208412fde with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:44.305580 17926 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:44.310858 16953 raft_consensus.cc:2955] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.323585 16708 catalog_manager.cc:5697] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.332906 16950 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.335173 17727 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:44.336078 17526 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.338200 17888 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:44.344954 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet efdef9f5ee0b4225ba140b5208412fde with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:44.357123 17943 tablet_replica.cc:333] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:18:44.363835 17943 raft_consensus.cc:2243] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.365186 17943 raft_consensus.cc:2272] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.368093 16807 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.370497 17888 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:44.371173 17943 ts_tablet_manager.cc:1916] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:44.375877 17926 raft_consensus.cc:2955] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.386852 17524 raft_consensus.cc:2955] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.391013 17943 ts_tablet_manager.cc:1929] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:44.391527 17943 log.cc:1199] T efdef9f5ee0b4225ba140b5208412fde P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/efdef9f5ee0b4225ba140b5208412fde
I20260709 13:18:44.393743 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet efdef9f5ee0b4225ba140b5208412fde (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:44.402629 17926 raft_consensus.cc:1064] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:44.402556 16707 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.405174 17926 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:44.406358 16950 raft_consensus.cc:2955] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.419517 16807 raft_consensus.cc:2955] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.432015 17526 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.432726 16953 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.434589 17727 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:44.436707 16807 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.438198 17727 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:44.439450 17940 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:44.447855 17894 raft_consensus.cc:1064] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:44.458467 16880 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:44.464367 17894 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:44.475961 17526 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:44.476635 16801 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:44.478462 17940 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:44.479852 17944 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:44.487959 17940 raft_consensus.cc:2955] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.495739 17524 raft_consensus.cc:2955] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.498348 16801 raft_consensus.cc:2955] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.508206 17888 raft_consensus.cc:2955] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.512612 16950 raft_consensus.cc:2955] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.589022 16707 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:18:44.589986 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 61164.7us
I20260709 13:18:44.595724 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet caf243a747f348a29b25b4642b64788e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:44.599957 16880 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.601321 17952 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:44.605479 16708 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.629544 17524 raft_consensus.cc:2955] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.633587 16942 tablet_service.cc:1558] Processing DeleteTablet for tablet caf243a747f348a29b25b4642b64788e with delete_type TABLET_DATA_TOMBSTONED (TS ca1b60a074dc47cd8e68cc57a33a94a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34326
I20260709 13:18:44.667114 17526 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.672106 17875 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 13:18:44.684384 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 73962.4us
I20260709 13:18:44.684985 16807 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:44.692684 16878 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:44.708078 17962 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:44.717371 17963 tablet_replica.cc:333] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:18:44.720500 17963 raft_consensus.cc:2243] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.721280 17963 raft_consensus.cc:2272] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.736331 17963 ts_tablet_manager.cc:1916] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:44.736862 17527 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:44.746964 17926 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:44.755851 17960 raft_consensus.cc:2955] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.757697 17527 raft_consensus.cc:2955] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.767023 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3291b51968ff4989a89ff1c802955900 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:44.770022 17952 raft_consensus.cc:2955] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.771602 17524 raft_consensus.cc:2955] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.798607 16707 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.800237 16807 raft_consensus.cc:2955] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.810498 16881 raft_consensus.cc:2955] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.815888 16708 catalog_manager.cc:5697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.819352 17963 ts_tablet_manager.cc:1929] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:44.819849 17963 log.cc:1199] T caf243a747f348a29b25b4642b64788e P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/wals/caf243a747f348a29b25b4642b64788e
I20260709 13:18:44.821586 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet caf243a747f348a29b25b4642b64788e (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:44.833748 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet 3291b51968ff4989a89ff1c802955900 with delete_type TABLET_DATA_TOMBSTONED (TS 96eaa6dafb3e4bbe914e54dc12507912 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:44.838927 16950 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:44.857545 16953 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:44.858789 17526 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:44.865224 17962 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:44.869091 16806 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:44.872742 17962 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:44.875013 17967 tablet_replica.cc:333] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:18:44.878162 17967 raft_consensus.cc:2243] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.878720 17967 pending_rounds.cc:70] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912: Trying to abort 1 pending ops.
I20260709 13:18:44.879048 17967 pending_rounds.cc:77] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305638397557731328 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "3291b51968ff4989a89ff1c802955900" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } } }
I20260709 13:18:44.891875 17967 raft_consensus.cc:2917] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:18:44.892390 17967 raft_consensus.cc:2889] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:18:44.892858 17967 raft_consensus.cc:2272] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.896335 17967 ts_tablet_manager.cc:1916] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:44.896623 17926 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:44.907464 16954 raft_consensus.cc:2955] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.915050 17962 raft_consensus.cc:2955] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.917038 16806 raft_consensus.cc:2955] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.921041 17967 ts_tablet_manager.cc:1929] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:44.921514 17967 log.cc:1199] T 3291b51968ff4989a89ff1c802955900 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/wals/3291b51968ff4989a89ff1c802955900
I20260709 13:18:44.924191 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:44.924873 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet 3291b51968ff4989a89ff1c802955900 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:44.933002 17524 raft_consensus.cc:2955] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:44.946899 16704 catalog_manager.cc:5697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:44.959476 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1 with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:44.962908 17968 tablet_replica.cc:333] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:18:44.963900 17968 raft_consensus.cc:2243] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:44.964541 17968 raft_consensus.cc:2272] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:44.967293 17968 ts_tablet_manager.cc:1916] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:44.980589 17968 ts_tablet_manager.cc:1929] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:44.981108 17968 log.cc:1199] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/6f6df2c313bf4b0a8bb4d3b4422f4da1
I20260709 13:18:44.983179 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet 6f6df2c313bf4b0a8bb4d3b4422f4da1 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:46.036233 16878 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:46.042027 16954 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:46.042670 16806 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:46.042711 16848 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fe476f65c0445399ab9cd51828acf2f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.043480 17970 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.044525 17944 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.052708 17926 raft_consensus.cc:2955] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.059116 16801 raft_consensus.cc:2955] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.059974 16954 raft_consensus.cc:2955] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.064479 16878 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:46.071527 16705 catalog_manager.cc:5697] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:46.088261 16848 consensus_peers.cc:597] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a0f9edf7f0a4d878e6da7c3949d2dbe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.090454 16801 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:46.093184 16954 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:46.095970 17970 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.097203 17944 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.116338 17944 raft_consensus.cc:2955] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.120400 16801 raft_consensus.cc:2955] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.125969 16954 raft_consensus.cc:2955] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.139307 16708 catalog_manager.cc:5697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.143294 16801 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:18:46.156725 16773 consensus_peers.cc:597] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 949d7afc13ea44af96dab1af3a1dd354. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.160660 16878 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:46.160653 16954 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:46.161919 17969 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.162693 17957 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.170532 17957 raft_consensus.cc:2955] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.171818 16878 raft_consensus.cc:2955] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.177004 16954 raft_consensus.cc:2955] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.184072 16950 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:46.190500 16704 catalog_manager.cc:5697] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:46.203136 16881 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:46.203444 16922 consensus_peers.cc:597] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 671210bca23f4566a684a188613c1665. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:46.203711 16801 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:46.204835 17962 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.206847 17952 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:46.215157 17952 raft_consensus.cc:2955] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.252339 16881 raft_consensus.cc:2955] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.285205 16704 catalog_manager.cc:5697] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:46.286592 16806 raft_consensus.cc:2955] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:46.589608 17991 ts_tablet_manager.cc:933] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:46.591579 17991 tablet_copy_client.cc:323] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:46.593144 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 7fe476f65c0445399ab9cd51828acf2f from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:46.593566 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 7fe476f65c0445399ab9cd51828acf2f from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-7fe476f65c0445399ab9cd51828acf2f
I20260709 13:18:46.598198 16895 tablet_copy_source_session.cc:215] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:46.600694 17991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe476f65c0445399ab9cd51828acf2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:46.612155 17991 tablet_copy_client.cc:806] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:46.612700 17991 tablet_copy_client.cc:670] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:46.619776 17991 tablet_copy_client.cc:538] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:46.644534 17993 ts_tablet_manager.cc:933] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:46.647285 17994 ts_tablet_manager.cc:933] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:46.652918 17994 tablet_copy_client.cc:323] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:18:46.654438 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:18:46.654930 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-6a0f9edf7f0a4d878e6da7c3949d2dbe
I20260709 13:18:46.655552 17991 tablet_bootstrap.cc:492] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:46.672863 16895 tablet_copy_source_session.cc:215] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:46.674506 17993 tablet_copy_client.cc:323] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.3:33725
I20260709 13:18:46.676976 17994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:46.678529 16969 tablet_copy_service.cc:140] P ca1b60a074dc47cd8e68cc57a33a94a3: Received BeginTabletCopySession request for tablet 671210bca23f4566a684a188613c1665 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:48222)
I20260709 13:18:46.679033 16969 tablet_copy_service.cc:161] P ca1b60a074dc47cd8e68cc57a33a94a3: Beginning new tablet copy session on tablet 671210bca23f4566a684a188613c1665 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:48222: session id = 599f9a88b6cd4e818a1c59a0b4522480-671210bca23f4566a684a188613c1665
I20260709 13:18:46.696682 17994 tablet_copy_client.cc:806] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:46.700264 17994 tablet_copy_client.cc:670] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:46.701574 17998 ts_tablet_manager.cc:933] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:46.708201 17994 tablet_copy_client.cc:538] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:46.709069 16969 tablet_copy_source_session.cc:215] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:46.718230 17994 tablet_bootstrap.cc:492] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:46.720453 17993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 671210bca23f4566a684a188613c1665. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:46.727092 17998 tablet_copy_client.cc:323] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:46.729095 16819 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet 949d7afc13ea44af96dab1af3a1dd354 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:46.729588 16819 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet 949d7afc13ea44af96dab1af3a1dd354 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-949d7afc13ea44af96dab1af3a1dd354
I20260709 13:18:46.729717 17991 tablet_bootstrap.cc:492] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:46.730595 17991 tablet_bootstrap.cc:492] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:46.731237 17991 ts_tablet_manager.cc:1403] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.076s	user 0.025s	sys 0.025s
I20260709 13:18:46.736735 16819 tablet_copy_source_session.cc:215] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:46.736017 17991 raft_consensus.cc:359] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:46.737301 17991 raft_consensus.cc:740] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:46.737910 17991 consensus_queue.cc:260] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:46.736752 17993 tablet_copy_client.cc:806] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:46.739780 17993 tablet_copy_client.cc:670] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:46.740408 17998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 949d7afc13ea44af96dab1af3a1dd354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:46.744704 17993 tablet_copy_client.cc:538] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:46.764079 17993 tablet_bootstrap.cc:492] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:46.765105 17998 tablet_copy_client.cc:806] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:46.767127 17991 ts_tablet_manager.cc:1434] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.036s	user 0.021s	sys 0.009s
I20260709 13:18:46.768216 17998 tablet_copy_client.cc:670] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:46.769629 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-7fe476f65c0445399ab9cd51828acf2f received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:46.770056 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-7fe476f65c0445399ab9cd51828acf2f on tablet 7fe476f65c0445399ab9cd51828acf2f with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:46.786064 17994 tablet_bootstrap.cc:492] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:46.786983 17994 tablet_bootstrap.cc:492] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:46.787629 17994 ts_tablet_manager.cc:1403] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.020s
I20260709 13:18:46.790398 17994 raft_consensus.cc:359] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:46.791185 17994 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:46.792016 17994 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:46.794387 17994 ts_tablet_manager.cc:1434] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:18:46.771739 17998 tablet_copy_client.cc:538] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:46.801862 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-6a0f9edf7f0a4d878e6da7c3949d2dbe received from {username='slave'} at 127.0.0.1:42010
I20260709 13:18:46.802261 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-6a0f9edf7f0a4d878e6da7c3949d2dbe on tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:46.809705 17998 tablet_bootstrap.cc:492] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:46.818004 17993 tablet_bootstrap.cc:492] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:46.819197 17993 tablet_bootstrap.cc:492] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:46.819926 17993 ts_tablet_manager.cc:1403] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.009s
I20260709 13:18:46.824206 17993 raft_consensus.cc:359] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:46.825052 17993 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:46.825727 17993 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:46.828140 17993 ts_tablet_manager.cc:1434] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:18:46.830894 16969 tablet_copy_service.cc:342] P ca1b60a074dc47cd8e68cc57a33a94a3: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-671210bca23f4566a684a188613c1665 received from {username='slave'} at 127.0.0.1:48222
I20260709 13:18:46.831275 16969 tablet_copy_service.cc:434] P ca1b60a074dc47cd8e68cc57a33a94a3: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-671210bca23f4566a684a188613c1665 on tablet 671210bca23f4566a684a188613c1665 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:46.849244 17998 tablet_bootstrap.cc:492] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:46.850497 17998 tablet_bootstrap.cc:492] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:46.851122 17998 ts_tablet_manager.cc:1403] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.009s
I20260709 13:18:46.853870 17998 raft_consensus.cc:359] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:46.854662 17998 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:46.855260 17998 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:46.860232 17998 ts_tablet_manager.cc:1434] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:18:46.861732 16819 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-949d7afc13ea44af96dab1af3a1dd354 received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:46.862129 16819 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-949d7afc13ea44af96dab1af3a1dd354 on tablet 949d7afc13ea44af96dab1af3a1dd354 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:46.952550 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:47.024013 17524 raft_consensus.cc:1217] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:47.052153 16881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:47.052829 16881 raft_consensus.cc:606] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:47.055282 16881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:47.055830 16881 raft_consensus.cc:606] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:47.066346 16881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:47.066861 16881 raft_consensus.cc:606] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:47.081501 16881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:47.082046 16881 raft_consensus.cc:606] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:47.084617 16881 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caf243a747f348a29b25b4642b64788e"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:47.085106 16881 raft_consensus.cc:606] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:47.093339 17524 raft_consensus.cc:1217] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:47.107723 16806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:18:47.108243 16806 raft_consensus.cc:606] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:47.109661 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:47.111102 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:47.113550 17524 raft_consensus.cc:1217] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:47.133944 17944 raft_consensus.cc:993] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:47.134392 17944 raft_consensus.cc:1081] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:47.136260 16950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:52044
I20260709 13:18:47.136806 16950 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:47.137120 16950 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.143383 16950 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:47.145658 16950 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:47.146935 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:47.147532 16881 raft_consensus.cc:3055] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:47.147878 16881 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:47.148552 16881 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:47.147418 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:47.149708 16881 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.150070 16806 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.155823 16881 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:47.156232 16806 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:47.156970 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:47.157738 17952 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.158191 17952 raft_consensus.cc:697] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:47.164284 17952 consensus_queue.cc:237] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:47.165377 17524 raft_consensus.cc:1217] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:47.186813 17944 raft_consensus.cc:993] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:47.187326 17999 raft_consensus.cc:1081] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:47.188732 17526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caf243a747f348a29b25b4642b64788e"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44626
I20260709 13:18:47.189215 17526 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:47.189524 17526 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.195703 17526 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.200760 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:47.201294 16806 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.207017 18007 raft_consensus.cc:993] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:47.207566 18007 raft_consensus.cc:1081] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:47.208525 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:47.209048 16881 raft_consensus.cc:3055] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:47.209329 16881 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:47.209985 16881 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.210968 16881 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.210796 16704 catalog_manager.cc:5697] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.212275 17526 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:47.214510 17524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44636
I20260709 13:18:47.214979 17524 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:47.215284 17524 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.217247 16806 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:47.219707 16881 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:47.221148 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:47.221935 18001 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.221679 17524 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.225817 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:47.226334 16806 raft_consensus.cc:3055] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:47.226614 16806 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:47.228581 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:47.229100 16878 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.229439 17524 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:47.230581 18001 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:18:47.231514 18001 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.236279 16878 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:47.237237 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:18:47.237313 16806 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.238590 16806 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.239413 18013 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.250835 16806 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:47.254595 16705 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.263569 18013 raft_consensus.cc:697] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:18:47.265515 18013 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.288570 16705 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.384938 17944 raft_consensus.cc:993] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:47.385371 17999 raft_consensus.cc:1081] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:47.386682 16953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:52044
I20260709 13:18:47.387135 16953 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:47.387518 16953 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.392694 16953 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:47.394212 16953 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:47.394757 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:47.395321 16806 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.395447 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:47.396064 16878 raft_consensus.cc:3055] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:47.396358 16878 raft_consensus.cc:740] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:47.396986 16878 consensus_queue.cc:260] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:47.397801 16878 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.401621 16806 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:47.402864 16924 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:47.403493 16878 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:47.403618 18011 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.404166 18011 raft_consensus.cc:697] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:47.404966 18011 consensus_queue.cc:237] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:47.421396 16705 catalog_manager.cc:5697] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.486323 17999 raft_consensus.cc:993] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:47.489092 17999 raft_consensus.cc:1081] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:47.490967 17526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44626
I20260709 13:18:47.491473 17526 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:47.491887 17526 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.498162 17526 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.500168 17526 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:47.500612 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:47.501039 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:47.501179 16881 raft_consensus.cc:3055] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:47.501524 16881 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:47.501541 16950 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.502358 16881 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.503543 16881 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.505141 17944 raft_consensus.cc:993] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:47.505587 17944 raft_consensus.cc:1081] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:47.507287 17524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44626
I20260709 13:18:47.507761 17524 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:47.508085 17524 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.508239 16950 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:47.509585 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:47.510309 18013 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.510763 18013 raft_consensus.cc:697] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:18:47.511575 18013 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.518356 17944 raft_consensus.cc:1064] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:47.520092 18008 raft_consensus.cc:1064] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:47.522409 18008 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.525624 17944 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.526003 16705 catalog_manager.cc:5697] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.532505 17526 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:47.534240 17970 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:47.535476 17524 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.547441 16881 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:47.548076 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:47.548661 16806 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.548695 17524 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:47.550627 16807 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:47.557629 18010 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:47.560866 16806 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:47.561498 18010 raft_consensus.cc:1064] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:47.561477 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:47.561872 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:47.562076 16881 raft_consensus.cc:3055] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:47.562424 16881 raft_consensus.cc:740] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:47.562675 18013 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:47.563163 18013 raft_consensus.cc:697] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:18:47.564013 18013 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.566903 16954 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:47.567369 16950 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:47.568969 18008 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:47.569100 18010 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.570458 16878 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:47.572232 17527 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:47.575014 18007 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:47.576315 16881 consensus_queue.cc:260] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.576975 18027 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:47.581939 16881 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:47.589766 18007 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:47.605070 16705 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.618949 16881 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:47.627635 18011 raft_consensus.cc:1064] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:47.630123 18011 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:47.636264 16806 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:47.637611 18013 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:47.646243 18008 raft_consensus.cc:2955] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:47.648550 17527 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:47.649282 17526 raft_consensus.cc:2955] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:47.667104 17944 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:18:47.672353 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 49380.2us
I20260709 13:18:47.662900 16950 raft_consensus.cc:2955] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:47.625908 17970 raft_consensus.cc:2955] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:47.694976 16705 catalog_manager.cc:5697] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.700424 16801 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.701910 17990 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:47.716811 17524 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:47.721235 16881 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:47.727820 17990 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:47.728176 16807 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:47.730455 17990 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:47.746717 16878 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:47.775189 18038 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:47.894214 16801 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:47.965266 16801 raft_consensus.cc:2955] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:47.969152 16806 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:47.988332 16880 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:47.989320 16877 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:47.990546 17970 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:47.990599 16880 raft_consensus.cc:2955] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.013876 16950 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:48.031282 18013 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:48.033136 18013 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:48.034283 18013 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:48.035496 17524 raft_consensus.cc:2955] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.041440 16880 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.050235 17952 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:48.050843 16956 raft_consensus.cc:2955] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.053107 17990 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:48.075971 16707 catalog_manager.cc:5697] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.080374 16807 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:48.115751 18027 raft_consensus.cc:2955] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.126185 17990 raft_consensus.cc:2955] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.129663 16807 raft_consensus.cc:2955] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.131156 16884 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:48.140175 17527 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:48.143750 16808 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:48.147297 17970 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:48.147007 16883 raft_consensus.cc:2955] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.162492 16958 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:48.162302 17970 raft_consensus.cc:2955] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.169099 16808 raft_consensus.cc:2955] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.176744 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7fe476f65c0445399ab9cd51828acf2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:48.198194 17970 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:48.204538 17978 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:48.203218 16708 catalog_manager.cc:5697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.228775 16807 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:48.232069 18008 raft_consensus.cc:2955] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.233783 18039 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:48.237538 17524 raft_consensus.cc:2955] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:18:48.247447 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 217307us
I20260709 13:18:48.256048 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:48.265525 16877 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:48.271060 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 949d7afc13ea44af96dab1af3a1dd354 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:48.277652 16956 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:48.277866 18049 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:48.283450 16806 raft_consensus.cc:2955] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.287038 16708 catalog_manager.cc:5697] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.290243 17527 raft_consensus.cc:2955] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.314013 17527 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:48.315176 16704 catalog_manager.cc:5697] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.325627 16942 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fe476f65c0445399ab9cd51828acf2f with delete_type TABLET_DATA_TOMBSTONED (TS ca1b60a074dc47cd8e68cc57a33a94a3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34326
I20260709 13:18:48.327054 16806 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:48.336987 16884 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:48.340592 16953 raft_consensus.cc:2955] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.346304 18068 tablet_replica.cc:333] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:18:48.350594 16952 raft_consensus.cc:2955] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.370949 18068 raft_consensus.cc:2243] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:48.371763 18068 raft_consensus.cc:2272] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:48.372836 18046 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:48.374495 18054 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:48.375803 18054 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:48.388548 18068 ts_tablet_manager.cc:1916] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:48.395591 16704 catalog_manager.cc:5697] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 3 to 4, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.402745 18068 ts_tablet_manager.cc:1929] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:48.404057 18068 log.cc:1199] T 7fe476f65c0445399ab9cd51828acf2f P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/wals/7fe476f65c0445399ab9cd51828acf2f
I20260709 13:18:48.405678 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet 7fe476f65c0445399ab9cd51828acf2f (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
W20260709 13:18:48.431617 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 57758.5us
I20260709 13:18:48.432590 18054 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:48.438544 17527 raft_consensus.cc:2955] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.444267 17524 raft_consensus.cc:2955] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.472779 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:48.498900 18054 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:48.503123 16953 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:48.506271 16942 tablet_service.cc:1558] Processing DeleteTablet for tablet 7fe476f65c0445399ab9cd51828acf2f with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:34326
I20260709 13:18:48.514344 16884 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:48.516745 18038 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:48.530659 18055 raft_consensus.cc:2955] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.536933 16880 raft_consensus.cc:2955] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.537931 17527 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:48.544284 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet 7fe476f65c0445399ab9cd51828acf2f (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:48.556651 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet 949d7afc13ea44af96dab1af3a1dd354 with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:48.567027 16884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:48.567625 16884 raft_consensus.cc:606] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:48.569571 18039 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:48.575834 16884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:48.576365 16884 raft_consensus.cc:606] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:48.578655 16884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:48.579174 16884 raft_consensus.cc:606] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:48.581941 18027 raft_consensus.cc:993] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:48.582402 18027 raft_consensus.cc:1081] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:48.583912 16801 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:18:48.584523 16801 raft_consensus.cc:606] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:48.588195 16878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efa1a19816094c78802287ff39e74b62"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:48.588721 16878 raft_consensus.cc:606] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:48.591744 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:48.593346 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:48.593838 17524 raft_consensus.cc:2955] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.617956 18078 tablet_replica.cc:333] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:18:48.620906 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 671210bca23f4566a684a188613c1665 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:48.629364 17527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44626
I20260709 13:18:48.644124 17527 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:48.644482 17527 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.643734 18078 raft_consensus.cc:2243] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:48.649195 18078 raft_consensus.cc:2272] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:48.652060 17527 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:48.652640 18078 ts_tablet_manager.cc:1916] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:48.654922 17527 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:48.658849 16705 catalog_manager.cc:5697] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.667342 18078 ts_tablet_manager.cc:1929] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:48.667871 18078 log.cc:1199] T 949d7afc13ea44af96dab1af3a1dd354 P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/949d7afc13ea44af96dab1af3a1dd354
I20260709 13:18:48.667742 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:48.668402 16953 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.674324 16953 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:48.676800 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:48.676903 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet 949d7afc13ea44af96dab1af3a1dd354 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:48.677603 18070 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:48.678201 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:48.678846 16880 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:48.678975 18049 raft_consensus.cc:993] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:48.678280 18070 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:18:48.679153 16880 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:48.679339 18046 raft_consensus.cc:993] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:48.679503 18049 raft_consensus.cc:1081] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:48.680073 18046 raft_consensus.cc:1081] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:48.679942 16880 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:48.680001 18070 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:48.681259 16880 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.684126 16953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efa1a19816094c78802287ff39e74b62"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:52044
I20260709 13:18:48.684644 16953 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:48.685041 16953 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.684698 16884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44084
I20260709 13:18:48.688414 16884 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:48.688803 16884 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.691107 16953 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:48.693732 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:48.694243 16806 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.696323 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet 671210bca23f4566a684a188613c1665 with delete_type TABLET_DATA_TOMBSTONED (TS 96eaa6dafb3e4bbe914e54dc12507912 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:48.700259 16707 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.704444 16806 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:48.705610 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:48.706419 18038 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:48.706884 18038 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:48.708093 18038 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:48.712364 16953 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:48.712517 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:48.713074 16877 raft_consensus.cc:3055] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:48.713353 16877 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:48.713662 16880 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:48.714010 16877 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:48.714977 16877 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.721040 16877 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:48.722142 16884 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:48.727136 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:48.727712 16806 raft_consensus.cc:3055] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:48.728032 16806 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:48.728744 16806 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:48.729610 16877 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:48.731432 16884 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:48.730134 16806 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.732461 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:48.734993 17527 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:48.737149 18080 tablet_replica.cc:333] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:18:48.737349 16953 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.738412 18080 raft_consensus.cc:2243] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:48.739038 18080 raft_consensus.cc:2272] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:48.735345 16707 catalog_manager.cc:5697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.739785 18047 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:48.743942 18027 raft_consensus.cc:993] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:48.744377 18027 raft_consensus.cc:1081] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:48.746356 16953 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:48.746644 16952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:52044
I20260709 13:18:48.747231 16952 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:48.747601 16952 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.746793 18027 raft_consensus.cc:2955] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.752957 17527 raft_consensus.cc:2955] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.750449 18080 ts_tablet_manager.cc:1916] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:48.764400 16806 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:48.765048 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:48.766690 18010 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:48.768414 16952 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:48.769299 18010 raft_consensus.cc:697] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:48.769304 18080 ts_tablet_manager.cc:1929] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:48.770017 18080 log.cc:1199] T 671210bca23f4566a684a188613c1665 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/wals/671210bca23f4566a684a188613c1665
I20260709 13:18:48.770583 16952 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:48.770268 18010 consensus_queue.cc:237] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:48.771911 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:48.772451 16806 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.777402 16707 catalog_manager.cc:5697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 1 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.778157 16806 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:48.779549 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet 671210bca23f4566a684a188613c1665 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:18:48.779553 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:48.780938 18038 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:48.781375 18038 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:48.782267 18038 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:48.783710 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:48.785106 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:48.785641 16877 raft_consensus.cc:3055] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:48.785933 16877 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:48.786592 16877 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:48.787534 16877 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.793841 16952 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:18:48.795763 18046 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:48.799906 16952 raft_consensus.cc:2955] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:48.810595 16877 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:48.813723 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe with delete_type TABLET_DATA_TOMBSTONED (TS 96eaa6dafb3e4bbe914e54dc12507912 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:48.814599 18080 tablet_replica.cc:333] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:18:48.815343 18080 raft_consensus.cc:2243] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:48.814827 16705 catalog_manager.cc:5697] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.815987 18080 raft_consensus.cc:2272] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:48.818658 18080 ts_tablet_manager.cc:1916] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:48.821080 16707 catalog_manager.cc:5697] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.837706 18080 ts_tablet_manager.cc:1929] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:18:48.838874 18080 log.cc:1199] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 96eaa6dafb3e4bbe914e54dc12507912: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/wals/6a0f9edf7f0a4d878e6da7c3949d2dbe
I20260709 13:18:48.840235 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet 6a0f9edf7f0a4d878e6da7c3949d2dbe (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
W20260709 13:18:48.879240 16906 debug-util.cc:398] Leaking SignalData structure 0x7b080010a000 after lost signal to thread 15723
W20260709 13:18:48.880370 16906 debug-util.cc:398] Leaking SignalData structure 0x7b08000e17e0 after lost signal to thread 16742
W20260709 13:18:48.881481 16906 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5b60 after lost signal to thread 16834
W20260709 13:18:48.882608 16906 debug-util.cc:398] Leaking SignalData structure 0x7b08002f57a0 after lost signal to thread 16909
W20260709 13:18:48.883749 16906 debug-util.cc:398] Leaking SignalData structure 0x7b080027d580 after lost signal to thread 16983
W20260709 13:18:48.885100 16906 debug-util.cc:398] Leaking SignalData structure 0x7b08003429a0 after lost signal to thread 17551
I20260709 13:18:48.969209 18010 raft_consensus.cc:993] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:48.969702 18010 raft_consensus.cc:1081] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:48.971187 17527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44626
I20260709 13:18:48.971697 17527 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:48.972028 17527 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.980547 17527 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:48.982353 17527 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:48.982884 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:48.983451 16806 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.984002 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:48.985435 16877 raft_consensus.cc:3055] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:48.985728 16877 raft_consensus.cc:740] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:48.986400 16877 consensus_queue.cc:260] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:48.987830 16877 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:48.989035 16806 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:48.989908 17492 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:48.990509 18070 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:48.990929 18070 raft_consensus.cc:697] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:18:48.991709 18070 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:48.998139 16877 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:49.003579 16705 catalog_manager.cc:5697] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.171849 16952 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:49.173399 18054 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:49.189607 16953 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:49.191419 18046 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:49.198709 16884 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:49.200573 18054 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:49.201305 16806 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:49.207258 18027 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:49.258579 16807 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:49.260001 18055 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:49.268000 16807 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:49.270272 18055 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:49.277419 16880 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:49.283869 18055 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:49.306602 16884 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:49.313668 18039 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:49.436020 16801 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:49.437919 18070 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:49.458407 16884 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:49.459779 18088 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:49.594319 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:49.649343 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:49.694131 16807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:18:49.694684 16807 raft_consensus.cc:606] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:49.697105 16877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:49.697561 16877 raft_consensus.cc:606] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:49.716084 16952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:18:49.716609 16952 raft_consensus.cc:606] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:49.719060 16807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:18:49.719619 16807 raft_consensus.cc:606] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:49.725845 16807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:18:49.726384 16807 raft_consensus.cc:606] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:49.729416 16807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:18:49.729938 16807 raft_consensus.cc:606] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:49.730919 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:49.732290 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:49.755968 18010 raft_consensus.cc:993] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:49.756528 17970 raft_consensus.cc:1081] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:49.758302 17524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44626
I20260709 13:18:49.758731 17524 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:49.759055 17524 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:49.764153 17524 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:49.766494 17524 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:49.767179 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:49.767365 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:49.767818 16877 raft_consensus.cc:3055] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:49.767958 16952 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:49.768189 16877 raft_consensus.cc:740] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:49.769012 16877 consensus_queue.cc:260] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:49.770046 16877 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:49.775166 16952 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:49.776180 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:49.776702 16877 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:49.776836 18070 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:49.777375 18070 raft_consensus.cc:697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:18:49.778111 18070 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:49.789220 16704 catalog_manager.cc:5697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.854136 17978 raft_consensus.cc:993] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:49.854570 17978 raft_consensus.cc:1081] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:49.858299 17524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44636
I20260709 13:18:49.859845 17524 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:49.860204 17524 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:49.867916 17524 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:49.877158 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:49.877668 16807 raft_consensus.cc:3055] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:49.877947 16807 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:49.878568 16807 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:49.879498 16807 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:49.889665 16807 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:49.890717 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:49.891485 18070 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:49.891958 18070 raft_consensus.cc:697] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:18:49.892779 18070 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:49.900245 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:49.900945 16952 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:49.905143 17524 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:18:49.906361 16756 auto_rebalancer.cc:629] Failed to schedule move for tablet 7c407adc8efe4ee9859c31d64a280e7a: Remote error: Service unavailable: leader transfer in progress
I20260709 13:18:49.921257 16952 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:49.919042 16807 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:49.922938 16704 catalog_manager.cc:5697] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.925097 17978 raft_consensus.cc:993] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:49.925508 17978 raft_consensus.cc:1081] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:49.926905 16877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44084
I20260709 13:18:49.927513 16877 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:49.927953 16877 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:49.934891 16877 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:49.935822 16952 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:49.936729 16877 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:49.937245 16880 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:49.937989 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:18:49.938470 16773 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa815b919c824fb196befa2fd6eeac35. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.938515 16952 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:49.939448 17978 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:49.940954 18109 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:49.943106 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:49.943740 16807 raft_consensus.cc:3055] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:49.944092 16807 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:49.944703 16952 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:49.951809 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:49.951633 16807 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:49.953023 17970 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:49.953881 17970 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:49.954763 17970 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:49.989531 16807 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:49.983048 18109 raft_consensus.cc:993] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:49.991104 17978 raft_consensus.cc:1081] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:49.991946 17978 raft_consensus.cc:2955] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:49.985036 16704 catalog_manager.cc:5697] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.976828 18098 raft_consensus.cc:993] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:18:49.996966 18098 raft_consensus.cc:1081] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:18:49.998742 16877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44084
I20260709 13:18:49.999323 16877 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:49.999689 16801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:18:50.000177 16801 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.000490 16801 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:49.999643 16877 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.006070 16806 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:50.010169 16801 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:50.014912 16953 raft_consensus.cc:2955] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:50.015898 16801 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:50.011524 16877 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:50.023703 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:50.024226 16952 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.026304 16807 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:50.030145 16952 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:50.022923 16877 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:50.031208 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:50.032593 17970 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:50.033089 17970 raft_consensus.cc:697] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:50.033963 17970 consensus_queue.cc:237] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:50.034439 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:50.035020 16956 raft_consensus.cc:3055] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:50.035318 16956 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:50.036113 16956 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:50.037339 16956 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.041366 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:50.041972 16883 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:50.044921 16956 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:18:50.047219 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:50.048327 16801 raft_consensus.cc:3055] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:50.048633 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:50.049492 18008 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:50.050132 18008 raft_consensus.cc:697] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:50.051096 18008 consensus_queue.cc:237] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:50.055599 16883 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:18:50.022926 16704 catalog_manager.cc:5697] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:50.062639 16953 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:18:50.064714 16773 consensus_peers.cc:597] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d157a8f033dd43d5a5c824d9e6235fe9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:50.072744 16880 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:50.075229 18113 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:50.048686 16801 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:50.079761 18113 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:50.078576 16801 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:50.081571 16801 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.082706 16883 raft_consensus.cc:2955] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:50.094789 18113 raft_consensus.cc:2955] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:50.104766 16953 raft_consensus.cc:2955] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:50.115175 16883 raft_consensus.cc:2955] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:50.120976 16952 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:50.124609 16801 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:50.135453 16705 catalog_manager.cc:5697] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 2 to 3, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:50.140813 16922 consensus_peers.cc:597] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78ca000fd50c4b38bfdd60badc024845. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:50.144352 16801 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:50.150976 18098 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:50.154886 16883 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:18:50.155560 16704 catalog_manager.cc:5697] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:50.156833 16707 catalog_manager.cc:5697] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:50.169142 18039 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:18:50.275058 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 90793.8us
I20260709 13:18:50.317054 16952 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:50.324949 18054 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:18:50.325125 18113 raft_consensus.cc:993] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:50.365419 18113 raft_consensus.cc:1081] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:50.380674 18130 raft_consensus.cc:2955] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:50.401888 16880 raft_consensus.cc:2955] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:50.405273 16807 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:50.406791 18088 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:50.410750 17527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44636
I20260709 13:18:50.411230 17527 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.411585 17527 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.424520 17527 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:50.424297 16807 raft_consensus.cc:2955] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:18:50.426319 17527 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:50.430855 16877 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:50.431896 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:50.432579 16806 raft_consensus.cc:3055] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:50.432878 16806 raft_consensus.cc:740] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:50.442703 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:50.443270 16877 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.447139 18054 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:50.449522 16806 consensus_queue.cc:260] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:50.453419 16953 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:50.456017 16806 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:50.455641 16877 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:50.459121 18054 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:50.483336 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:18:50.486310 18088 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:50.489964 16802 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:50.501538 16806 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:50.517300 16707 catalog_manager.cc:5697] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 2, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 1 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:50.521852 17970 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:50.528864 18137 ts_tablet_manager.cc:933] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:50.552248 18088 raft_consensus.cc:697] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:18:50.553279 18088 consensus_queue.cc:237] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:50.559413 16806 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:50.572877 18137 tablet_copy_client.cc:323] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:50.574059 16956 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:18:50.577102 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 75584.8us
I20260709 13:18:50.582366 16819 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet aa815b919c824fb196befa2fd6eeac35 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:50.582860 16819 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet aa815b919c824fb196befa2fd6eeac35 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-aa815b919c824fb196befa2fd6eeac35
I20260709 13:18:50.589291 17970 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:50.592500 17970 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:50.594314 16819 tablet_copy_source_session.cc:215] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:50.597743 16705 catalog_manager.cc:5697] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.598664 18137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa815b919c824fb196befa2fd6eeac35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.595132 18148 ts_tablet_manager.cc:933] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:18:50.645193 18137 tablet_copy_client.cc:806] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:50.646193 18137 tablet_copy_client.cc:670] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:50.650668 18137 tablet_copy_client.cc:538] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:50.664590 16956 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:50.666146 18008 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:50.669983 18137 tablet_bootstrap.cc:492] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:50.701299 16958 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:50.713526 16880 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:50.721896 18137 tablet_bootstrap.cc:492] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.722873 18137 tablet_bootstrap.cc:492] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:50.723589 18137 ts_tablet_manager.cc:1403] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.005s
I20260709 13:18:50.729328 18137 raft_consensus.cc:359] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:50.730269 18137 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:50.730973 18137 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:50.732990 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:50.738404 18137 ts_tablet_manager.cc:1434] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:18:50.745319 18155 ts_tablet_manager.cc:933] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:50.754024 16819 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-aa815b919c824fb196befa2fd6eeac35 received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:50.754472 16819 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-aa815b919c824fb196befa2fd6eeac35 on tablet aa815b919c824fb196befa2fd6eeac35 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:50.764070 18148 tablet_copy_client.cc:323] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
I20260709 13:18:50.768661 16819 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet d157a8f033dd43d5a5c824d9e6235fe9 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:18:50.769237 16819 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet d157a8f033dd43d5a5c824d9e6235fe9 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-d157a8f033dd43d5a5c824d9e6235fe9
I20260709 13:18:50.781955 16819 tablet_copy_source_session.cc:215] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:50.791808 18125 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:50.792912 18148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d157a8f033dd43d5a5c824d9e6235fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.799397 18109 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:50.830668 18148 tablet_copy_client.cc:806] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:50.831454 18148 tablet_copy_client.cc:670] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:50.835433 18148 tablet_copy_client.cc:538] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:50.835618 18155 tablet_copy_client.cc:323] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.3:33725
I20260709 13:18:50.838068 16969 tablet_copy_service.cc:140] P ca1b60a074dc47cd8e68cc57a33a94a3: Received BeginTabletCopySession request for tablet 78ca000fd50c4b38bfdd60badc024845 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:48222)
I20260709 13:18:50.838579 16969 tablet_copy_service.cc:161] P ca1b60a074dc47cd8e68cc57a33a94a3: Beginning new tablet copy session on tablet 78ca000fd50c4b38bfdd60badc024845 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:48222: session id = 599f9a88b6cd4e818a1c59a0b4522480-78ca000fd50c4b38bfdd60badc024845
I20260709 13:18:50.844488 18148 tablet_bootstrap.cc:492] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:50.845840 16969 tablet_copy_source_session.cc:215] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:50.849663 18155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ca000fd50c4b38bfdd60badc024845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:50.871105 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:50.893175 17526 raft_consensus.cc:1217] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:18:50.976656 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 94051.1us
I20260709 13:18:50.987499 16880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:50.988076 16880 raft_consensus.cc:606] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:50.992142 16807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:18:50.993216 16807 raft_consensus.cc:606] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:50.995517 18155 tablet_copy_client.cc:806] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:50.996068 18155 tablet_copy_client.cc:670] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:51.000665 16956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:18:51.001204 16956 raft_consensus.cc:606] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:51.005228 16807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:18:51.005726 16807 raft_consensus.cc:606] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:51.007761 18155 tablet_copy_client.cc:538] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:51.010015 16880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:51.010604 16880 raft_consensus.cc:606] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:51.011854 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:51.012269 16883 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:51.013657 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:51.013473 18088 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:51.015277 18148 tablet_bootstrap.cc:492] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:51.016191 18148 tablet_bootstrap.cc:492] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:51.016839 18148 ts_tablet_manager.cc:1403] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.016s
I20260709 13:18:51.020166 18148 raft_consensus.cc:359] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:51.020931 18148 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:51.021534 18148 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:51.028483 18148 ts_tablet_manager.cc:1434] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:18:51.033776 16819 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-d157a8f033dd43d5a5c824d9e6235fe9 received from {username='slave'} at 127.0.0.1:42344
I20260709 13:18:51.034178 16819 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-d157a8f033dd43d5a5c824d9e6235fe9 on tablet d157a8f033dd43d5a5c824d9e6235fe9 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:51.046598 18113 raft_consensus.cc:993] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:51.047158 18113 raft_consensus.cc:1081] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:51.047621 18155 tablet_bootstrap.cc:492] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:18:51.051169 16883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44084
I20260709 13:18:51.051729 16883 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:51.052067 16883 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.056741 16807 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:51.058981 18145 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:51.153192 18155 tablet_bootstrap.cc:492] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:51.154343 18155 tablet_bootstrap.cc:492] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:18:51.155046 18155 ts_tablet_manager.cc:1403] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.108s	user 0.037s	sys 0.030s
I20260709 13:18:51.160745 16883 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:51.163918 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:51.164494 16806 raft_consensus.cc:3055] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:51.164813 16806 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:51.165822 16883 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:51.165961 16806 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:51.168402 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:51.168926 16953 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.170845 16806 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.158249 18155 raft_consensus.cc:359] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:51.173477 18155 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:18:51.174383 18155 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:51.177114 16953 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:51.180083 18155 ts_tablet_manager.cc:1434] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.005s
I20260709 13:18:51.181205 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:51.182345 18163 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:51.182783 18163 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:51.183601 18163 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:51.189443 16969 tablet_copy_service.cc:342] P ca1b60a074dc47cd8e68cc57a33a94a3: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-78ca000fd50c4b38bfdd60badc024845 received from {username='slave'} at 127.0.0.1:48222
I20260709 13:18:51.189968 16969 tablet_copy_service.cc:434] P ca1b60a074dc47cd8e68cc57a33a94a3: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-78ca000fd50c4b38bfdd60badc024845 on tablet 78ca000fd50c4b38bfdd60badc024845 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:51.196408 16806 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:51.219069 16708 catalog_manager.cc:5697] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:51.253211 18008 raft_consensus.cc:993] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:51.253732 18008 raft_consensus.cc:1081] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:51.258945 16880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44084
I20260709 13:18:51.259476 16880 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:51.259833 16880 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.271943 16880 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:51.274044 16880 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:51.275029 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:51.275595 16952 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.276278 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:51.276830 16806 raft_consensus.cc:3055] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:51.277108 16806 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:51.277875 16806 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:51.279268 16806 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.286142 16806 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:51.287027 16952 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:51.287427 16850 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:51.288230 18163 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:51.288734 18163 raft_consensus.cc:697] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:51.289629 18163 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:51.315018 17527 raft_consensus.cc:1217] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:18:51.325726 16708 catalog_manager.cc:5697] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:51.336410 17970 raft_consensus.cc:993] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:51.336897 18163 raft_consensus.cc:1081] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Signalling peer ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:51.341471 16952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:52044
I20260709 13:18:51.342000 16952 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:51.342379 16952 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.361948 16952 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:51.364683 16952 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:51.366658 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:51.367187 16880 raft_consensus.cc:3055] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:51.367452 16880 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:51.368141 16880 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:51.376048 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:51.376689 16806 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.381752 18135 raft_consensus.cc:993] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:18:51.382280 18130 raft_consensus.cc:1081] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:18:51.386853 16802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:18:51.387403 16802 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:51.387794 16802 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.392606 16806 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:18:51.394593 16802 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:51.395975 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:51.396778 16802 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:51.396838 16880 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:51.398720 18038 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:51.399256 18038 raft_consensus.cc:697] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:51.400672 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:51.401245 16883 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.402608 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:51.403184 16956 raft_consensus.cc:3055] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:51.403462 16956 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:51.408532 16883 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:51.404259 16956 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:51.408324 18038 consensus_queue.cc:237] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:51.411278 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:51.412127 18109 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:51.412635 18109 raft_consensus.cc:697] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:51.413532 18109 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:51.416404 16956 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.430820 16956 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:51.435150 16880 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:18:51.452761 18010 raft_consensus.cc:993] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:51.453294 18010 raft_consensus.cc:1081] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:18:51.455039 17527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44626
I20260709 13:18:51.455579 17527 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:51.456025 17527 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.462656 17527 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:51.464462 17527 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:51.467173 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:51.467799 16802 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.473067 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:51.473670 16880 raft_consensus.cc:3055] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:51.473949 16880 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:51.474646 16880 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:51.483569 16880 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:51.471407 16708 catalog_manager.cc:5697] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 1 to 2, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:51.727357 16802 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:51.732015 16802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:51.732632 16802 raft_consensus.cc:606] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:18:51.737304 16802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:51.738795 16802 raft_consensus.cc:606] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:18:51.739758 16694 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 78ca000fd50c4b38bfdd60badc024845 already in progress [suppressed 3 similar messages]
I20260709 13:18:51.743579 16802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:43930
I20260709 13:18:51.744705 16802 raft_consensus.cc:606] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:18:51.749511 16756 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:18:51.749889 16756 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 78ca000fd50c4b38bfdd60badc024845 already in progress
W20260709 13:18:51.750197 16756 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 78ca000fd50c4b38bfdd60badc024845 already in progress
I20260709 13:18:51.764034 16707 catalog_manager.cc:5697] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 2 to 3, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.777125 17492 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:51.778287 18054 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:51.778767 18054 raft_consensus.cc:697] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:18:51.780543 18054 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:51.788564 16807 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:51.799552 18027 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:51.807427 16807 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:51.842250 16952 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:51.853137 16956 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:51.870218 16880 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:51.880971 16708 catalog_manager.cc:5697] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.885030 18027 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:51.895536 17527 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Advancing to term 2
I20260709 13:18:51.909549 17527 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:51.910833 17970 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:51.917596 17970 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:51.921802 18163 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:18:51.924263 18175 raft_consensus.cc:1064] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:51.926856 18175 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:51.949501 16802 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:51.952922 16884 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:51.959579 16884 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:51.964242 17525 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Advancing to term 2
I20260709 13:18:51.979146 18008 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:51.981209 17525 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:51.982939 18008 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:51.999739 18038 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:18:52.005025 16956 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:18:52.006724 18008 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:52.007490 18126 raft_consensus.cc:1064] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:52.020603 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:52.038033 16950 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:52.043725 16877 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:18:52.051815 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 53240us
I20260709 13:18:52.056528 18008 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:52.081642 17524 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:18:52.093351 18109 raft_consensus.cc:993] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:52.078651 18131 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:18:52.110461 18175 raft_consensus.cc:1064] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:18:52.099617 18126 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:52.174400 18008 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:52.176960 18197 raft_consensus.cc:1081] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
W20260709 13:18:52.165282 18183 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:18:52.164397 18180 log.cc:927] Time spent T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:18:52.168776 18175 raft_consensus.cc:1068] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: Unable to promote non-voter 599f9a88b6cd4e818a1c59a0b4522480: Service unavailable: leader transfer in progress
W20260709 13:18:52.249162 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 150461us
I20260709 13:18:52.301970 18190 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:18:52.306675 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 49888.7us
W20260709 13:18:52.324604 18187 log.cc:927] Time spent T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:18:52.353018 16882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44084
W20260709 13:18:52.411156 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 95882us
W20260709 13:18:52.472172 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 52882.3us
I20260709 13:18:52.512991 16810 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:18:52.537139 16739 debug-util.cc:398] Leaking SignalData structure 0x7b0800034580 after lost signal to thread 15723
I20260709 13:18:52.258895 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:52.539273 16739 debug-util.cc:398] Leaking SignalData structure 0x7b080018fe00 after lost signal to thread 16742
I20260709 13:18:52.555505 16882 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:52.561400 16882 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:52.582057 16739 debug-util.cc:398] Leaking SignalData structure 0x7b0800279720 after lost signal to thread 16834
W20260709 13:18:52.628559 16739 debug-util.cc:398] Leaking SignalData structure 0x7b080030e8a0 after lost signal to thread 16909
I20260709 13:18:52.623704 16882 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:18:52.631382 16739 debug-util.cc:398] Leaking SignalData structure 0x7b080033ca60 after lost signal to thread 16983
I20260709 13:18:52.653443 16877 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:18:52.666401 16739 debug-util.cc:398] Leaking SignalData structure 0x7b08003555e0 after lost signal to thread 17551
I20260709 13:18:52.688657 18214 raft_consensus.cc:1064] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
W20260709 13:18:52.689278 18214 raft_consensus.cc:1068] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: Unable to promote non-voter 599f9a88b6cd4e818a1c59a0b4522480: Service unavailable: leader transfer in progress
I20260709 13:18:52.738848 16952 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:52.740049 18224 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:18:52.762684 16882 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:52.757452 18224 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:18:52.820895 18203 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:18:52.837495 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:52.857015 18226 raft_consensus.cc:2955] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:52.860960 17526 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:52.873687 16802 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:52.879725 17525 raft_consensus.cc:2955] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:52.911706 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:52.912397 16804 raft_consensus.cc:3055] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:52.912711 16804 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:52.913538 16804 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:52.937668 18210 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:52.938350 18210 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:52.941136 18210 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:52.949604 16804 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:52.958688 17970 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:52.961552 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:18:52.980094 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 79270us
W20260709 13:18:52.981225 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 77790.6us
I20260709 13:18:52.993595 18221 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:53.060596 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:53.053563 16952 raft_consensus.cc:2955] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:53.102732 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:53.103924 18176 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:53.082540 16879 raft_consensus.cc:2955] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:53.133786 18222 raft_consensus.cc:2955] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:53.144459 16809 raft_consensus.cc:2955] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:53.147192 16804 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:18:53.157612 16850 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:53.221271 17970 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:53.221808 17970 raft_consensus.cc:697] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:18:53.221472 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 63936.5us
I20260709 13:18:53.173844 16878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:53.232486 16878 raft_consensus.cc:606] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:53.173301 16706 catalog_manager.cc:5697] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 2 to 3, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:53.249712 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:18:53.250284 16959 raft_consensus.cc:606] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:53.249958 17970 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:53.267158 16809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:18:53.267720 16809 raft_consensus.cc:606] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:53.292616 16952 raft_consensus.cc:2955] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:53.299120 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:53.300948 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:53.302822 18226 raft_consensus.cc:993] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:53.303294 18226 raft_consensus.cc:1081] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:18:53.313285 16879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44084
I20260709 13:18:53.313943 16879 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.314338 16879 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:53.334918 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 65296.7us
I20260709 13:18:53.360503 16879 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:53.368883 17526 raft_consensus.cc:2955] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:53.380985 16879 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:53.386786 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:53.387358 16810 raft_consensus.cc:3055] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:53.387630 16810 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:53.388288 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:53.388856 16953 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:53.394390 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:18:53.394953 17525 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:53.389688 16810 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:53.402626 16810 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:53.403980 16953 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:53.408811 17525 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:53.429046 16848 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:53.430437 18217 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:53.430910 18217 raft_consensus.cc:697] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:53.431824 18217 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:53.441712 16810 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:53.453977 16707 catalog_manager.cc:5697] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 2 to 3, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 3 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.455957 16707 catalog_manager.cc:5697] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 2 to 4, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:53.474841 16694 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 96eaa6dafb3e4bbe914e54dc12507912 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:53.509558 16708 catalog_manager.cc:5697] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.511109 18217 raft_consensus.cc:993] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:53.511778 18242 raft_consensus.cc:1081] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Signalling peer ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:53.513676 16952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:52044
I20260709 13:18:53.514353 16952 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.515007 16952 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.523962 16952 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:53.529662 16952 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:53.533660 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:53.534319 16804 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.537828 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:53.538390 16881 raft_consensus.cc:3055] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:53.538653 16881 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:53.539469 16880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:53.540114 16880 raft_consensus.cc:606] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:18:53.539763 16879 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:53.541268 16881 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:53.548894 16884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:53.549439 16884 raft_consensus.cc:606] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:18:53.549646 16881 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:53.551810 16804 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:18:53.557124 17525 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:53.559580 16810 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:18:53.563020 18176 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:53.564694 16879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44070
I20260709 13:18:53.565382 16879 raft_consensus.cc:606] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:18:53.565096 18176 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:53.592578 16881 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:18:53.610152 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:53.611074 18038 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:53.611526 18038 raft_consensus.cc:697] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:53.612354 18038 consensus_queue.cc:237] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:53.687467 18135 raft_consensus.cc:993] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:18:53.687981 18135 raft_consensus.cc:1081] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:18:53.696684 17525 raft_consensus.cc:2955] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:53.703112 18217 raft_consensus.cc:2955] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:53.722543 16802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:18:53.723245 16802 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:53.723712 16802 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:53.735581 16802 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:53.737644 16802 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:54.436780 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:54.499643 16708 catalog_manager.cc:5697] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 2 to 3, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:54.546432 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 959) took 1014 ms. Trace:
I20260709 13:18:54.546896 16804 rpcz_store.cc:276] 0709 13:18:53.532231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.533438 (+  1207us) service_pool.cc:224] Handling call
0709 13:18:54.546342 (+1012904us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.562018 18135 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:54.562752 18135 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:54.564834 18135 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:54.573161 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:54.615202 18227 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:54.615844 18227 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:54.618245 18227 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:54.636147 16804 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:54.641422 16802 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:54.643031 18182 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:54.643635 18182 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:54.651795 18182 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:54.989455 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa815b919c824fb196befa2fd6eeac35 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:54.993081 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 1363) took 1243 ms. Trace:
I20260709 13:18:54.999820 16810 rpcz_store.cc:276] 0709 13:18:53.743504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.743631 (+   127us) service_pool.cc:224] Handling call
0709 13:18:54.690016 (+946385us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b58001d0498. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:18:54.985995 (+295979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.986182 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.986219 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.986278 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:54.986324 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.986400 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.986516 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12567808}
I20260709 13:18:54.984001 18214 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.054052 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:55.054721 16959 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:55.055049 16959 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:55.034617 18226 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.089988 18113 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.084147 16959 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.123828 16959 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:55.099593 18226 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.117388 18113 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.137285 18088 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.137910 18088 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.138989 18226 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.139078 18113 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.139732 18113 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.140198 18113 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.141317 18227 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.117606 18182 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.064654 18214 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.140189 18250 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.160182 18130 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.160899 18215 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.160706 18130 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.161370 18215 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.162814 18130 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:55.163259 18215 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.164152 18264 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.164465 18127 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.164706 18264 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.164940 18127 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.168619 18130 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.142066 18224 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.172235 18130 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.173336 18113 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.174016 18268 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.146238 18226 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.176905 18256 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.177270 18182 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.150266 18207 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.177953 18214 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.148543 18175 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.179104 18038 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.173379 18264 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.165373 18215 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.175002 18088 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.218739 18038 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.179456 18250 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:55.216558 16831 debug-util.cc:398] Leaking SignalData structure 0x7b08000faa80 after lost signal to thread 15723
I20260709 13:18:55.169310 18227 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.184185 18268 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.180718 18224 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.216581 18215 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.233551 18270 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.217504 18228 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.229024 18264 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.199069 18175 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.198249 18226 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.282895 18271 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.276559 18127 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:18:55.277403 16831 debug-util.cc:398] Leaking SignalData structure 0x7b0800120160 after lost signal to thread 16742
I20260709 13:18:55.278666 17970 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.261950 18214 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.281683 18038 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:55.282383 18259 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.277813 18113 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.292897 18268 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.283490 18271 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.285966 17970 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.216573 18266 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.229959 18207 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.223402 18256 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.294970 18113 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.288899 18264 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.291268 18214 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.304080 18226 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:18:55.309439 16831 debug-util.cc:398] Leaking SignalData structure 0x7b0800379200 after lost signal to thread 16834
I20260709 13:18:55.333885 17970 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.287235 18228 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.285517 18270 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.366025 18038 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.375872 18263 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.377672 18038 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.321318 18268 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.376577 18263 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.325333 18127 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.301463 18266 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.392419 17970 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.298547 18259 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.397877 18038 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.398524 18274 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.399051 18274 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.399499 18264 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.400173 18269 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.400802 18269 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.402987 17970 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.408568 18265 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.409240 18265 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.412035 18286 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.412735 18286 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.417812 18228 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:55.420018 18259 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.422258 18270 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:55.424708 18274 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.426879 18269 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:55.429309 18263 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.431936 18266 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.386389 18226 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.393041 18268 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.394552 18227 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.394116 18261 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:18:55.407610 16831 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3020 after lost signal to thread 16909
I20260709 13:18:55.402472 18182 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.415511 18286 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.436057 18264 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.447621 18207 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.449625 17970 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.451908 18175 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.452493 18279 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.396471 18127 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.460736 17970 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.462908 17970 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.449285 18215 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.450186 18274 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.451406 18263 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.470332 18215 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.437625 18226 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.470819 18113 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.463881 18224 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.470952 18215 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.475871 18259 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.476042 18226 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.476490 18256 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:55.476435 18259 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.478343 18259 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.478788 18259 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.479198 18259 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.480950 16959 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:55.444012 18284 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.483803 17970 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.461962 18286 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:18:55.473166 16831 debug-util.cc:398] Leaking SignalData structure 0x7b08003677a0 after lost signal to thread 16983
I20260709 13:18:55.470901 18202 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.465184 18265 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.472678 18257 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.470793 18267 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.495638 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.496199 16810 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:18:55.487272 16831 debug-util.cc:398] Leaking SignalData structure 0x7b08003677c0 after lost signal to thread 16984
I20260709 13:18:55.461711 18264 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.498123 18280 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.498307 18254 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.498893 18288 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.499102 18127 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.500339 18215 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.500726 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:55.501396 18251 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.502012 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:55.487593 18214 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.521212 18258 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.508373 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.486943 18253 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.490680 18276 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.510807 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.453146 18261 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.489115 18250 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:55.512320 18260 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.474279 18263 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.518990 16884 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:55.494017 18226 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.468683 18275 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.497375 18210 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.484702 18274 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.490258 18286 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.530051 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.531040 18287 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.568501 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.531176 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.484341 18279 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.532279 18268 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.585073 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.525054 18259 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.526427 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:55.526859 18224 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.526049 18280 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.533432 16802 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:55.572049 16954 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
W20260709 13:18:55.539911 16831 debug-util.cc:398] Leaking SignalData structure 0x7b08002f35a0 after lost signal to thread 17551
I20260709 13:18:55.599033 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.599890 18295 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.601790 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.601945 18255 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.602342 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.610947 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.613682 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.614136 18279 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.615413 16807 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:55.616459 18297 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:18:55.614838 16694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 77294.9us
I20260709 13:18:55.617190 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.588505 18273 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.487720 18284 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.502920 18202 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.514178 18267 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.527524 18288 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.525899 18254 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.585640 18260 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.521229 18251 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.658517 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.589357 18210 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.619984 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.573485 18226 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.520020 18257 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.521826 18258 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:55.607312 16831 debug-util.cc:398] Leaking SignalData structure 0x7b08002f72e0 after lost signal to thread 17552
I20260709 13:18:55.692433 16952 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:55.614442 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.709440 18301 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.611129 18259 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.738144 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.732920 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.707280 18127 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.710242 18301 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.713047 16877 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:55.687342 18279 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.591120 18287 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.537866 18276 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:18:55.726040 16831 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5d60 after lost signal to thread 18221
I20260709 13:18:55.568804 18253 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.583503 18275 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.739358 18127 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.663331 18262 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.725592 18273 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.664347 18255 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.776683 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:55.777735 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 160148us
I20260709 13:18:55.684478 18300 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.715826 18289 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.780354 18274 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.716337 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.796598 16807 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:55.712352 18297 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.657778 18295 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.778972 18264 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:18:55.785712 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 69920.3us
I20260709 13:18:55.652629 18290 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.792635 18288 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.793349 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.793474 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.618719 18224 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.711560 16882 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:55.761976 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:55.800570 18130 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:55.733057 18285 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.785239 18215 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.783245 18302 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.763016 18292 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.762457 18259 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.805816 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:55.801007 18257 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.770934 18279 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.803640 18176 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.783493 18299 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.801620 18263 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.823135 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:55.846331 18273 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.847496 18260 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.827936 18286 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.859943 18280 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.862995 16884 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:55.833891 18264 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.865520 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:55.866271 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.866621 18254 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.836030 18291 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.872016 16801 raft_consensus.cc:1813] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Handling vote request from an unknown peer ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:55.876425 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:55.841473 18175 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:55.858987 18176 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.882197 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:55.882732 18297 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.847541 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.883394 16801 raft_consensus.cc:2410] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:18:55.857272 18113 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.901180 18283 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:18:55.901818 18113 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.903573 18202 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.903844 18113 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.862224 18226 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:55.860710 18273 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:55.904721 18273 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.906702 18273 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.895560 18293 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:55.907351 18293 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:18:55.907898 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 117338us
I20260709 13:18:55.895709 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.896185 18127 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:55.896581 18294 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.897481 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:55.863921 18263 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:55.864068 18207 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.901139 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:55.928884 16801 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:55.928854 18207 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:18:55.843991 18215 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.793912 18300 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.854537 18285 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.891362 18264 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.797806 18262 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:55.830791 18290 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.855505 18302 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.870538 18299 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:56.306254 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:56.013001 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:55.807832 18289 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.907799 18293 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.344987 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:56.104905 18284 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:55.894023 18261 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:18:56.071127 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 95432.4us
I20260709 13:18:56.013048 18275 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.071955 18294 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.894418 18250 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:56.370859 18250 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:56.371187 18176 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:56.371291 18250 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:56.013126 18210 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:56.354245 16880 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:55.913208 18279 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.364064 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:56.304793 18253 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:18:56.364965 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 383516us
I20260709 13:18:56.015170 18251 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:55.938865 16803 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:56.367244 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:56.356690 18263 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:55.931568 18203 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.439s
I20260709 13:18:56.369997 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:56.014765 18291 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:55.919122 18254 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.452s
I20260709 13:18:55.898941 18292 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:56.376122 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:55.929687 18287 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.355662 18265 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:55.931242 18276 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:56.356793 18214 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:56.022571 18304 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.367172 18273 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:56.362171 18202 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:55.931701 18175 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:18:56.419907 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 49985.4us
I20260709 13:18:56.423026 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:56.441581 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:56.426571 16950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:18:56.443318 16950 raft_consensus.cc:606] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:56.414068 18224 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.377678 18261 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:56.435874 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:56.438563 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:56.446422 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:56.428737 18256 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:56.472522 16884 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:56.477517 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:56.414724 18295 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:56.473575 16810 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:56.444581 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:56.473948 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:56.444581 18304 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:56.444830 18268 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:56.446581 18202 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:56.481185 18268 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:56.482363 18304 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.472591 18286 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:56.483176 18202 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:56.483492 18286 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:56.444998 18273 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:56.484952 18175 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:56.485581 18286 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:56.485966 18273 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:56.445051 18176 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:56.486617 18283 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:56.487074 18292 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:56.486718 18176 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:56.488037 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:56.476559 18251 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:56.488552 18289 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:18:56.491293 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 582810us
I20260709 13:18:56.493036 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:56.494036 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:56.437304 18255 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.512943 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:56.510222 16957 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:56.439700 18259 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:56.487232 18283 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:56.501900 16924 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:56.476181 18257 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:56.441296 18284 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:56.444830 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:56.523927 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:56.525473 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:56.483218 18268 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:56.530030 16924 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:56.531075 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:56.501616 18202 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:56.534137 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:56.508039 18253 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:56.534945 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:56.500870 16955 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:18:56.516544 18292 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:56.439479 18265 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:56.530879 18176 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:56.551927 18299 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.553287 18290 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.560274 18207 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.529268 18251 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:56.572341 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 130314us
I20260709 13:18:56.517453 18261 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:56.580629 18302 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.501473 18214 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:56.533471 18284 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:56.581101 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:56.904459 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:56.906332 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:56.917327 16810 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:18:56.917424 17526 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:56.917577 17525 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:56.581563 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:56.904875 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:56.913512 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:56.914878 18261 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:56.582342 16808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 976) took 1054 ms. Trace:
I20260709 13:18:56.540340 18130 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:56.905556 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:18:56.910327 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 470166us
I20260709 13:18:56.917793 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 970) took 1425 ms. Trace:
I20260709 13:18:56.892547 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 1343) took 1376 ms. Trace:
I20260709 13:18:56.927023 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 984) took 1208 ms. Trace:
I20260709 13:18:56.580677 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 1348) took 1079 ms. Trace:
I20260709 13:18:56.545620 18268 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:56.928684 18257 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:56.927364 16809 rpcz_store.cc:276] 0709 13:18:55.712599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.712777 (+   178us) service_pool.cc:224] Handling call
0709 13:18:56.581429 (+868652us) spinlock_profiling.cc:243] Waited 3.53 ms on lock 0x7b58001d0498. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:18:56.920452 (+339023us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8123264}
I20260709 13:18:56.927271 16878 rpcz_store.cc:276] 0709 13:18:55.500120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.503167 (+  3047us) service_pool.cc:224] Handling call
0709 13:18:55.515544 (+ 12377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.707297 (+191753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.707326 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.707372 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:55.707401 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.876417 (+1169016us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54003f4b54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:18:56.876461 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.876582 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440513280}
I20260709 13:18:56.910143 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 1341) took 1410 ms. Trace:
I20260709 13:18:56.938551 16877 rpcz_store.cc:276] 0709 13:18:55.501612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.501779 (+   167us) service_pool.cc:224] Handling call
0709 13:18:56.580507 (+1078728us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54000b4d54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:18:56.580602 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440504192}
I20260709 13:18:56.909474 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:56.957247 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:56.970149 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:56.973258 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:56.974597 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:56.973073 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 947) took 1199 ms. Trace:
I20260709 13:18:56.974576 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:56.844597 18285 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.953532 16806 rpcz_store.cc:276] 0709 13:18:55.492184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.492309 (+   125us) service_pool.cc:224] Handling call
0709 13:18:56.917173 (+1424864us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b58001d0498. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71e9c 00007feeebf71a5b 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:18:56.917358 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.917504 (+   146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.917527 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.917567 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:56.917593 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.917643 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.917736 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5545600}
I20260709 13:18:56.972023 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:56.983162 16881 rpcz_store.cc:276] 0709 13:18:55.773720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.773834 (+   114us) service_pool.cc:224] Handling call
0709 13:18:55.774106 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.803664 (+ 29558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.803725 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.803762 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:55.803803 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.972879 (+1169076us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b54003f3754. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:18:56.972919 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.973021 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67576704}
I20260709 13:18:56.955092 16879 rpcz_store.cc:276] 0709 13:18:55.499533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.500686 (+  1153us) service_pool.cc:224] Handling call
0709 13:18:55.500965 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.375975 (+875010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.378572 (+  2597us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.415636 (+ 37064us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:56.418369 (+  2733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.909905 (+491536us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b5400134a54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:18:56.909954 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.910085 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995234048}
I20260709 13:18:56.967569 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 948) took 1193 ms. Trace:
I20260709 13:18:56.581745 18262 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.925203 18265 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:56.653010 18283 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:56.561508 18253 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:56.908179 18294 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.849664 18293 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:56.572628 18263 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:56.584079 18292 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:57.006400 18257 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:56.970949 18264 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:57.040062 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.573875 18257 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:18:57.100301 16807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 985) took 1362 ms (client timeout 1691 ms). Trace:
I20260709 13:18:56.951826 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 993) took 1009 ms. Trace:
I20260709 13:18:57.007650 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 961) took 1167 ms. Trace:
I20260709 13:18:56.859097 18300 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:56.845541 18291 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:57.215497 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 1345) took 1714 ms. Trace:
I20260709 13:18:57.576956 16876 rpcz_store.cc:276] 0709 13:18:55.500741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.501177 (+   436us) service_pool.cc:224] Handling call
0709 13:18:57.213419 (+1712242us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b580013ef98. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:18:57.214720 (+  1301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.214919 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.214948 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.214996 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:57.215027 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.215112 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.215255 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2676480}
I20260709 13:18:57.052007 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.578575 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.578903 16878 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:57.263782 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:18:57.580449 16878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 968) took 1614 ms (client timeout 2106 ms). Trace:
I20260709 13:18:56.926827 18130 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:57.580817 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.581220 18130 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:57.580992 16878 rpcz_store.cc:269] 0709 13:18:55.965933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.998075 (+1032142us) service_pool.cc:224] Handling call
0709 13:18:57.580380 (+582305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.581559 16879 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:57.514534 18284 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:57.582360 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.314918 16708 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58336 (request call id 232) took 3608 ms. Trace:
I20260709 13:18:57.582619 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.047813 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 977) took 1073 ms. Trace:
I20260709 13:18:57.039088 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:18:57.569679 18250 consensus_meta.cc:287] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 1.198s	user 0.006s	sys 0.004s
I20260709 13:18:56.924424 16808 rpcz_store.cc:276] 0709 13:18:55.528064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.528536 (+   472us) service_pool.cc:224] Handling call
0709 13:18:55.528821 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.583379 (+ 54558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.583412 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.583452 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:55.583481 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.581979 (+998498us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b54001a8454. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:18:56.582037 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.582170 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124974336}
I20260709 13:18:57.257448 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.013247 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 970) took 1018 ms. Trace:
I20260709 13:18:57.289950 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.178392 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.041509 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.290447 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.587779 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:57.590119 16877 rpcz_store.cc:276] 0709 13:18:55.974850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.974318 (+999468us) service_pool.cc:224] Handling call
0709 13:18:57.047743 (+ 73425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18048}
I20260709 13:18:57.595443 16958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 68) took 1065 ms. Trace:
I20260709 13:18:57.580513 16959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 69) took 1004 ms. Trace:
I20260709 13:18:57.586788 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.575531 16880 rpcz_store.cc:276] 0709 13:18:55.840303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.971799 (+1131496us) service_pool.cc:224] Handling call
0709 13:18:57.007581 (+ 35782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.574815 16883 rpcz_store.cc:276] 0709 13:18:55.774506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.774719 (+   213us) service_pool.cc:224] Handling call
0709 13:18:55.775082 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:56.369931 (+594849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.369959 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:56.369999 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:56.370030 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.967205 (+597175us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54000b5254. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:18:56.967260 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.967393 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367577344}
I20260709 13:18:57.579864 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.590502 17524 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:57.595399 16809 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:57.612273 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.596027 16884 rpcz_store.cc:276] 0709 13:18:55.966587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.974396 (+1007809us) service_pool.cc:224] Handling call
0709 13:18:56.984887 (+ 10491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.614540 17526 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:57.597043 16958 rpcz_store.cc:276] 0709 13:18:56.529993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.556591 (+ 26598us) service_pool.cc:224] Handling call
0709 13:18:57.289776 (+733185us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b5800004298. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:18:57.595380 (+305604us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21463424}
I20260709 13:18:57.614914 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.260051 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 1347) took 1723 ms. Trace:
W20260709 13:18:57.574820 16807 rpcz_store.cc:269] 0709 13:18:55.737793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.737902 (+   109us) service_pool.cc:224] Handling call
0709 13:18:57.100124 (+1362222us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b54001897d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:18:57.100245 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132908416}
I20260709 13:18:57.616073 16885 rpcz_store.cc:276] 0709 13:18:55.501313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.502063 (+   750us) service_pool.cc:224] Handling call
0709 13:18:55.502322 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:55.592191 (+ 89869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.592244 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:55.592294 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:55.592337 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.224909 (+1632572us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b5400145fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:18:57.224972 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.225113 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206174080}
I20260709 13:18:57.617750 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 979) took 1251 ms. Trace:
I20260709 13:18:57.618161 16881 rpcz_store.cc:276] 0709 13:18:56.366444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.041222 (+674778us) service_pool.cc:224] Handling call
0709 13:18:57.617697 (+576475us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:57.619302 16924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.018s	sys 0.028s
W20260709 13:18:57.257882 16848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.704s (SENT) [suppressed 3 similar messages]
I20260709 13:18:57.619542 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.620168 16953 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:57.620653 16953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1519) took 1106 ms. Trace:
I20260709 13:18:57.620805 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:18:57.622068 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 49963.2us
I20260709 13:18:57.575003 16804 rpcz_store.cc:276] 0709 13:18:55.908457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.910162 (+  1705us) service_pool.cc:224] Handling call
0709 13:18:56.073721 (+163559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.364822 (+291101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.367449 (+  2627us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.559974 (+192525us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b2c000264b8. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:18:56.560475 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.914486 (+354011us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:56.914550 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.914656 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.915522 (+   866us) raft_consensus.cc:1685] finished
0709 13:18:56.915548 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.915817 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49579,"raft.queue_time_us":54555,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4496,"spinlock_wait_cycles":4584832,"thread_start_us":353540,"threads_started":1,"wal-append.queue_time_us":353452}
I20260709 13:18:56.924892 18251 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:57.624028 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1515) took 1099 ms. Trace:
I20260709 13:18:57.624094 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:57.571116 16704 catalog_manager.cc:5697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 4 to 5, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New cstate: current_term: 2 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:18:57.625309 16952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1522) took 1097 ms. Trace:
I20260709 13:18:57.625448 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:57.615789 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.625896 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.620976 16953 rpcz_store.cc:276] 0709 13:18:56.514150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.619357 (+1105207us) service_pool.cc:224] Handling call
0709 13:18:57.620605 (+  1248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.608664 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:57.626269 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.624909 16957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1517) took 1099 ms. Trace:
W20260709 13:18:57.626854 16924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.018s	sys 0.028s
I20260709 13:18:57.626799 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.626879 16878 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:57.627532 16953 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
W20260709 13:18:57.239548 18256 consensus_meta.cc:287] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.747s	user 0.005s	sys 0.006s
I20260709 13:18:57.626319 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.628068 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.617520 16959 rpcz_store.cc:276] 0709 13:18:56.575901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.583549 (+  7648us) service_pool.cc:224] Handling call
0709 13:18:57.263596 (+680047us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b5800004298. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:18:57.580459 (+316863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9926912}
I20260709 13:18:57.624825 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.625665 16952 rpcz_store.cc:276] 0709 13:18:56.514979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.554405 (+ 39426us) service_pool.cc:224] Handling call
0709 13:18:57.178194 (+623789us) spinlock_profiling.cc:243] Waited 8.92 ms on lock 0x7b5800004298. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:18:57.612790 (+434596us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20517632}
I20260709 13:18:57.631929 17524 raft_consensus.cc:1813] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Handling vote request from an unknown peer ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:57.628896 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.013844 18228 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:57.629742 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.626745 16808 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:57.632647 16877 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:57.633824 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.103221 18285 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:57.630246 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.637540 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.637737 16950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1514) took 1125 ms. Trace:
I20260709 13:18:57.632851 17524 raft_consensus.cc:2410] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:18:57.628278 16953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 67) took 1110 ms. Trace:
I20260709 13:18:57.624532 16954 rpcz_store.cc:276] 0709 13:18:56.513042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.545955 (+ 32913us) service_pool.cc:224] Handling call
0709 13:18:57.257272 (+711317us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b5800004298. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:18:57.612605 (+355333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18973568}
I20260709 13:18:57.627194 16957 rpcz_store.cc:276] 0709 13:18:56.513570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.522419 (+  8849us) service_pool.cc:224] Handling call
0709 13:18:57.290258 (+767839us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b5800004298. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:18:57.612708 (+322450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20404992}
I20260709 13:18:57.314945 18267 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:57.571496 18301 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:57.632272 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.639014 16952 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:57.237174 18215 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:57.633852 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.237439 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.280877 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:18:57.256363 16882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 1349) took 1754 ms (client timeout 1600 ms). Trace:
I20260709 13:18:57.639521 16952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1521) took 1124 ms. Trace:
I20260709 13:18:57.644459 16952 rpcz_store.cc:276] 0709 13:18:56.514693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.632016 (+1117323us) service_pool.cc:224] Handling call
0709 13:18:57.639472 (+  7456us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.264609 18214 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:57.280593 18271 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:57.640131 16953 rpcz_store.cc:276] 0709 13:18:56.518102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.626588 (+1108486us) service_pool.cc:224] Handling call
0709 13:18:57.628211 (+  1623us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.638059 16950 rpcz_store.cc:276] 0709 13:18:56.512743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.611926 (+1099183us) service_pool.cc:224] Handling call
0709 13:18:57.637683 (+ 25757us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.640079 16880 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:57.642225 16924 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:57.643450 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.643661 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.648144 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.648540 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.648802 16951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1516) took 1135 ms. Trace:
I20260709 13:18:57.649115 16880 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:57.649130 16951 rpcz_store.cc:276] 0709 13:18:56.513303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.613065 (+1099762us) service_pool.cc:224] Handling call
0709 13:18:57.648753 (+ 35688us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.649691 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1510) took 1138 ms. Trace:
I20260709 13:18:57.649894 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.650413 16880 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:57.650060 16954 rpcz_store.cc:276] 0709 13:18:56.511658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.649008 (+1137350us) service_pool.cc:224] Handling call
0709 13:18:57.649266 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.649414 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.649438 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.649476 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:57.649504 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.649551 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.649640 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.645377 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.651273 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.639281 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.646166 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.646978 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.650616 16951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1512) took 1138 ms. Trace:
I20260709 13:18:57.651638 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.629894 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.645331 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.690995 16952 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:57.612452 16879 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:57.659427 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1513) took 1147 ms. Trace:
I20260709 13:18:57.691346 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.652081 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.689163 16951 rpcz_store.cc:276] 0709 13:18:56.512217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.649926 (+1137709us) service_pool.cc:224] Handling call
0709 13:18:57.650200 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.650354 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.650378 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.650414 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:57.650442 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.650487 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.650573 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.692754 17525 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:57.630651 18251 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:57.692823 16952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1518) took 1179 ms. Trace:
I20260709 13:18:57.689335 16885 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:57.688695 16884 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:18:57.693704 16952 rpcz_store.cc:276] 0709 13:18:56.513850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.691959 (+1178109us) service_pool.cc:224] Handling call
0709 13:18:57.692239 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.692462 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.692487 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.692582 (+    95us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:57.692611 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.692660 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.692775 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.691802 16954 rpcz_store.cc:276] 0709 13:18:56.512459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.651189 (+1138730us) service_pool.cc:224] Handling call
0709 13:18:57.651409 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.651543 (+   134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.651565 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.651598 (+    33us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:57.651626 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.659226 (+  7600us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.659368 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.652266 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.688719 16881 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:57.651780 16880 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:57.655542 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.694854 16958 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:57.695248 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.695261 16883 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:18:57.695971 16881 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:57.696233 16883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3291b51968ff4989a89ff1c802955900"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:57.696695 16956 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:18:57.697088 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.697336 16956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 66) took 1195 ms. Trace:
I20260709 13:18:57.697693 17522 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:57.692464 16957 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
W20260709 13:18:57.699788 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 57620.1us
I20260709 13:18:57.700587 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.701071 16880 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:57.634191 18300 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:57.705902 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.706454 17524 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:57.707019 16881 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:18:57.707456 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 950) took 1931 ms. Trace:
I20260709 13:18:57.707557 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 953) took 1931 ms. Trace:
I20260709 13:18:57.703056 16924 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:57.697764 16956 rpcz_store.cc:276] 0709 13:18:56.502025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.516946 (+ 14921us) service_pool.cc:224] Handling call
0709 13:18:57.237290 (+720344us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b5800004298. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71eee 0000000000375939 00007feef3fe51e0 00007feef40ae0c4 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:18:57.697259 (+459969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19606400}
I20260709 13:18:57.690480 16955 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:57.708706 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.709273 16955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 1438) took 1140 ms. Trace:
I20260709 13:18:57.705170 18265 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:57.613436 18250 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:57.639024 18256 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:57.708009 16880 rpcz_store.cc:276] 0709 13:18:55.776496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.707024 (+1930528us) service_pool.cc:224] Handling call
0709 13:18:57.707242 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.707366 (+   124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.707379 (+    13us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.707404 (+    25us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:57.707422 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.707452 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.707523 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.707715 16881 rpcz_store.cc:276] 0709 13:18:55.775598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.706598 (+1931000us) service_pool.cc:224] Handling call
0709 13:18:57.706827 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.707283 (+   456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.707419 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.711066 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.700227 16883 raft_consensus.cc:606] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:57.711795 17526 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:57.712105 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 956) took 1934 ms. Trace:
I20260709 13:18:57.697943 18253 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:57.709647 16955 rpcz_store.cc:276] 0709 13:18:56.569425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.581367 (+ 11942us) service_pool.cc:224] Handling call
0709 13:18:57.280688 (+699321us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b5800004298. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:18:57.709215 (+428527us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6661376}
I20260709 13:18:57.698860 18267 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:57.712105 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 955) took 1935 ms. Trace:
I20260709 13:18:57.713819 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.647908 18258 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:57.712906 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:57.643708 18283 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:57.717027 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.653730 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.651885 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.709579 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.716832 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.712625 16881 rpcz_store.cc:276] 0709 13:18:55.777357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.711508 (+1934151us) service_pool.cc:224] Handling call
0709 13:18:57.711758 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.711879 (+   121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.711900 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.711932 (+    32us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:57.711956 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.711997 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.712056 (+    59us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.725390 16950 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:57.725570 16885 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:57.726408 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 959) took 1948 ms. Trace:
I20260709 13:18:57.719023 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.717432 18268 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:57.727088 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.727056 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 960) took 1925 ms. Trace:
I20260709 13:18:57.724972 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 954) took 1948 ms. Trace:
I20260709 13:18:57.727870 18268 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:57.729187 18256 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:57.646414 18228 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:57.728936 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:57.726776 16881 rpcz_store.cc:276] 0709 13:18:55.778278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.725570 (+1947292us) service_pool.cc:224] Handling call
0709 13:18:57.725988 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.726130 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.726152 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.726187 (+    35us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:57.726214 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.726284 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.726364 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.731228 16878 rpcz_store.cc:276] 0709 13:18:55.776788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.712934 (+1936146us) service_pool.cc:224] Handling call
0709 13:18:57.717149 (+  4215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.717291 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.717305 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.717329 (+    24us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:57.717346 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.717418 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.724921 (+  7503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.715508 16880 rpcz_store.cc:276] 0709 13:18:55.777063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.711402 (+1934339us) service_pool.cc:224] Handling call
0709 13:18:57.711651 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.711821 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.711844 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.711878 (+    34us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:57.711904 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.711970 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.712055 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.729722 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 963) took 1862 ms. Trace:
I20260709 13:18:57.740645 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.728585 16885 rpcz_store.cc:276] 0709 13:18:55.801502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.726338 (+1924836us) service_pool.cc:224] Handling call
0709 13:18:57.726565 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.726781 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.726807 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.726845 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:57.726874 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.726925 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.727010 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.740983 16883 rpcz_store.cc:276] 0709 13:18:55.867029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.728395 (+1861366us) service_pool.cc:224] Handling call
0709 13:18:57.728634 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.729452 (+   818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.729475 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.729508 (+    33us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:18:57.729533 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.729581 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.729663 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.714082 18250 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:57.718529 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.735234 16950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1509) took 1223 ms. Trace:
I20260709 13:18:57.654398 18285 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:57.737607 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.747958 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.748090 16954 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:57.748241 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.748878 18301 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:57.749686 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.749802 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:57.750398 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.750764 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.751258 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:57.740727 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.752842 18210 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:57.715476 18300 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:57.742451 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.754771 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.584935 16708 rpcz_store.cc:276] 0709 13:18:53.706939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.708095 (+  1156us) service_pool.cc:224] Handling call
0709 13:18:57.314790 (+3606695us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:55.137680 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:55.138265 (+   585us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:55.138299 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:18:55.138311 (+    12us) tablet.cc:662] Decoding operations
0709 13:18:55.138655 (+   344us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:55.138709 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:55.138734 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:55.138922 (+   188us) tablet.cc:701] Row locks acquired
0709 13:18:55.138939 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:18:55.139075 (+   136us) write_op.cc:270] Start()
0709 13:18:55.139178 (+   103us) write_op.cc:276] Timestamp: P: 1783603135139029 usec, L: 0
0709 13:18:55.139194 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:18:55.163277 (+ 24083us) log.cc:844] Serialized 535 byte log entry
0709 13:18:55.686182 (+522905us) op_driver.cc:464] REPLICATION: finished
0709 13:18:56.489169 (+802987us) write_op.cc:301] APPLY: starting
0709 13:18:56.501043 (+ 11874us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:56.523333 (+ 22290us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:56.533257 (+  9924us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:56.646525 (+113268us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:56.646698 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:56.646759 (+    61us) write_op.cc:312] APPLY: finished
0709 13:18:56.646964 (+   205us) log.cc:844] Serialized 23 byte log entry
0709 13:18:57.038780 (+391816us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:57.038876 (+    96us) write_op.cc:454] Released schema lock
0709 13:18:57.038918 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:57.039330 (+   412us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:57.039357 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":731300,"apply.run_cpu_time_us":27571,"apply.run_wall_time_us":593021,"num_ops":1,"prepare.queue_time_us":634109,"prepare.run_cpu_time_us":16294,"prepare.run_wall_time_us":208090,"raft.queue_time_us":125528,"raft.run_cpu_time_us":11270,"raft.run_wall_time_us":355981,"replication_time_us":516850,"thread_start_us":855661,"threads_started":5,"wal-append.queue_time_us":1200942,"wal-append.run_cpu_time_us":21373,"wal-append.run_wall_time_us":1100881}]]}
I20260709 13:18:57.756610 18262 raft_consensus.cc:993] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: : Instructing follower ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:18:57.733507 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 975) took 1759 ms. Trace:
I20260709 13:18:57.746158 16950 rpcz_store.cc:276] 0709 13:18:56.511401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.648085 (+1136684us) service_pool.cc:224] Handling call
0709 13:18:57.705616 (+ 57531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.725744 (+ 20128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.735040 (+  9296us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b54002157d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:18:57.735186 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44773120}
I20260709 13:18:57.743599 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.741612 18318 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:57.736804 18268 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:57.757256 16884 rpcz_store.cc:276] 0709 13:18:55.974206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.732908 (+1758702us) service_pool.cc:224] Handling call
0709 13:18:57.733146 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.733308 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.733329 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.733363 (+    34us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:57.733379 (+    16us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.733410 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.733472 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.751434 18301 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:57.730976 16876 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:57.751288 16880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:57.751837 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.752012 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:18:57.647045 16882 rpcz_store.cc:269] 0709 13:18:55.501927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.507945 (+  6018us) service_pool.cc:224] Handling call
0709 13:18:57.256087 (+1748142us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540041a0d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:18:57.256261 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240659328}
I20260709 13:18:57.753230 18210 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:57.746122 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.816635 18292 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:57.713621 18267 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:18:57.816720 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 59653.9us
I20260709 13:18:57.758700 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.817456 17519 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:18:57.763069 18262 raft_consensus.cc:1081] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Signalling peer ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
W20260709 13:18:57.780124 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 52736.3us
I20260709 13:18:57.818910 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:18:57.819375 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 71498.2us
I20260709 13:18:57.819667 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.820323 18256 raft_consensus.cc:993] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:18:57.820158 18293 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:57.748239 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:57.741361 18283 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:57.738273 16959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1520) took 1223 ms. Trace:
I20260709 13:18:57.825814 18301 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:57.868271 16959 rpcz_store.cc:276] 0709 13:18:56.514424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.693013 (+1178589us) service_pool.cc:224] Handling call
0709 13:18:57.703646 (+ 10633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.703777 (+   131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.703792 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.703818 (+    26us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:57.703835 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.703866 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.738133 (+ 34267us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54002152d0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:18:57.738221 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23870336}
I20260709 13:18:57.745581 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44070 (request call id 86) took 1380 ms. Trace:
I20260709 13:18:57.828011 16880 raft_consensus.cc:606] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:18:57.833204 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 210184us
I20260709 13:18:57.836642 16954 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:57.837885 17970 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:57.933696 16775 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:57.822108 18318 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:18:57.860327 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 618335us
I20260709 13:18:57.860582 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:57.919775 17526 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEARNER]: Advancing to term 3
I20260709 13:18:57.914502 18182 raft_consensus.cc:1081] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
W20260709 13:18:57.942862 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 82367.8us
W20260709 13:18:57.920557 16756 auto_rebalancer.cc:893] Removing replace marker failed: Leader has not yet committed an operation in its own term
W20260709 13:18:57.943596 16756 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for d157a8f033dd43d5a5c824d9e6235fe9 already in progress
I20260709 13:18:57.921650 18265 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:57.925570 18300 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:18:57.943907 16756 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for d157a8f033dd43d5a5c824d9e6235fe9 already in progress
I20260709 13:18:57.949801 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.950310 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:57.950469 16878 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:57.954645 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.929514 16880 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:18:57.955543 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.956013 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.956368 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.958552 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.915922 18301 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:57.932045 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 957) took 2154 ms. Trace:
I20260709 13:18:57.835475 18210 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:57.955657 16880 raft_consensus.cc:606] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:57.943877 18318 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:57.869853 16877 rpcz_store.cc:276] 0709 13:18:56.356355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.730051 (+1373696us) service_pool.cc:224] Handling call
0709 13:18:57.737092 (+  7041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.972726 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.974614 18263 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:57.974959 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.991278 18263 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:57.969180 16879 rpcz_store.cc:276] 0709 13:18:55.777642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.718340 (+1940698us) service_pool.cc:224] Handling call
0709 13:18:57.822784 (+104444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.838884 (+ 16100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:57.841198 (+  2314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.860832 (+ 19634us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:57.868679 (+  7847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.915276 (+ 46597us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:57.930128 (+ 14852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:57.991711 18263 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:57.979856 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:18:57.993764 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.994481 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:57.994594 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 156419us
I20260709 13:18:57.980562 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:57.948905 18228 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:57.968480 18285 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:18:57.984896 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 210056us
I20260709 13:18:57.985829 18251 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:57.987568 18130 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:57.971269 18265 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:57.949079 18257 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:57.994612 17526 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:18:58.013783 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:57.978868 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:57.972857 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:58.015566 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:18:58.002046 16694 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:58.020839 18329 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:58.022168 18314 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:58.022562 18314 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:58.023540 18314 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:58.024155 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.024940 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.025125 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:58.025509 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:58.026201 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.026631 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.026252 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:58.027223 16809 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:58.019208 16775 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:58.035977 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:58.037638 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.040619 16957 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:18:58.042399 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:58.043175 16954 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:58.044134 16958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3291b51968ff4989a89ff1c802955900"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:52044
I20260709 13:18:58.044400 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:58.044739 16958 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:58.045145 16958 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.045585 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:58.046356 16880 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:18:58.013867 18257 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:58.029812 18228 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.063148 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:58.027776 18322 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.060683 16773 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:58.052764 18215 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.085605 17970 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:18:58.084578 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.089250 16773 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:58.092953 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:58.092898 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:58.064540 18257 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.095943 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:58.064405 18228 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:58.097653 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:58.034046 18182 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:18:58.100270 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.108132 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:58.069571 18322 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:58.085727 18300 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.103883 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:58.109515 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:58.109838 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:58.104163 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.098757 18264 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.106037 18265 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:58.106293 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.076339 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:58.107577 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.114089 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:58.116655 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.104283 18228 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.088997 18215 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:58.116705 16958 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:58.126534 16952 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:58.098135 18323 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.129688 16958 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:58.123045 18271 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.115578 18322 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.110376 18283 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:58.110846 18300 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:58.116019 18264 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:58.128000 18323 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:58.128131 16803 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:18:58.128664 18215 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.131368 18271 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:58.137452 18264 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.137872 18300 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.153746 18251 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:58.140810 18323 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:58.157191 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 138051us
W20260709 13:18:58.157552 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 69682.9us
I20260709 13:18:58.158897 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.160880 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.158345 16848 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.162657 17970 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:58.163069 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.163793 17970 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:58.150269 18271 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.168854 16775 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:58.170727 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.171758 16848 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.174072 17970 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:58.175630 17970 raft_consensus.cc:3055] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:58.175956 17970 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:58.178073 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.180435 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.168298 18332 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.192791 17970 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:58.185930 18332 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:58.202126 18332 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:58.208624 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 58834.4us
I20260709 13:18:58.209092 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:58.209877 16808 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.194113 18320 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.216818 18320 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:58.206357 18130 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:58.215735 18335 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:18:58.223940 18328 log.cc:927] Time spent T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:18:58.252524 18327 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:18:58.218456 18340 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:58.222229 18320 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.225476 18293 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.268168 18293 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:58.224213 18341 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:58.268814 17970 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.269408 18293 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.269773 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:58.254470 18335 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:18:58.296380 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 253660us
I20260709 13:18:58.259581 18257 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:58.301607 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 91691.9us
I20260709 13:18:58.294462 18335 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.341248 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:58.302294 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:18:58.343654 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 166635us
I20260709 13:18:58.352042 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.352699 16801 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:58.352706 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.354410 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:58.346323 18284 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.355515 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:58.355630 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:58.356025 18284 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:58.356491 18284 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.356524 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:58.346475 18182 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.359531 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:58.346860 18267 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:58.368503 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.372579 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.350575 18319 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:18:58.467860 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 103718us
I20260709 13:18:58.362027 18182 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:58.374543 16804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
W20260709 13:18:58.492403 16694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 146686us
I20260709 13:18:58.363133 16708 catalog_manager.cc:5697] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 1 to 2, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:58.354867 18264 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:58.477190 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:58.492616 18182 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:58.536233 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 355828us
I20260709 13:18:58.536998 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.538178 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.541209 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.503821 16804 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:58.543309 18339 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.551836 18339 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:58.552256 18339 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.544162 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:58.554070 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:58.488911 18332 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:58.489820 18319 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:58.565800 16808 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
W20260709 13:18:58.566798 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 219080us
I20260709 13:18:58.569347 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.549113 16804 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.560784 18214 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:58.543431 18353 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:58.565856 18349 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.594643 18271 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:58.600369 18323 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:58.602547 18323 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:58.602640 18342 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:58.595399 16704 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51366 (request call id 182) took 2215 ms. Trace:
W20260709 13:18:58.582010 18301 consensus_meta.cc:287] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.595s	user 0.014s	sys 0.006s
I20260709 13:18:58.619535 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:58.582659 18257 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:18:58.620791 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 66816.4us
I20260709 13:18:58.621649 16775 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:58.622803 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.586396 18214 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:58.587046 18353 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:58.605463 18349 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:58.628268 16775 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:58.629376 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:58.630020 18331 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.630398 18331 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:58.631844 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:58.632899 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:18:58.634838 18333 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:58.634999 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.635877 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.636173 16810 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:58.636626 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.637657 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.637864 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.638177 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.630713 18331 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.638878 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.640506 16809 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:58.641645 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.638813 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.579334 18344 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:58.645385 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.647619 16809 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:18:58.648851 16808 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:58.650588 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.627928 18214 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:58.652546 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.628300 18323 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.611701 18335 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:58.632401 18349 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.615623 18301 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:58.640981 18345 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.647274 18314 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.644562 18130 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.629201 18353 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:58.656133 18323 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:58.608294 16704 rpcz_store.cc:276] 0709 13:18:56.413367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.422844 (+  9477us) service_pool.cc:224] Handling call
0709 13:18:58.595333 (+2172489us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:57.976314 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:57.980068 (+  3754us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:57.980098 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:18:57.980109 (+    11us) tablet.cc:662] Decoding operations
0709 13:18:57.980418 (+   309us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:57.980467 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:57.980492 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:57.980896 (+   404us) tablet.cc:701] Row locks acquired
0709 13:18:57.980914 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:57.981039 (+   125us) write_op.cc:270] Start()
0709 13:18:57.981140 (+   101us) write_op.cc:276] Timestamp: P: 1783603137981001 usec, L: 0
0709 13:18:57.981159 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:57.981750 (+   591us) log.cc:844] Serialized 530 byte log entry
0709 13:18:58.107154 (+125404us) op_driver.cc:464] REPLICATION: finished
0709 13:18:58.371300 (+264146us) write_op.cc:301] APPLY: starting
0709 13:18:58.386111 (+ 14811us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:58.478844 (+ 92733us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:58.534683 (+ 55839us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:58.543341 (+  8658us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:58.543498 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:58.543544 (+    46us) write_op.cc:312] APPLY: finished
0709 13:18:58.552025 (+  8481us) log.cc:844] Serialized 23 byte log entry
0709 13:18:58.552184 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:58.552289 (+   105us) write_op.cc:454] Released schema lock
0709 13:18:58.552327 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:58.552697 (+   370us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:58.552733 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":76096,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":241719,"apply.run_cpu_time_us":2331,"apply.run_wall_time_us":190503,"num_ops":1,"prepare.queue_time_us":331385,"prepare.run_cpu_time_us":2769,"prepare.run_wall_time_us":24815,"replication_time_us":125853,"thread_start_us":475588,"threads_started":2}]]}
I20260709 13:18:58.667709 16810 raft_consensus.cc:2393] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:58.668099 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.658558 18292 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.663890 18323 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.663492 18130 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:58.665596 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.676129 16942 tablet_service.cc:1558] Processing DeleteTablet for tablet aa815b919c824fb196befa2fd6eeac35 with delete_type TABLET_DATA_TOMBSTONED (TS ca1b60a074dc47cd8e68cc57a33a94a3 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34326
I20260709 13:18:58.664254 16802 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:58.670729 18264 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:18:58.674954 18268 consensus_meta.cc:287] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.843s	user 0.007s	sys 0.005s
I20260709 13:18:58.695642 18268 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:58.691939 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:58.682328 18210 consensus_meta.cc:287] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.002s
I20260709 13:18:58.693202 18319 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:58.678781 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:58.694509 18322 consensus_meta.cc:287] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.000s
I20260709 13:18:58.694778 18271 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:58.694941 18332 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:58.672663 18292 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:58.678750 18130 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.704298 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:58.709546 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 47377.2us
I20260709 13:18:58.710980 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:58.714036 18319 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:58.714502 18319 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:58.714977 18319 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:58.704252 16694 catalog_manager.cc:4755] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): ChangeConfig:REMOVE_PEER RPC failed for tablet d157a8f033dd43d5a5c824d9e6235fe9: Remote error: Service unavailable: leader transfer in progress
I20260709 13:18:58.719303 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.697551 18345 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:58.674124 18362 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.706769 18292 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:18:58.729552 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 143049us
I20260709 13:18:58.730332 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:58.732686 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.724027 18335 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:58.704399 18210 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:58.726002 18345 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:58.737286 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:58.705608 18322 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:58.736976 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:58.744249 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:58.744807 16880 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:58.744959 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:18:58.740128 18318 consensus_meta.cc:287] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.740s	user 0.013s	sys 0.007s
I20260709 13:18:58.818742 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:18:58.813925 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 76744.4us
I20260709 13:18:58.825783 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:58.734819 18271 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.812821 16801 raft_consensus.cc:1240] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:58.727249 18362 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:18:58.879295 18251 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:58.883980 16879 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:18:58.886312 18228 consensus_meta.cc:287] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.752s	user 0.005s	sys 0.014s
I20260709 13:18:58.888397 18350 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:58.752351 18256 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:59.156320 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.750007 18357 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.038470 16804 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.190675 16804 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:58.908908 18271 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:18:59.187110 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 361402us
W20260709 13:18:58.960216 18284 consensus_meta.cc:287] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.603s	user 0.005s	sys 0.005s
W20260709 13:18:59.038733 18317 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:18:58.888550 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:58.992357 18366 tablet_replica.cc:333] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:18:59.194113 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:58.811456 18268 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:59.197379 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:18:59.193984 18331 consensus_meta.cc:287] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260709 13:18:58.996734 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:18:59.065500 16882 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
W20260709 13:18:59.188584 18293 consensus_meta.cc:287] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.892s	user 0.006s	sys 0.013s
W20260709 13:18:59.188333 18339 consensus_meta.cc:287] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.636s	user 0.005s	sys 0.005s
I20260709 13:18:59.145906 18210 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:18:59.194077 18320 consensus_meta.cc:287] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.902s	user 0.012s	sys 0.000s
I20260709 13:18:59.204547 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:58.986406 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:18:59.194470 18215 consensus_meta.cc:287] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 1.046s	user 0.007s	sys 0.004s
I20260709 13:18:59.110157 18322 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:58.987964 18365 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:18:59.193334 18353 consensus_meta.cc:287] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.005s
I20260709 13:18:59.205569 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:18:59.050873 18263 consensus_meta.cc:287] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 1.059s	user 0.003s	sys 0.018s
W20260709 13:18:59.195518 18182 consensus_meta.cc:287] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.000s
I20260709 13:18:59.232546 18182 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.223047 18320 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.234760 18182 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:59.235718 18320 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.235472 18263 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.219905 18339 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.237463 18263 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.237892 18339 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.226869 18215 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.238524 16807 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:59.210137 18331 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.218796 18293 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.240170 18215 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:59.163298 18350 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:59.241288 18293 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.175328 18362 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.197381 18256 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:59.206638 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:18:59.242218 17524 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.242574 18256 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.208171 18338 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.220615 16804 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.244266 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.250341 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:18:59.251395 18319 consensus_meta.cc:287] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.002s
I20260709 13:18:58.909145 18318 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.208714 16803 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:59.257565 18338 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.258783 18301 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:18:59.259768 18292 consensus_meta.cc:287] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.524s	user 0.004s	sys 0.004s
W20260709 13:18:59.260107 18314 consensus_meta.cc:287] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.001s
I20260709 13:18:59.260182 18292 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.262183 18292 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:18:59.262495 18349 consensus_meta.cc:287] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.000s
I20260709 13:18:59.262876 18349 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.263168 16803 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:18:59.263334 18319 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:59.264526 18300 consensus_meta.cc:287] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 1.100s	user 0.011s	sys 0.008s
I20260709 13:18:59.264752 16955 raft_consensus.cc:1240] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.264917 18300 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.265353 18319 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:18:59.263192 18130 consensus_meta.cc:287] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.002s
I20260709 13:18:59.266826 18318 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:59.267009 18300 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.267539 18130 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:18:59.268188 18323 consensus_meta.cc:287] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.000s
I20260709 13:18:59.267390 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.268559 18323 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.269505 16803 raft_consensus.cc:2393] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:59.270445 18323 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.271255 16803 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.243013 18331 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:59.241520 18350 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:58.889423 18214 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.252530 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.196041 18271 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:18:59.253159 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 47686.9us
I20260709 13:18:59.254539 17524 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:59.200043 18284 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.255751 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:18:59.255760 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:18:59.267758 18353 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.269644 18130 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:59.272492 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:18:59.272739 16705 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58326 (request call id 269) took 1767 ms. Trace:
I20260709 13:18:58.996289 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:59.320254 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.188863 18228 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.277206 18347 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:59.277562 18349 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:18:59.279253 18345 consensus_meta.cc:287] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 13:18:59.226495 18365 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:18:59.226727 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 481793us
I20260709 13:18:59.351586 18365 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.352800 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.281431 16958 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
W20260709 13:18:59.294000 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.300045 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.280714 18362 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.298552 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.364018 16951 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.309053 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:18:59.365033 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 56075.5us
I20260709 13:18:59.309528 16773 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:18:59.389891 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 80440us
I20260709 13:18:59.319845 16705 rpcz_store.cc:276] 0709 13:18:57.505747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.506143 (+   396us) service_pool.cc:224] Handling call
0709 13:18:59.272562 (+1766419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76511,"reported_tablets":1}
I20260709 13:18:59.342461 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.350755 18345 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.407931 18331 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:59.407948 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:59.409013 16882 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:18:59.409488 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:59.363700 18347 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.388070 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:59.382611 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.385648 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.366331 16950 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 2: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:18:59.408516 18331 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:59.380399 16808 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:59.553956 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:59.363229 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.560111 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:59.420454 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:59.560818 16954 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:18:59.562126 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:59.562628 18347 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:59.421913 18353 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.563340 16878 raft_consensus.cc:2376] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2. Re-sending same reply.
I20260709 13:18:59.414392 18284 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:59.423867 18228 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:59.422549 18214 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.549185 18300 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.566305 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:59.566561 18300 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.566706 18365 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.568632 18300 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.569635 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.570508 16803 raft_consensus.cc:2393] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 2: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:59.547078 16951 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
W20260709 13:18:59.459805 16694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 183743us
I20260709 13:18:59.572649 18365 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.572894 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.574285 18345 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:18:59.574505 16883 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:59.575393 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:59.576153 18365 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:59.576531 18365 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:59.566305 16807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1006) took 1464 ms. Trace:
I20260709 13:18:59.578616 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.578589 16807 rpcz_store.cc:276] 0709 13:18:58.101633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.101752 (+   119us) service_pool.cc:224] Handling call
0709 13:18:58.101981 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.238896 (+1136915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.566116 (+327220us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000997d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:18:59.566250 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2613375872}
I20260709 13:18:59.579756 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.582618 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:18:59.571457 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.564002 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.583984 16880 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.586820 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.588210 16954 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:59.576884 18365 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.588555 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:59.364029 18366 raft_consensus.cc:2243] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.590195 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.594870 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.590699 16878 raft_consensus.cc:1240] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.591253 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.589938 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.409034 18342 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.598728 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.586798 18284 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.599948 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.600522 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.601305 16802 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 2: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:59.601553 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.602227 16807 raft_consensus.cc:2393] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:59.602133 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.602968 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.571448 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.605674 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:59.605443 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.602239 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.608834 16806 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:18:59.610922 16955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1550) took 1249 ms. Trace:
I20260709 13:18:59.613013 16955 rpcz_store.cc:276] 0709 13:18:58.361803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.366759 (+  4956us) service_pool.cc:224] Handling call
0709 13:18:58.479995 (+113236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.265187 (+785192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.610659 (+345472us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b540032afd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:18:59.610835 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783364864}
I20260709 13:18:59.613548 18271 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.588374 18338 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:59.617468 18380 log.cc:927] Time spent T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:59.618862 18271 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.598122 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:18:59.593842 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.409679 18362 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.601192 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.631878 17519 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.633520 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 989) took 1280 ms. Trace:
I20260709 13:18:59.633916 16879 rpcz_store.cc:276] 0709 13:18:58.353285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.355382 (+  2097us) service_pool.cc:224] Handling call
0709 13:18:59.633331 (+1277949us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b5400145fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:18:59.633464 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046363392}
I20260709 13:18:59.635491 16885 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.630369 18268 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:59.636942 16924 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:59.637737 18368 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:18:59.638262 18368 raft_consensus.cc:697] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:59.638854 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.635975 18268 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:59.639631 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.640177 16804 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 2: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:59.410032 18327 consensus_queue.cc:1059] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
I20260709 13:18:59.565507 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.641633 16805 raft_consensus.cc:2393] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:18:59.594997 16775 connection.cc:256] RPC call timeout handler was delayed by -2.2742000639998423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 13:18:59.643759 16775 connection.cc:256] RPC call timeout handler was delayed by -2.0230625629999395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:18:59.644094 16775 connection.cc:256] RPC call timeout handler was delayed by -2.0014625629999045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 13:18:59.644368 16775 connection.cc:256] RPC call timeout handler was delayed by -1.7476625629999489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 13:18:59.644651 16775 connection.cc:256] RPC call timeout handler was delayed by -1.716162562999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 13:18:59.644934 16775 connection.cc:256] RPC call timeout handler was delayed by -1.4083625629998551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
I20260709 13:18:59.639931 18268 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.645159 18360 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:59.645213 16775 connection.cc:256] RPC call timeout handler was delayed by -1.3894923699999708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 13:18:59.653759 16775 connection.cc:256] RPC call timeout handler was delayed by -1.3012923699998282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:18:59.654179 16775 connection.cc:256] RPC call timeout handler was delayed by -1.1356923700000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
I20260709 13:18:59.654870 16775 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:59.651082 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.656394 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:18:59.651312 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.629782 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.653029 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.639178 18368 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.660220 18331 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.661299 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:18:59.661470 18347 raft_consensus.cc:670] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:18:59.663151 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.663790 18327 raft_consensus.cc:3055] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:59.663417 18365 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.663995 16809 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:59.664160 18327 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:59.664497 17526 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.665907 16775 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.668108 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.669754 16810 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 2: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:59.675489 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:59.677769 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:59.681458 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:18:59.682535 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 204206us
I20260709 13:18:59.682987 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:18:59.683794 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 89788.7us
I20260709 13:18:59.684620 18353 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.684667 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.685945 18271 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.686446 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:59.688515 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.689194 18271 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.693358 16924 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:18:59.683403 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.689297 18314 consensus_queue.cc:1059] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:18:59.673575 18362 raft_consensus.cc:2764] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:18:59.693353 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:59.697521 16775 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.693917 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:18:59.690013 16922 leader_election.cc:336] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.642s (SENT)
I20260709 13:18:59.697068 16810 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.693477 18368 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.713326 16922 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:59.698231 16801 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.714272 18368 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.694090 16956 raft_consensus.cc:3055] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:18:59.714980 16922 leader_election.cc:336] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.657s (SENT)
I20260709 13:18:59.695204 17492 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:59.704089 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:59.611541 18350 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.693962 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.706629 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:59.714205 16810 raft_consensus.cc:1240] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.716341 16882 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:18:59.706534 18318 consensus_queue.cc:1059] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:59.694867 16806 raft_consensus.cc:1240] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:59.717191 18382 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:59.717474 18318 raft_consensus.cc:3055] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:59.694357 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:59.707183 18283 consensus_queue.cc:1059] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:59.707770 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:18:59.694489 18349 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:59.683002 18367 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.690541 18214 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:18:59.741868 18214 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:59.742430 18214 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.744561 17520 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.746011 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:59.747830 18368 raft_consensus.cc:3055] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:59.749496 18368 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:59.703609 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:59.746680 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:59.715346 16956 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:59.696024 18130 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:18:59.707116 18365 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.721014 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:59.717600 18382 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:18:59.731034 18329 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.724494 18350 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.724788 18353 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.695128 16803 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.728480 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:18:59.690415 18341 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:59.708529 18366 raft_consensus.cc:2272] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.694649 18253 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:18:59.696488 18314 raft_consensus.cc:3055] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:59.738363 18349 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:18:59.750504 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 46959.3us
I20260709 13:18:59.751847 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1024) took 1008 ms. Trace:
I20260709 13:18:59.705193 18327 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.789875 16809 rpcz_store.cc:276] 0709 13:18:58.743353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.222963 (+479610us) service_pool.cc:224] Handling call
0709 13:18:59.663842 (+440879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.664449 (+   607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.751591 (+ 87142us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54002a8850. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:18:59.751776 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013128448}
I20260709 13:18:59.719952 18318 raft_consensus.cc:740] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:59.674060 18360 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.692420 18345 consensus_queue.cc:1059] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:18:59.759024 18257 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.724045 16804 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.763962 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.797703 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.798023 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.798710 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.717808 18336 consensus_queue.cc:1059] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:18:59.772315 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:18:59.772684 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 44301.5us
I20260709 13:18:59.758857 18215 consensus_queue.cc:1059] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:18:59.763262 18271 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.774497 18331 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:18:59.763236 18362 consensus_queue.cc:1059] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:18:59.806419 18344 raft_consensus.cc:3055] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:59.806753 18344 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:59.768411 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.808032 16882 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:59.808898 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.807511 18344 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.809396 16877 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:59.809906 18344 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.810899 18214 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.760334 18210 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:59.812150 18350 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:18:59.777688 16694 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:59.768489 18130 raft_consensus.cc:697] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:18:59.763294 18382 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.816892 16809 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.748415 16806 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:59.774884 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.773020 18341 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:59.796850 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.775489 18268 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.801267 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.804299 18331 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:18:59.804411 16955 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:18:59.801199 18365 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.805402 18215 raft_consensus.cc:3055] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:18:59.790416 18349 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.789546 18314 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:18:59.815749 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.816033 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.834918 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:59.798856 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.821372 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:18:59.836203 16884 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:59.836230 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:59.837375 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:59.821534 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:59.804966 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:18:59.842144 16922 leader_election.cc:336] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.585s (SENT)
I20260709 13:18:59.842554 16922 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:59.838092 17526 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:59.844658 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:59.845292 17524 raft_consensus.cc:1813] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Handling vote request from an unknown peer ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.845554 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:18:59.845721 17524 raft_consensus.cc:2393] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:18:59.846513 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:18:59.849107 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:59.850683 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:18:59.850764 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:59.852744 16922 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:18:59.851934 17526 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:59.856164 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:59.820333 18327 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:18:59.821009 18341 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:59.792505 18318 consensus_queue.cc:260] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:18:59.864909 16804 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:59.823076 18331 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:59.832549 18215 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:18:59.867168 16952 raft_consensus.cc:1240] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:59.867586 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:59.868155 16850 leader_election.cc:336] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.585s (SENT)
I20260709 13:18:59.868330 16958 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:59.868577 16850 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:18:59.867304 16810 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
W20260709 13:18:59.869634 16850 leader_election.cc:336] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.629s (SENT)
I20260709 13:18:59.869907 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.858904 18262 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:18:59.966852 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 97221.5us
I20260709 13:18:59.868613 18265 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.968375 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:59.832600 18343 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:18:59.973280 16885 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:18:59.854830 18256 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.857244 18257 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.848192 18350 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.849362 18369 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.983748 17527 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:18:59.969162 16808 raft_consensus.cc:2393] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 2: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:18:59.984385 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:59.984701 18382 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:18:59.986799 16850 leader_election.cc:336] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.670s (SENT)
I20260709 13:18:59.987228 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:18:59.969966 16884 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:18:59.867923 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:59.988641 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:59.989068 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:59.989828 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:18:59.990429 17519 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:18:59.991297 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:18:59.870882 16807 raft_consensus.cc:1240] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:18:59.957747 18130 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.974941 18360 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.993481 18342 consensus_queue.cc:1059] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:59.975273 18366 ts_tablet_manager.cc:1916] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:59.957929 18314 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.995920 18314 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:18:59.996205 18342 raft_consensus.cc:3055] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:18:59.996695 18342 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:18:59.998063 18342 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:18:59.978174 18210 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:18:59.973064 18258 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:18:59.981839 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:18:59.987447 18382 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:18:59.994798 18365 consensus_queue.cc:1059] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:59.979846 18215 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:00.008024 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 201940us
W20260709 13:19:00.010224 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 153183us
I20260709 13:19:00.014196 16877 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:00.015306 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:00.009867 18350 consensus_queue.cc:1059] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:18:59.999778 18342 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:00.026808 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 175171us
I20260709 13:19:00.029321 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:00.039947 16809 raft_consensus.cc:2393] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:19:00.045058 16922 leader_election.cc:336] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.731s (SENT)
I20260709 13:19:00.047010 16954 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.053593 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:00.025566 18329 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.057133 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:00.009227 18253 consensus_queue.cc:1059] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:19:00.030045 16803 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:00.058887 16882 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:00.077968 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.068045 18214 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:18:59.954809 18368 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.002142 18262 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.042812 18210 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:00.014631 18341 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.062511 18349 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.078140 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:00.083619 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 96837.8us
I20260709 13:19:00.080058 16881 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:00.071640 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:00.082176 16922 leader_election.cc:336] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.934s (SENT)
I20260709 13:19:00.086036 16922 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:00.086295 18268 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:00.084316 16850 leader_election.cc:336] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.704s (SENT)
I20260709 13:19:00.084671 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:00.086807 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.087467 17519 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:00.087785 17526 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:00.052163 18396 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:00.088272 18331 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.088982 18396 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.089634 18360 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.089953 18389 consensus_queue.cc:1059] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:00.072504 18364 consensus_queue.cc:1059] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:19:00.090320 18360 consensus_queue.cc:1059] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:00.090965 18389 raft_consensus.cc:3055] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.091029 18396 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:00.091240 18364 raft_consensus.cc:3055] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.080910 18130 consensus_queue.cc:1059] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:19:00.088564 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:00.091398 18389 raft_consensus.cc:740] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:00.091683 18364 raft_consensus.cc:740] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:00.094458 17526 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:00.094617 18364 consensus_queue.cc:260] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.092252 18253 raft_consensus.cc:3055] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.084789 18283 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.096380 18253 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:00.097308 18253 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.098444 18253 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.098582 16708 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58310 (request call id 262) took 2081 ms. Trace:
I20260709 13:19:00.092585 18258 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:00.100212 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.092545 18389 consensus_queue.cc:260] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.101773 17521 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.101959 18389 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.100212 18258 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:00.081179 18215 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.105306 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.098953 16708 rpcz_store.cc:276] 0709 13:18:58.016857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.016991 (+   134us) service_pool.cc:224] Handling call
0709 13:19:00.098524 (+2081533us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:58.504694 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:58.619318 (+114624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:58.621066 (+  1748us) write_op.cc:435] Acquired schema lock
0709 13:18:58.621083 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:58.656998 (+ 35915us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:58.660205 (+  3207us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:58.661237 (+  1032us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:58.671031 (+  9794us) tablet.cc:701] Row locks acquired
0709 13:18:58.671053 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:18:58.678778 (+  7725us) write_op.cc:270] Start()
0709 13:18:58.697247 (+ 18469us) write_op.cc:276] Timestamp: P: 1783603138676533 usec, L: 0
0709 13:18:58.697276 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:18:58.739823 (+ 42547us) log.cc:844] Serialized 535 byte log entry
0709 13:18:59.555093 (+815270us) op_driver.cc:464] REPLICATION: finished
0709 13:18:59.727561 (+172468us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeebf8c0ac 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feef2accef0
0709 13:18:59.978883 (+251322us) write_op.cc:301] APPLY: starting
0709 13:18:59.978966 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:59.979057 (+    91us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:59.979078 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:59.979301 (+   223us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:59.979444 (+   143us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:18:59.979488 (+    44us) write_op.cc:312] APPLY: finished
0709 13:18:59.979776 (+   288us) log.cc:844] Serialized 23 byte log entry
0709 13:18:59.979937 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:59.980014 (+    77us) write_op.cc:454] Released schema lock
0709 13:18:59.980071 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:59.980756 (+   685us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:59.980784 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":423564,"apply.run_cpu_time_us":1410,"apply.run_wall_time_us":1856,"num_ops":1,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":10447,"prepare.run_wall_time_us":320992,"replication_time_us":856178,"spinlock_wait_cycles":2617216,"thread_start_us":248241,"threads_started":1}]]}
I20260709 13:19:00.108342 18300 raft_consensus.cc:3055] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.116261 18300 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:00.113214 18258 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.117202 18300 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.118322 18300 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.056679 18338 consensus_queue.cc:1059] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:19:00.121049 18338 raft_consensus.cc:3055] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.121414 18338 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:00.122255 18338 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.081254 18345 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:00.109870 16956 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.112156 18341 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:00.147045 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:00.127823 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.138867 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:00.134608 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:00.114044 16922 leader_election.cc:336] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 2.024s (SENT)
I20260709 13:19:00.114300 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.160502 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:00.161177 16953 raft_consensus.cc:2393] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:00.160099 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 44053.4us
I20260709 13:19:00.026309 18343 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.159578 16954 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:00.092715 18396 consensus_queue.cc:1059] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:19:00.161377 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:00.161742 16850 leader_election.cc:336] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.754s (SENT)
I20260709 13:19:00.170413 16950 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:00.170486 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.162078 16922 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:00.135510 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.171025 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:00.116183 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.168224 16801 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
W20260709 13:19:00.168967 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 54744us
I20260709 13:19:00.173681 18367 raft_consensus.cc:3055] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.172502 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.174909 17525 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:19:00.175163 16850 leader_election.cc:336] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.789s (SENT)
I20260709 13:19:00.175621 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.176299 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.177950 18257 consensus_queue.cc:1059] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:00.178973 18130 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.091288 18360 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.179620 18130 raft_consensus.cc:3055] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.179739 18360 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:00.180060 18396 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.180234 18393 raft_consensus.cc:3055] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.180577 18393 raft_consensus.cc:740] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:00.180749 18360 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.181375 18393 consensus_queue.cc:260] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.182003 18360 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.182560 18393 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.182853 18331 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:00.123632 18338 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.150496 16805 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.093406 18262 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:00.127990 18369 consensus_queue.cc:1059] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:19:00.184859 16956 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.184916 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.185267 18369 raft_consensus.cc:3055] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:00.185679 18369 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:00.185806 17523 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:00.186403 18369 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.174081 18367 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:00.119374 18283 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.173856 18253 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:00.188362 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 131289us
I20260709 13:19:00.147707 18382 raft_consensus.cc:3055] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.187506 18369 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:00.172516 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 58496.4us
I20260709 13:19:00.158669 18345 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:00.216259 16885 raft_consensus.cc:1240] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.217319 17527 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:00.218406 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.219048 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:00.219996 16922 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.220024 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.221020 16884 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 2: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:00.223873 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:00.224030 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.224423 16805 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.212100 18382 raft_consensus.cc:740] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:00.225711 18382 consensus_queue.cc:260] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.226933 18382 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.168762 18228 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:00.176146 18268 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.155987 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.228559 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.228724 18349 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:00.233402 16922 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.180066 18130 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:00.239467 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.240849 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.249169 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 45926.8us
I20260709 13:19:00.250473 18349 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:00.251485 16882 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:00.243263 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:00.254587 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:00.259795 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:00.260555 16802 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:00.260665 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:00.261384 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:00.261650 16807 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 2: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:00.262646 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:00.259613 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:00.265810 16883 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.267742 16807 raft_consensus.cc:2393] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:00.268602 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:00.268716 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:00.269901 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:00.262491 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:00.271039 16877 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:00.217089 18345 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.271288 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:00.216593 18262 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.233099 18283 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:00.302388 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:00.276191 16807 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:00.303270 16808 raft_consensus.cc:2393] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:00.304193 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:00.237793 18253 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.273644 18228 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:19:00.306180 18130 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.308149 16809 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.304111 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:00.266731 18256 consensus_queue.cc:1059] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:19:00.304263 18258 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:00.342962 17524 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:00.311208 16956 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:00.302471 18283 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:00.313467 18390 raft_consensus.cc:3055] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.347375 18390 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:00.348287 18390 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.349539 18390 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.214159 18265 consensus_queue.cc:1059] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:19:00.283648 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:00.351486 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 67948.8us
W20260709 13:19:00.351959 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.352485 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.263121 18350 consensus_queue.cc:1059] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:19:00.212572 18373 consensus_queue.cc:1059] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:19:00.275535 18301 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:19:00.230810 18347 consensus_queue.cc:1059] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:19:00.236209 18396 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:00.327549 16804 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:00.329134 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.346139 18258 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.337291 18130 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.240305 18268 consensus_queue.cc:1059] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:19:00.362653 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.265516 18331 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:19:00.346992 18283 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.357052 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.331924 16807 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:00.362309 18373 raft_consensus.cc:3055] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.388935 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.356016 18341 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:00.358258 18400 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.363075 18396 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.363103 18228 raft_consensus.cc:3055] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:00.422719 18228 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:00.364064 18347 raft_consensus.cc:3055] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.365649 16708 catalog_manager.cc:5697] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 1 to 2, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:00.423923 18347 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:00.425055 18347 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.426702 18347 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:00.376879 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 143529us
I20260709 13:19:00.428313 16922 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:00.374231 18343 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:00.383579 18368 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.326803 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.389039 18373 raft_consensus.cc:740] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:00.351048 18253 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.362385 18301 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.434387 18301 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:00.390002 18258 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.264254 18367 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:00.438666 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.441275 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 172713us
I20260709 13:19:00.446060 16806 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.448071 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:00.456312 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 66359.4us
I20260709 13:19:00.457535 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.461146 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:00.421500 18215 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.420804 18341 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:00.465037 18341 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.453145 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:00.475507 16850 leader_election.cc:336] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.816s (SENT)
I20260709 13:19:00.476038 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:00.477991 16850 leader_election.cc:336] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.858s (SENT)
I20260709 13:19:00.422134 18388 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:00.478030 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:00.478504 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:00.481679 16850 leader_election.cc:336] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.912s (SENT)
W20260709 13:19:00.460533 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.482167 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:00.485860 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.469025 18343 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:00.490406 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:00.487128 16850 leader_election.cc:336] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 2.049s (SENT)
I20260709 13:19:00.472447 18318 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.495806 16954 raft_consensus.cc:1240] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:00.498342 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:00.498603 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:00.479038 18214 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.497422 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:00.499037 16950 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:00.505106 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:00.506189 16953 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:00.506405 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.501166 16954 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 2: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:00.507622 18411 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:00.501973 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:00.503746 18342 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:00.508955 16951 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 2: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:00.509021 18342 raft_consensus.cc:697] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:00.510757 16959 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.507993 16775 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:00.492235 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:00.492331 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 64135.1us
I20260709 13:19:00.472728 18349 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.483794 18391 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:00.511932 16922 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:00.435518 18301 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.517868 18300 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.483927 18403 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:00.519328 16850 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 2.052s (SENT)
I20260709 13:19:00.490782 18329 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.525344 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.495020 18343 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:00.523808 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:00.526467 16850 leader_election.cc:336] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 2.118s (SENT)
I20260709 13:19:00.526950 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.529873 18300 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:00.530876 16850 leader_election.cc:336] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 2.135s (SENT)
I20260709 13:19:00.531234 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.531929 18268 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.486505 18353 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:19:00.529031 18405 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:00.511271 18257 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:00.473847 18228 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.511085 18367 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.537086 18343 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.545624 16922 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.547047 16958 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:00.526952 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:00.536091 18214 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.535363 18262 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.488361 16803 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:00.540154 18257 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:00.546803 18301 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.542034 18409 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.549880 18405 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.541817 18349 consensus_queue.cc:1059] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:19:00.491900 18373 consensus_queue.cc:260] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.498883 18404 consensus_queue.cc:1059] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:19:00.561177 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.520375 18342 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.565546 16879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:19:00.566138 16879 raft_consensus.cc:606] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.566462 16879 raft_consensus.cc:614] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:00.568737 18357 raft_consensus.cc:3055] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.569060 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.570837 18373 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.547785 18366 ts_tablet_manager.cc:1929] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:19:00.558933 18257 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.576370 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.573755 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.579973 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:00.584026 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 106053us
I20260709 13:19:00.585095 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.586213 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.569075 18357 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:19:00.588474 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.575965 18344 raft_consensus.cc:3055] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.625229 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.626085 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.630728 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.587530 18366 log.cc:1199] T aa815b919c824fb196befa2fd6eeac35 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/wals/aa815b919c824fb196befa2fd6eeac35
W20260709 13:19:00.587647 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.627121 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 106288us
I20260709 13:19:00.633610 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.633975 17526 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:00.592633 18396 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:00.628417 18344 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:00.624512 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.631187 18210 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:00.654422 16883 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:00.655517 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.666460 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.670020 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "671210bca23f4566a684a188613c1665"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:00.670739 16959 raft_consensus.cc:606] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:00.670756 18357 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.669986 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.673920 18373 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:19:00.685737 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.648104 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:00.668277 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.668056 18210 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:00.703969 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.667069 18331 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:19:00.708693 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.675372 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.710163 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:00.722889 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 67442.4us
I20260709 13:19:00.709635 18210 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.716032 18283 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.721405 18367 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.733727 17492 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.725469 18228 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:00.740691 16954 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:00.743019 18420 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.743165 18367 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.743497 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.743556 18420 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.726776 18415 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.744032 18414 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:19:00.755978 18412 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:19:00.742205 18331 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:00.720851 18344 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.744330 18404 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:00.762182 18405 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:00.758796 18416 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:19:00.745404 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.745566 18271 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.751977 18395 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.777009 16922 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.765722 18393 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:00.786572 16922 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.774322 18366 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34326 (request call id 73) took 2166 ms. Trace:
I20260709 13:19:00.764117 18331 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:00.780978 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.789835 18268 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.792148 18283 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:00.793128 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.786276 18256 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.783844 18373 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:00.799413 16804 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:00.787765 18391 raft_consensus.cc:1064] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:19:00.796936 18422 consensus_queue.cc:1059] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:19:00.780056 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.782229 18420 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:00.805646 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 95540.5us
I20260709 13:19:00.776556 18404 raft_consensus.cc:697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:00.790856 18257 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.814673 18364 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.797470 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:00.807964 16775 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:00.796276 18360 consensus_meta.cc:287] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.614s	user 0.012s	sys 0.000s
I20260709 13:19:00.780272 18130 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:19:00.810092 18424 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.812991 18210 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.788893 18366 rpcz_store.cc:276] 0709 13:18:58.641301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.657802 (+ 16501us) service_pool.cc:224] Handling call
0709 13:18:58.960853 (+303051us) ts_tablet_manager.cc:1151] Deleting tablet aa815b919c824fb196befa2fd6eeac35
0709 13:18:58.991870 (+ 31017us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:19:00.101294 (+1109424us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:00.544358 (+443064us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:00.774220 (+229862us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115577,"tablet-delete.queue_time_us":144546,"thread_start_us":43436,"threads_started":1}
I20260709 13:19:00.825069 18331 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.826282 18331 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.826749 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet aa815b919c824fb196befa2fd6eeac35 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:19:00.820858 18257 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:00.822114 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 113480us
I20260709 13:19:00.801828 18342 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:00.823396 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.806351 18373 raft_consensus.cc:697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:00.826079 18268 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:00.827526 18404 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.816164 16806 raft_consensus.cc:1240] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.801669 18344 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.825148 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:00.837406 18210 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:00.793687 18345 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.837659 18258 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:00.822239 16773 consensus_peers.cc:597] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89c4a22bddc9425886aa0574ae085451. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:00.830305 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.823508 18341 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.865001 16808 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.865913 16956 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:00.869123 16878 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:00.840370 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.841812 18397 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.842666 18373 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.846285 16881 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:00.818792 18283 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:00.872371 18283 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:00.848402 18426 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.839521 18350 raft_consensus.cc:3055] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.847872 18342 raft_consensus.cc:697] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:00.875252 18428 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.876294 18350 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:00.878314 18350 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:00.879528 18350 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:00.880847 18345 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:00.881505 16952 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:00.874277 18360 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:00.874481 18271 consensus_queue.cc:1059] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:19:00.883522 18318 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:00.888410 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:00.892287 18407 raft_consensus.cc:993] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:19:00.897691 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:00.902575 16924 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:00.870947 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.899382 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:00.908007 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:00.901464 16694 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 4b60b701acc7473e87e3e529a2a34689 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 2 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:00.902397 18365 raft_consensus.cc:3055] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:00.918557 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:00.920127 16806 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:00.921325 17524 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:00.921937 18425 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.922325 18397 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.922760 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:00.922088 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:00.924880 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.908124 18347 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:00.926141 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:00.927743 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 53798.2us
I20260709 13:19:00.920713 18256 raft_consensus.cc:1081] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:19:00.934455 16877 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:19:00.938537 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:00.949478 16877 raft_consensus.cc:606] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:00.919660 18365 raft_consensus.cc:740] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:00.920548 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:00.950173 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:00.923326 18283 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:00.960893 18258 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:00.961176 18421 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:19:00.927459 18130 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:00.962141 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:00.928599 18329 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:00.962285 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:01.002826 16806 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:19:00.971568 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:19:00.974972 18430 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:19:00.907294 18342 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.000617 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:01.000633 16810 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:00.928431 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:01.007652 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 79288.4us
I20260709 13:19:01.008415 16775 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:01.011113 18343 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:01.012389 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 57158.9us
I20260709 13:19:01.015166 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:01.018285 16957 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:01.022830 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.028789 16775 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:01.007594 17522 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:01.032547 16848 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:01.039413 16878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "671210bca23f4566a684a188613c1665"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:19:01.040277 16878 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:01.040721 16878 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.013993 18349 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:01.017894 18400 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:01.030866 18345 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:01.031288 18331 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:01.027302 18329 raft_consensus.cc:697] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:01.049713 18329 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.050352 18341 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:01.050467 18360 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:01.027355 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:01.052454 18406 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:19:01.054322 18317 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
I20260709 13:19:01.054698 18345 raft_consensus.cc:697] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:01.056329 18331 raft_consensus.cc:697] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:01.059520 16775 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:01.072728 18343 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:01.063627 18400 raft_consensus.cc:697] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:01.074211 18400 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.077054 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:01.080215 16775 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:01.086541 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:01.091949 16956 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:01.099472 16954 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:01.091370 16878 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.069743 18388 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:01.068903 18393 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:01.106410 16878 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:01.105702 16956 raft_consensus.cc:1240] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:01.100214 16955 raft_consensus.cc:2393] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:01.069420 18406 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:01.108620 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:01.112512 17524 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.093606 18397 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:01.086447 18215 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:01.104943 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:01.105517 18265 raft_consensus.cc:3055] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:01.095160 18341 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:19:01.118922 18434 log.cc:927] Time spent T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:19:01.104650 18388 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:01.109004 18393 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.126467 18406 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.120814 18350 consensus_queue.cc:1059] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:19:01.129345 17524 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:01.131656 18357 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.135272 16848 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:01.129462 18345 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.130574 18331 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.137032 18350 raft_consensus.cc:3055] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:01.140412 17525 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:01.076011 18365 consensus_queue.cc:260] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.120363 18265 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:01.144826 18388 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.139225 18343 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:01.145833 16850 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:01.152127 16877 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:01.150632 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:01.132472 18215 raft_consensus.cc:697] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:01.159927 16850 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:01.167104 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:01.167593 16880 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
W20260709 13:19:01.168110 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.169816 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:01.170921 16878 raft_consensus.cc:1240] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:01.172534 16877 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:19:01.176618 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:01.141776 18350 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:01.176947 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:01.178205 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:01.147166 18406 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.146499 18343 raft_consensus.cc:697] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:19:01.168184 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.181430 18395 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:01.167914 18424 consensus_queue.cc:1059] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:19:01.187427 18395 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:01.184263 18408 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:19:01.188946 18424 raft_consensus.cc:3055] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:01.189327 18424 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:01.190167 18424 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.191357 18424 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.179764 18301 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.191995 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:01.157603 18314 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.184372 18265 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.185192 16876 raft_consensus.cc:1240] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:01.170898 18405 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:01.211131 16956 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.212563 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:01.222728 18405 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.216701 18215 consensus_queue.cc:237] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.224177 18265 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.196930 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:01.225073 16952 raft_consensus.cc:3055] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:01.160661 18362 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:01.225369 16952 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:01.224725 18405 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:01.202998 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:01.218591 18350 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.221246 16878 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:19:01.230602 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:01.178627 18388 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.226133 16952 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.228384 18428 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:01.232810 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:01.234395 16952 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.239265 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:01.239424 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:01.240866 16806 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:01.241444 16957 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.244066 18406 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:01.243896 18349 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:01.240567 18428 raft_consensus.cc:697] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:01.263641 16806 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:01.267390 18428 consensus_queue.cc:237] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.253281 18426 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:01.263429 18301 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:01.256912 18350 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.254019 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:01.181959 18391 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.264858 18406 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:01.300566 16952 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:01.308914 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:01.312207 18407 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:01.272862 18336 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:01.327754 16957 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:01.299063 17522 raft_consensus.cc:1240] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:01.292691 18349 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:01.301635 18426 raft_consensus.cc:697] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:01.304395 18406 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.322330 18423 raft_consensus.cc:476] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:19:01.336614 18407 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.303269 18284 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:01.341467 18349 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.273092 18343 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:01.367803 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.348168 18369 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:19:01.424717 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.429908 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.464522 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.357666 18228 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.355001 18327 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:01.517747 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.364743 18301 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.358779 18393 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:01.545185 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 367020us
I20260709 13:19:01.546052 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:01.551826 18329 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.557747 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:01.559582 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.355792 18407 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.371173 18364 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.164s
W20260709 13:19:01.571832 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 298335us
I20260709 13:19:01.577209 16810 raft_consensus.cc:1240] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:01.517894 18341 consensus_queue.cc:1059] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:19:01.580654 16881 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:01.515920 18369 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:01.586095 18438 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260709 13:19:01.587692 18437 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:19:01.532253 18301 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.524075 18228 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.591171 18301 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:01.591523 18228 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:01.592440 18365 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:01.597139 18214 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:01.611521 18369 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:01.525720 18327 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.616997 18393 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:01.618194 18301 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:01.622380 16957 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.622592 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:01.622867 18268 raft_consensus.cc:476] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:19:01.623482 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:01.625365 17518 consensus_meta.cc:287] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.000s
W20260709 13:19:01.628917 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.629067 18341 raft_consensus.cc:3055] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:01.599375 18427 consensus_queue.cc:1059] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:19:01.662019 18341 raft_consensus.cc:740] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:01.663331 18427 raft_consensus.cc:3055] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:01.663887 18427 raft_consensus.cc:740] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:01.663081 18341 consensus_queue.cc:260] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.664878 18427 consensus_queue.cc:260] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:01.665854 18341 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.659451 16883 raft_consensus.cc:2393] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:01.666555 18427 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:01.653177 16957 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:01.639258 18327 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:01.671159 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:01.681986 16810 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:01.682569 17526 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:19:01.683856 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.639833 18314 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:01.634469 18336 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:01.693993 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.644510 18404 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:01.701449 18400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.012s	sys 0.008s
W20260709 13:19:01.713253 18400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.012s	sys 0.008s
I20260709 13:19:01.659650 17518 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:01.681185 18364 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:01.717655 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.574082 18426 consensus_queue.cc:237] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.702219 18336 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:01.672430 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 93521.7us
I20260709 13:19:01.697045 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:01.752329 17525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.001s	sys 0.013s
I20260709 13:19:01.722908 18420 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:01.751780 17524 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.007s	sys 0.007s
I20260709 13:19:01.772269 16957 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
W20260709 13:19:01.779045 17524 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.008s	sys 0.008s
W20260709 13:19:01.764786 17525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.002s	sys 0.013s
W20260709 13:19:01.792559 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 234869us
I20260709 13:19:01.736440 18364 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.794055 16850 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:01.795615 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:01.721066 18404 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:01.798758 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:01.817826 16808 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:01.820478 16808 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:01.774098 18268 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.823621 16776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.013s	sys 0.052s
W20260709 13:19:01.824195 16776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.013s	sys 0.052s
I20260709 13:19:01.793025 18407 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:01.774610 16882 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:01.781500 18369 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:01.792972 18462 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.792284 18314 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:01.809382 18367 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:01.798759 18403 raft_consensus.cc:1027] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: attempt to promote peer 599f9a88b6cd4e818a1c59a0b4522480: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:19:01.798426 18343 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:01.797996 18458 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:01.997709 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 168579us
I20260709 13:19:01.829614 18268 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:01.821548 18414 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.861524 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:01.825930 18397 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:19:02.024845 18350 consensus_meta.cc:287] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.002s
I20260709 13:19:01.830619 18344 consensus_queue.cc:1059] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.162s
I20260709 13:19:02.005872 16808 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:02.023582 18408 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.029629 18388 consensus_meta.cc:287] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.002s
W20260709 13:19:02.028800 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.962168 18271 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.796103 18349 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.063355 18448 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:19:02.048388 18458 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.055786 16881 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:02.063189 18349 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.007269 18407 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.027081 18396 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.063122 18271 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.031644 18393 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:02.030073 18314 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:02.053355 18444 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260709 13:19:01.809192 16879 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:02.023303 18400 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:02.069049 16808 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:02.039909 18367 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:02.001616 18300 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:19:02.072443 18265 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.077958 18364 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:02.081369 18461 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 13:19:02.027261 18369 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.083911 18391 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.085801 18406 consensus_meta.cc:287] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.730s	user 0.009s	sys 0.000s
W20260709 13:19:02.089941 18460 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:02.072547 18397 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:02.076097 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.104065 16694 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 4b60b701acc7473e87e3e529a2a34689 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 2 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:02.029722 18462 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.082746 18343 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:02.074301 16803 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:02.002239 18426 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.081683 18445 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.091578 18130 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.091878 18283 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.065303 18408 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.124971 18314 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:02.125826 16805 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:02.126364 18268 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.119102 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:02.128540 18464 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.081674 18407 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.102624 18360 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:02.174063 18465 log.cc:927] Time spent T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 13:19:02.173934 18360 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:02.175143 18341 consensus_meta.cc:287] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.508s	user 0.004s	sys 0.004s
I20260709 13:19:02.102635 18400 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.132860 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:02.085690 18393 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.082530 18396 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:02.133172 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.154302 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:02.186354 16808 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:02.164140 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:02.145220 18364 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:19:02.154016 18445 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.190825 18445 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:02.108544 18350 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:19:02.156463 18426 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:02.157199 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.056396 18414 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.181110 17525 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:02.175743 18349 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:02.111410 18265 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.170624 18456 ts_tablet_manager.cc:933] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
I20260709 13:19:02.129823 18343 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:02.176276 18329 consensus_meta.cc:287] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.008s
W20260709 13:19:02.179570 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.202620 18440 log.cc:927] Time spent T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.199s	user 0.001s	sys 0.001s
W20260709 13:19:02.192595 18466 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 13:19:02.196264 18301 consensus_meta.cc:287] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
W20260709 13:19:02.198498 18468 log.cc:927] Time spent T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:19:02.198704 18271 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.198984 18414 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.156806 18130 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.198794 18467 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:19:02.114921 18391 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.185863 18464 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.203804 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:02.204672 16884 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:02.206050 16848 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:02.207152 16958 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:02.161408 18283 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.211031 16959 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:02.207854 18445 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.212023 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:02.213567 18400 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:02.220448 16806 raft_consensus.cc:2955] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:02.205185 18329 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:02.115164 18406 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.219807 18301 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:02.220019 18344 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.185778 18367 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.245172 18369 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.231806 18411 consensus_queue.cc:1059] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:19:02.246263 18464 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.227622 18314 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:02.238572 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:02.284451 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 45970.7us
I20260709 13:19:02.230329 18258 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:02.286038 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:02.286630 16883 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:02.231980 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:02.240633 18256 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.292748 18258 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:02.295042 18258 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:02.295755 18130 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.296270 18130 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.296691 18130 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.298571 18130 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.298926 18369 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.298995 18329 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.299621 18369 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.299741 18329 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.301795 18329 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:02.305140 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:02.233548 18445 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.246925 18365 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:19:02.277309 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:02.235821 18453 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:19:02.363554 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:02.370043 16878 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:02.363219 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:02.247272 18268 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
W20260709 13:19:02.309270 18336 consensus_meta.cc:287] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 13:19:02.250083 18344 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.314643 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:02.367935 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:02.312852 16956 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:02.375416 17526 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:02.215476 18397 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.387935 18215 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.416150 18215 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.308838 18130 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.304458 18464 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:02.411939 16885 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:02.309876 18256 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.384636 18462 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.304992 18314 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.435214 18391 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:02.432051 18420 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:02.391124 18406 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.364519 18350 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.364794 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:02.301829 18369 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.346961 18271 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.352747 18414 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.379940 16876 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:02.381248 18393 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:02.426306 18318 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.426705 18424 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:02.424506 18268 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:02.428072 18256 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.428643 18353 raft_consensus.cc:3055] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:02.428690 18456 tablet_copy_client.cc:323] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
W20260709 13:19:02.388518 18455 log.cc:927] Time spent T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:19:02.436241 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:02.436798 16881 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:19:02.388690 18463 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:19:02.422683 18427 consensus_meta.cc:287] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.754s	user 0.009s	sys 0.002s
I20260709 13:19:02.442500 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:02.443526 17518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44648 (request call id 192) took 1807 ms (client timeout 1818 ms). Trace:
I20260709 13:19:02.443683 18314 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:02.443430 18350 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.444331 18420 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.390281 18426 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:02.380671 18283 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.309116 18404 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:02.418834 18336 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.424583 18464 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.485519 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:02.547111 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.133225 16885 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:19:03.181370 16877 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:02.381129 18408 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.138474 16880 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:19:03.078202 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:03.139711 17492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.000s	sys 0.008s
W20260709 13:19:03.191967 17492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.001s	sys 0.008s
W20260709 13:19:03.076639 16922 leader_election.cc:336] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.818s (SENT)
I20260709 13:19:02.489073 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:03.196650 16922 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:03.193737 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:03.198685 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:02.529760 18396 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.133077 18458 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:02.484921 18472 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
I20260709 13:19:02.445277 18344 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:03.202739 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 126244us
I20260709 13:19:02.632206 18470 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.586416 18388 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.637706 18367 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.853485 18447 log.cc:927] Time spent T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 1.097s	user 0.008s	sys 0.000s
I20260709 13:19:02.637688 18331 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.711278 18400 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:02.947119 18228 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.228183 18470 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.488847 18406 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.139428 18464 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.135807 18343 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:03.235961 18482 log.cc:927] Time spent T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
W20260709 13:19:03.238933 18483 log.cc:927] Time spent T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:19:03.230581 18388 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.243120 18488 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.248530 18488 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.251623 18488 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.252341 18470 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.252875 18470 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:03.253650 18470 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.252784 18489 consensus_queue.cc:1059] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:03.254268 18464 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.254992 18489 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:03.255452 18489 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:03.255903 18470 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.256209 18464 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.256466 18489 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.258114 18489 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.218879 16883 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:03.287611 16808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.011s	sys 0.035s
W20260709 13:19:03.298872 16808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.011s	sys 0.036s
W20260709 13:19:03.041154 16803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 1059) took 1418 ms (client timeout 1607 ms). Trace:
W20260709 13:19:03.300599 16803 rpcz_store.cc:269] 0709 13:19:01.623116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.623223 (+   107us) service_pool.cc:224] Handling call
0709 13:19:03.040878 (+1417655us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400266454. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:03.041065 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968970624}
W20260709 13:19:03.290462 16775 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.501s (SENT) [suppressed 45 similar messages]
W20260709 13:19:03.008152 16806 consensus_meta.cc:287] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.775s	user 0.006s	sys 0.004s
W20260709 13:19:03.290663 16776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.013s	sys 0.006s
I20260709 13:19:03.300597 16808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 158) took 1050 ms. Trace:
W20260709 13:19:03.304069 16776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.014s	sys 0.006s
I20260709 13:19:03.067576 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1037) took 1847 ms. Trace:
I20260709 13:19:03.304126 16808 rpcz_store.cc:276] 0709 13:19:02.249951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.250410 (+   459us) service_pool.cc:224] Handling call
0709 13:19:02.250749 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.281463 (+ 30714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.281493 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.281919 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.299710 (+1017791us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:03.299824 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.299971 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.300067 (+    96us) raft_consensus.cc:1685] finished
0709 13:19:03.300108 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.300439 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19452,"raft.queue_time_us":79,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":24860,"thread_start_us":1004640,"threads_started":1,"wal-append.queue_time_us":951836}
I20260709 13:19:03.305668 16879 rpcz_store.cc:276] 0709 13:19:01.220572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.223144 (+  2572us) service_pool.cc:224] Handling call
0709 13:19:01.223421 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.089784 (+866363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.067272 (+977488us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54002f6054. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:03.067501 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307671808}
I20260709 13:19:03.309594 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 91) took 1250 ms. Trace:
W20260709 13:19:03.309864 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.297022 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 457638us
W20260709 13:19:03.311734 17490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.005s	sys 0.010s
W20260709 13:19:03.182153 17518 rpcz_store.cc:269] 0709 13:19:00.629262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.629599 (+   337us) service_pool.cc:224] Handling call
0709 13:19:02.424158 (+1794559us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b540026edd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:02.436402 (+ 12244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932180224}
I20260709 13:19:03.231020 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:02.647265 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:03.316262 18256 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.316522 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 482) took 1098 ms. Trace:
I20260709 13:19:03.316092 18228 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.223734 17519 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:03.138945 18210 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:03.317335 18256 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.434459 18130 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.319023 18210 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:02.666823 18214 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:03.322263 18130 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.446691 18258 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.322875 18228 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.323575 18228 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.323210 18214 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:03.297096 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:03.324911 18228 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.325649 18258 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.326539 18258 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.327014 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:03.322360 18256 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.323524 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:03.327402 18258 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.328028 18256 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.323223 18130 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:03.328926 18256 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.329775 18130 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.330693 18258 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.331625 18258 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.331852 18256 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.332482 18256 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.327572 18228 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.333413 18214 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.236258 18331 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.335353 18228 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.336216 18228 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.338047 18331 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.316992 17525 rpcz_store.cc:276] 0709 13:19:02.218434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.218539 (+   105us) service_pool.cc:224] Handling call
0709 13:19:02.218799 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.219009 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.219032 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.219892 (+   860us) log.cc:844] Serialized 26 byte log entry
0709 13:19:02.353719 (+133827us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:02.353819 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.354009 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.315874 (+961865us) raft_consensus.cc:1685] finished
0709 13:19:03.315918 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.316289 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":117582,"threads_started":1,"wal-append.queue_time_us":585888}
I20260709 13:19:03.338117 18256 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.060904 18265 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.310102 16954 rpcz_store.cc:276] 0709 13:19:02.059311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.059437 (+   126us) service_pool.cc:224] Handling call
0709 13:19:02.059746 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.060054 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.060081 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:02.069093 (+  9012us) log.cc:844] Serialized 26 byte log entry
0709 13:19:02.334732 (+265639us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:02.334789 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.334893 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.308829 (+973936us) raft_consensus.cc:1685] finished
0709 13:19:03.308880 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.309269 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1239,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":1404,"thread_start_us":253131,"threads_started":1,"wal-append.queue_time_us":944961}
I20260709 13:19:03.339987 18265 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.340862 18265 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.341985 18228 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.184458 18268 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.344146 18130 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.345889 18268 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.196959 18271 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.042104 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:02.617815 18284 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:03.348649 18271 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.188882 18283 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:03.349098 18284 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.349956 18283 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.183320 18318 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.352553 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44626 (request call id 475) took 1257 ms. Trace:
I20260709 13:19:03.352952 17520 rpcz_store.cc:276] 0709 13:19:02.095540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.103727 (+  8187us) service_pool.cc:224] Handling call
0709 13:19:03.041895 (+938168us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b5800011198. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:03.352342 (+310447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14395776}
I20260709 13:19:03.351572 18284 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.353929 18318 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:02.645423 18327 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.138932 18314 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.355161 18314 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.356122 18283 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.343483 18265 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.357563 18314 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.357934 18331 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.358726 18331 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.359841 16876 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:03.355165 18327 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.361279 18331 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.361788 18331 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.362331 18331 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:03.362905 18327 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.363956 16878 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:03.354470 18284 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.365072 18331 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.365293 18284 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.126525 18365 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.229195 18367 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.368587 18336 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.369253 18365 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.141788 18353 raft_consensus.cc:740] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:03.370859 18367 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:02.822814 18373 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.371768 18365 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.372350 18373 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.374140 18388 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.370898 18350 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.374743 18373 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.372397 18353 consensus_queue.cc:260] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.376565 18353 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:03.377345 18284 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:02.447762 18360 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.363502 18327 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:03.382923 18327 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:03.383960 18397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.001s	sys 0.026s
W20260709 13:19:03.384351 18397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.001s	sys 0.027s
I20260709 13:19:03.235785 18400 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.385186 18327 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.322152 18210 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.387274 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:03.387634 18400 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.201313 18404 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.389331 18404 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.392156 18404 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:02.968168 18407 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.239872 18406 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.217489 18408 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:02.787520 18411 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:03.394428 18411 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.396807 18420 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.396975 18411 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.183367 18414 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.399379 18414 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.193974 18426 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:19:03.402047 18403 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.402983 18403 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.403849 18420 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.404753 18420 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.405789 18403 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:02.609434 18453 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.608918 18462 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.461400 18500 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.461869 18462 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.462386 18500 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.078434 18463 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:03.466341 18420 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.055356 18467 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.467144 18500 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.467815 18467 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.407444 18314 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.469354 18314 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:02.839942 18484 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:03.471426 18495 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:19:03.395486 18406 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.472550 18314 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.474526 18445 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.340863 18256 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:03.479728 18496 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.215s	user 0.001s	sys 0.001s
W20260709 13:19:03.450309 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 160016us
I20260709 13:19:03.252312 18488 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.467528 18463 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.332552 18258 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.513466 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 485) took 1026 ms. Trace:
I20260709 13:19:03.513950 17526 rpcz_store.cc:276] 0709 13:19:02.486636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.486763 (+   127us) service_pool.cc:224] Handling call
0709 13:19:02.488937 (+  2174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.525617 (+ 36680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.525650 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.076547 (+550897us) log.cc:844] Serialized 548 byte log entry
0709 13:19:03.314399 (+237852us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:03.314492 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.314663 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.513073 (+198410us) raft_consensus.cc:1685] finished
0709 13:19:03.513095 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.513266 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":215346,"threads_started":1,"wal-append.queue_time_us":165918}
I20260709 13:19:03.515751 18214 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:03.516603 18214 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.517601 18258 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.519892 18420 consensus_queue.cc:1059] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:03.520378 18314 consensus_queue.cc:1059] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:03.522086 18314 raft_consensus.cc:3055] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:03.522585 18314 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:03.524338 16808 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:03.524477 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.525310 16803 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:19:03.526482 16805 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:03.526798 18427 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.526800 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:03.527829 16810 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.527693 18427 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.530943 18427 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.532009 18453 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.532349 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.532356 18314 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.533301 16804 raft_consensus.cc:2393] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:03.534389 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.535157 16954 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 2: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:03.537071 16956 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:03.537941 16924 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:03.541929 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:03.542557 18256 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:03.543066 18256 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.543115 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:03.543555 18256 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.544025 18406 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:03.544456 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.544831 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1051) took 1110 ms. Trace:
I20260709 13:19:03.544955 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.471489 18484 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.568253 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.571256 16810 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:03.569895 16959 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:03.547564 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1045) took 1258 ms. Trace:
W20260709 13:19:03.574805 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 261842us
I20260709 13:19:03.569842 16878 rpcz_store.cc:276] 0709 13:19:02.434148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.434276 (+   128us) service_pool.cc:224] Handling call
0709 13:19:03.544569 (+1110293us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54000b5754. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:03.544713 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396949888}
I20260709 13:19:03.538929 18314 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.574536 16881 rpcz_store.cc:276] 0709 13:19:02.289144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.289275 (+   131us) service_pool.cc:224] Handling call
0709 13:19:03.547139 (+1257864us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b5400025b54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:03.547350 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57245952}
I20260709 13:19:03.579154 16957 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:03.588971 18498 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:03.589540 18498 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.589424 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.590163 18498 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.591935 18493 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:03.570679 18406 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:03.591864 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.526513 18490 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:03.599272 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:03.531608 18427 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.602437 16958 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:03.601822 18364 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:03.601457 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1044) took 1308 ms. Trace:
I20260709 13:19:03.605118 16819 tablet_copy_service.cc:140] P 96eaa6dafb3e4bbe914e54dc12507912: Received BeginTabletCopySession request for tablet 89c4a22bddc9425886aa0574ae085451 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42344)
I20260709 13:19:03.569315 18500 raft_consensus.cc:3055] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:03.579687 18467 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.606767 16883 rpcz_store.cc:276] 0709 13:19:02.288170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.288318 (+   148us) service_pool.cc:224] Handling call
0709 13:19:02.288580 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.298311 (+1009731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.582484 (+284173us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b5400191c54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:03.596968 (+ 14484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2138938624}
I20260709 13:19:03.609930 16954 raft_consensus.cc:1240] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:03.592767 18493 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.609886 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.597807 18406 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.601022 18463 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.652257 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:03.608779 18500 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:03.644125 18453 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.655325 16807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 151) took 1587 ms. Trace:
W20260709 13:19:03.655961 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 141669us
I20260709 13:19:03.610751 18215 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.606623 18364 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.659122 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.605280 18427 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.616191 18462 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.655885 16807 rpcz_store.cc:276] 0709 13:19:02.067974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.068151 (+   177us) service_pool.cc:224] Handling call
0709 13:19:02.445926 (+377775us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b58001d0498. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:02.446123 (+   197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.446448 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:02.446485 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.304230 (+857745us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.569469 (+265239us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:03.579057 (+  9588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.585163 (+  6106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.647512 (+ 62349us) raft_consensus.cc:1685] finished
0709 13:19:03.647531 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.655100 (+  7569us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2060,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":13090176,"thread_start_us":189660,"threads_started":1,"wal-append.queue_time_us":340814}
I20260709 13:19:03.667523 18507 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.667176 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 157) took 1449 ms. Trace:
I20260709 13:19:03.671310 18507 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.671368 16806 rpcz_store.cc:276] 0709 13:19:02.217303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.217482 (+   179us) service_pool.cc:224] Handling call
0709 13:19:02.220039 (+  2557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.220344 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:03.303257 (+1082913us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.519842 (+216585us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.520730 (+   888us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.520885 (+   155us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:03.520921 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.521021 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:03.666843 (+145822us) raft_consensus.cc:1685] finished
0709 13:19:03.666867 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:03.667014 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26111,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":5000,"thread_start_us":193003,"threads_started":1,"wal-append.queue_time_us":351693}
W20260709 13:19:03.667727 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.617393 17519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44626 (request call id 481) took 1399 ms. Trace:
I20260709 13:19:03.617767 18484 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.666828 18467 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.651702 18214 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.676091 18507 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.676774 18505 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:03.678776 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.721274 18505 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.721890 16801 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 2: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:03.679996 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.724056 16806 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:03.680388 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.681267 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.683436 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.725544 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:03.674015 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 66110.7us
I20260709 13:19:03.609623 16819 tablet_copy_service.cc:161] P 96eaa6dafb3e4bbe914e54dc12507912: Beginning new tablet copy session on tablet 89c4a22bddc9425886aa0574ae085451 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42344: session id = 599f9a88b6cd4e818a1c59a0b4522480-89c4a22bddc9425886aa0574ae085451
I20260709 13:19:03.725975 16809 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:03.686677 16957 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:19:03.703079 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.703596 18214 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.731527 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.723246 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.732187 18214 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.704372 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.733067 16801 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:03.733309 16956 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:03.734113 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:03.734366 18214 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.735307 18214 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:03.735527 18414 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:03.736105 18414 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:03.735934 18214 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.736544 18414 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.737340 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:03.738318 18214 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.738957 18214 consensus_queue.cc:1059] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:03.739610 18503 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:03.739861 18331 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:03.740278 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:03.740453 18331 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:03.741217 18491 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:03.741647 18491 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.742238 18491 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.741602 18331 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.704730 16955 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:03.708681 18364 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:03.709160 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 61014.7us
I20260709 13:19:03.710295 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.720000 18467 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.721854 18505 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.651960 18490 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.703326 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.753386 16810 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:03.746379 17492 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:03.750005 18462 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:03.758265 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.770931 16801 raft_consensus.cc:2410] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:19:03.772459 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 79758.9us
I20260709 13:19:03.789633 18462 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.805455 18462 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.785593 18364 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:03.809590 18364 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.810045 18364 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.812033 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.813100 16955 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:03.813791 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.814536 16954 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:19:03.689092 17519 rpcz_store.cc:276] 0709 13:19:02.218039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.220560 (+  2521us) service_pool.cc:224] Handling call
0709 13:19:03.617086 (+1396526us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54001da454. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:03.617243 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952407936}
I20260709 13:19:03.822710 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:03.834748 18513 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:19:03.835665 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.836428 16950 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:03.836722 18420 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:03.836970 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:03.837864 18314 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:03.839219 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.841575 18427 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.823422 16953 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:03.767391 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.840643 16705 catalog_manager.cc:5697] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:03.847687 18493 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.799336 18490 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.865825 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.866344 16950 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:03.866761 16955 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:03.863335 18268 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.867870 18268 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.870108 18268 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.870155 18406 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.860004 18414 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:03.871740 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.862949 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.876487 17492 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:03.876984 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:03.877573 16801 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:03.878141 18406 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.878399 16924 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:03.878674 18406 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.879104 18406 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.879971 18462 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:03.880318 18497 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:03.880520 18462 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:03.881155 18406 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.881750 18369 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:03.880924 18497 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.882443 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.882586 18462 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.882834 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.883026 16951 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:03.883395 16953 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:03.889374 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.889828 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:03.887204 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.893196 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.893595 16958 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 2: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:03.893808 16953 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:03.893712 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.895264 16952 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:03.896950 18420 raft_consensus.cc:476] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:19:03.897140 16950 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:03.898517 16950 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:03.899528 18314 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:03.900007 18284 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:03.900460 18284 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.900628 17519 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:03.900262 18314 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.900859 18284 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.902568 18314 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:03.903182 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 43662.7us
I20260709 13:19:03.904597 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.905267 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:03.860522 18500 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.906623 18500 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:03.907827 18425 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:03.908282 18425 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.908627 18425 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.911811 18268 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:03.912279 18268 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.912640 18268 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.913143 18499 consensus_queue.cc:1059] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:03.914207 18258 raft_consensus.cc:3055] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:03.914605 18258 raft_consensus.cc:740] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:03.915016 18256 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.915500 18258 consensus_queue.cc:260] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.916414 18467 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.875038 18331 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:03.919237 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.882589 16819 tablet_copy_source_session.cc:215] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:03.924769 16951 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:19:03.883908 18497 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:03.918432 18505 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.929965 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.933344 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.940750 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.940631 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.941799 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:03.946214 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.946826 16958 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
W20260709 13:19:03.947970 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.950513 18488 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:03.951479 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:03.952268 16803 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:03.951996 18425 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.953222 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:03.954533 16953 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:03.955773 16952 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:03.899407 18498 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:03.955188 16956 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:03.960705 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:03.928526 18490 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.932549 18414 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:03.974699 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:03.979868 16850 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:03.987645 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 56314.5us
I20260709 13:19:03.991072 16708 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58310 (request call id 263) took 3826 ms. Trace:
I20260709 13:19:03.991442 16708 rpcz_store.cc:276] 0709 13:19:00.146169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.148465 (+  2296us) service_pool.cc:224] Handling call
0709 13:19:03.963577 (+3815112us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:00.585888 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:00.726146 (+140258us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:00.727205 (+  1059us) write_op.cc:435] Acquired schema lock
0709 13:19:00.730533 (+  3328us) tablet.cc:662] Decoding operations
0709 13:19:00.752503 (+ 21970us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:00.757693 (+  5190us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:00.765867 (+  8174us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:00.783897 (+ 18030us) tablet.cc:701] Row locks acquired
0709 13:19:00.786544 (+  2647us) write_op.cc:260] PREPARE: finished
0709 13:19:00.793323 (+  6779us) write_op.cc:270] Start()
0709 13:19:00.799992 (+  6669us) write_op.cc:276] Timestamp: P: 1783603140793257 usec, L: 0
0709 13:19:00.803032 (+  3040us) op_driver.cc:348] REPLICATION: starting
0709 13:19:00.835061 (+ 32029us) log.cc:844] Serialized 530 byte log entry
0709 13:19:01.701792 (+866731us) op_driver.cc:464] REPLICATION: finished
0709 13:19:03.079288 (+1377496us) write_op.cc:301] APPLY: starting
0709 13:19:03.134846 (+ 55558us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:03.183943 (+ 49097us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:03.219772 (+ 35829us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:03.540101 (+320329us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5c0021978c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef5288331 00007feef5288221 00007feef5282f6c 00007feef29e330b 00007feef29e2fd3 00007feef2ae1e34 00007feef2acd97c 00007feef2ad1d61 00007feef2ad1d19 00007feef2ad1ca9 00007feef2ad1c71
0709 13:19:03.568559 (+ 28458us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:03.568849 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:19:03.568912 (+    63us) write_op.cc:312] APPLY: finished
0709 13:19:03.683887 (+114975us) log.cc:844] Serialized 23 byte log entry
0709 13:19:03.701138 (+ 17251us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:03.701307 (+   169us) write_op.cc:454] Released schema lock
0709 13:19:03.701377 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:03.838645 (+137268us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:03.838675 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":1283460,"apply.run_cpu_time_us":14493,"apply.run_wall_time_us":784943,"num_ops":1,"prepare.queue_time_us":137710,"prepare.run_cpu_time_us":3909,"prepare.run_wall_time_us":258434,"replication_time_us":879094,"spinlock_wait_cycles":476741888,"thread_start_us":415946,"threads_started":3,"wal-append.queue_time_us":75089}]]}
I20260709 13:19:03.996166 18284 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:03.998535 18284 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:03.998600 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.000861 16958 raft_consensus.cc:2393] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 2: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:04.008247 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.009102 16810 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
W20260709 13:19:04.010818 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.963557 18258 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.020159 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.021310 16810 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
W20260709 13:19:04.024053 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 57203.2us
I20260709 13:19:04.027117 17522 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:04.027494 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.028430 16802 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:04.029275 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.029865 18500 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:03.951538 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.037386 16801 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:04.041406 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.027134 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.005112 18497 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.052541 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:04.054059 17527 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:04.055191 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.052874 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.055366 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.060256 16804 raft_consensus.cc:2410] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:04.031193 18453 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.018695 18492 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.058460 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:04.067009 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 50709.9us
I20260709 13:19:03.999884 18490 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.053251 18497 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.084378 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.089927 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.092487 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.093010 18462 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:19:04.107250 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.091775 18341 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.092133 18426 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.071339 18425 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:04.126205 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 49685.7us
I20260709 13:19:04.127627 16809 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.127997 16959 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:04.076238 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.127091 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:04.085695 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.130987 17524 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:04.134095 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.136745 18256 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:04.156904 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.143899 18492 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.054391 18493 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:19:04.147240 16958 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
W20260709 13:19:04.147490 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 207242us
I20260709 13:19:04.139384 18462 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.154003 16802 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:19:04.114359 17527 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:04.164973 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.160430 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:04.161154 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.091538 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:04.086077 18497 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.165740 16810 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.086218 18500 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:19:04.146971 18467 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:04.171243 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:04.139215 18453 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.159754 17520 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:04.171777 16956 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
W20260709 13:19:04.176729 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.178648 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.167558 18462 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.176792 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.176717 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.154613 18426 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.187744 18505 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:04.189337 16806 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.176813 18256 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.186367 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:04.158001 18341 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.190828 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.163975 18491 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.194262 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.195116 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:04.198125 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.198807 16877 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.174093 18467 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.169668 18425 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:19:04.186870 18484 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.195128 16881 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.194644 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.199039 16878 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:04.204100 16807 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.190225 18498 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:04.192975 18256 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.183840 18268 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.210873 17526 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:04.213781 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.214380 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.199039 18353 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:19:04.222390 18518 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:19:04.212730 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.223258 16876 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:19:04.223847 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.224108 18490 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.224426 16880 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.225062 17527 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:04.226164 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.226824 17527 raft_consensus.cc:2368] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:04.228224 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.228856 17523 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:04.229741 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.230307 18353 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.230752 18353 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.231281 18453 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.231879 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.219496 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.236375 16885 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:04.243228 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:04.243665 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.244270 16880 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
W20260709 13:19:04.251489 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.209578 18484 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.253439 16804 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.216394 18256 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:04.254855 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 103448us
I20260709 13:19:04.258167 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.258867 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.259853 16806 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.247483 17525 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:04.253120 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.261956 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:04.264125 16959 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:19:04.213652 16803 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:04.262324 16801 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:04.263164 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.266465 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.268440 18491 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.268751 18467 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.271070 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.248380 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.272068 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.272598 16802 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
W20260709 13:19:04.273301 18528 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:19:04.273597 18500 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:04.274012 18500 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:04.274438 18500 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.275126 16880 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.275662 16885 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:04.277664 16884 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:04.278532 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.279078 16884 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:04.253587 18492 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.280014 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.280438 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.280609 16885 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:04.281183 18341 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.281610 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.281682 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.282518 16880 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:04.282346 16885 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:04.282964 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.283702 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.284132 16880 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:04.284117 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.285004 16882 raft_consensus.cc:2368] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3.
I20260709 13:19:04.285424 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.286137 16882 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:04.286324 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.286608 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.287179 16885 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:04.287457 16880 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:04.289603 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:04.289665 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.290572 16880 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:19:04.291620 18364 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.292001 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.291906 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.293458 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.293764 18364 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:04.294531 17527 raft_consensus.cc:2368] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:04.294888 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.290735 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.291594 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:04.296000 16885 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:04.297035 18499 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:04.297541 18499 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:04.300686 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.302170 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.302903 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.296592 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.249264 17518 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.233044 18505 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.308084 16810 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:04.303967 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.323181 16877 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:04.319721 16806 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:04.287374 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.324579 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.293526 16880 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:04.261400 18484 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.264966 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:04.303512 16884 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
W20260709 13:19:04.326511 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 111686us
I20260709 13:19:04.322861 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.329516 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.331226 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.331712 16885 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:04.298871 18499 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.334960 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.335448 16810 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.303576 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.332669 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.338711 16878 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:19:04.341445 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.342020 16810 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.320112 16802 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.343708 16808 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:04.326433 18505 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:04.330506 18420 consensus_queue.cc:1059] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:19:04.344591 17524 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:04.347013 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:04.347373 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 82522.1us
I20260709 13:19:04.343986 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.348990 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:04.351061 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.347008 18505 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.348711 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.330997 18493 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.353598 16877 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:04.355486 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.356422 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.357389 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.347110 16879 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.358337 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.358500 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.340577 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:04.370285 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.359120 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:04.359901 18490 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.375856 18490 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:04.376271 18490 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.360522 18492 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.379901 18492 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.380288 18492 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.381759 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.382643 16877 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:19:04.360854 18493 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.361538 18256 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.383735 18493 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.383978 16876 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.385469 18256 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:04.365412 18531 raft_consensus.cc:3055] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:04.386104 18531 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:04.387102 18531 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.345132 18364 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:04.388159 18364 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:04.388548 18364 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:04.367901 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 64528.9us
I20260709 13:19:04.392149 16848 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:04.392441 17518 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:04.393015 16848 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:04.394366 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:04.394963 16877 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.357123 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.398399 16808 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.370776 16804 raft_consensus.cc:2393] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:04.370962 16880 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.400705 18531 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.372732 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.415910 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.416683 16806 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:04.356258 18467 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:19:04.422748 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 65415.9us
I20260709 13:19:04.375174 16810 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.381650 18500 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.366343 18268 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:04.348474 18314 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:19:04.406524 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 50764.5us
W20260709 13:19:04.452728 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 60685us
I20260709 13:19:04.427630 18467 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:04.459120 16885 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:04.460117 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.460562 18504 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.206s
I20260709 13:19:04.461629 18504 raft_consensus.cc:3055] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:04.461748 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.461978 18504 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:04.462488 18454 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:04.462889 18504 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.414840 17519 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:04.463959 18529 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:04.465286 16881 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:04.467084 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:04.469110 16879 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:04.456038 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:04.425535 18427 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:19:04.472810 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:04.473034 18500 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.473743 16883 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:04.474138 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.474953 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:04.467363 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.475819 18491 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:04.476490 18491 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.476651 18529 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:04.476946 18414 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.477154 18529 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:04.477409 18414 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:04.459124 18467 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.477634 16884 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.478168 18504 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.477634 18529 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.471496 18364 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.471978 18214 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.453964 16773 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:04.491359 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:04.491751 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 200218us
I20260709 13:19:04.492311 16808 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:04.476572 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.492775 16807 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:04.498607 16880 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.500756 16877 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:04.503131 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.438874 18331 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.477834 18414 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.511215 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.495620 18491 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.500026 18214 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:04.517127 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 63239.4us
I20260709 13:19:04.521837 16773 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.518908 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.504122 18314 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.504568 18341 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:04.526715 18493 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.525039 18489 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:04.507968 18427 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:19:04.533226 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 266873us
I20260709 13:19:04.534540 16773 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:04.515002 18503 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.513595 18331 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:04.520802 18491 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.530810 18214 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.516860 18530 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.548472 16775 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:04.530989 18426 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.508543 18484 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.532773 18314 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:04.507095 18497 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.541349 18506 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:04.537626 18427 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.568480 18427 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.568760 18506 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:04.556316 18314 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.537250 18454 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.572022 18454 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.572530 18454 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.537873 18489 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:04.509245 18492 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:04.577620 18492 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.575446 18489 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.525064 16876 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:04.578958 18215 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.579425 18215 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.579862 18215 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.543038 18503 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.550976 18530 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.545533 18331 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.563354 18498 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:04.548535 18341 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:19:04.563042 18497 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:04.564796 18490 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.567739 18364 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.569425 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:04.557768 16694 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4b60b701acc7473e87e3e529a2a34689 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:04.585352 18503 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:04.591023 16694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 55599.9us
W20260709 13:19:04.591634 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.587101 18530 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:04.606331 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 95194.7us
I20260709 13:19:04.587761 18467 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:04.618937 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 74453.7us
I20260709 13:19:04.603329 18364 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:04.605753 18497 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:04.622330 18364 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:04.626585 18364 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.627513 18453 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:04.629014 17520 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:04.630002 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.630596 17519 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.633656 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.622709 18462 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.637872 18493 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.638391 18462 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:04.639063 16924 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:04.641219 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.596642 18498 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.643384 18498 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:04.605455 18420 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:19:04.647164 18497 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:04.647889 18497 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.648233 18497 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.648588 18497 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.650153 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.665490 16705 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58336 (request call id 233) took 4988 ms. Trace:
W20260709 13:19:04.666009 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.670441 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 122462us
I20260709 13:19:04.677027 16708 catalog_manager.cc:5697] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.681470 17527 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:04.677870 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:04.680037 16708 catalog_manager.cc:5697] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 3, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 3 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:04.685586 16704 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58326 (request call id 270) took 4201 ms. Trace:
I20260709 13:19:04.685719 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:04.686518 16954 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:04.620514 18505 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.685781 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:04.685998 16704 rpcz_store.cc:276] 0709 13:19:00.484063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.484206 (+   143us) service_pool.cc:224] Handling call
0709 13:19:04.683949 (+4199743us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4}
I20260709 13:19:04.671654 18463 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:19:04.690827 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.686968 16708 catalog_manager.cc:5697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 3, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 3 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.689446 16956 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:04.688831 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.688606 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.692466 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.692883 17518 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:04.665911 16705 rpcz_store.cc:276] 0709 13:18:59.667083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.668181 (+  1098us) service_pool.cc:224] Handling call
0709 13:18:59.824059 (+155878us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400037fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeef000090 00007feeef09ef3a 00007feef4e551cc 00007feef4f5337e 00007feef34142a4 00007feef3414232 00007feef3414161 00007feef34140dc 00007feef3413392 00007feeed3d148c 00007feeed3d08c6
0709 13:19:04.643667 (+4819608us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:04.212866 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:04.225259 (+ 12393us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:04.225308 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:19:04.225328 (+    20us) tablet.cc:662] Decoding operations
0709 13:19:04.225727 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:04.225824 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:04.225852 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:04.226149 (+   297us) tablet.cc:701] Row locks acquired
0709 13:19:04.226205 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:19:04.226367 (+   162us) write_op.cc:270] Start()
0709 13:19:04.226498 (+   131us) write_op.cc:276] Timestamp: P: 1783603144226304 usec, L: 0
0709 13:19:04.226519 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:19:04.227185 (+   666us) log.cc:844] Serialized 535 byte log entry
0709 13:19:04.376012 (+148827us) op_driver.cc:464] REPLICATION: finished
0709 13:19:04.634505 (+258493us) write_op.cc:301] APPLY: starting
0709 13:19:04.634614 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:04.634745 (+   131us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:04.634875 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:04.635106 (+   231us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:04.635252 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:19:04.635300 (+    48us) write_op.cc:312] APPLY: finished
0709 13:19:04.635472 (+   172us) log.cc:844] Serialized 23 byte log entry
0709 13:19:04.635625 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:04.635739 (+   114us) write_op.cc:454] Released schema lock
0709 13:19:04.635773 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:04.636101 (+   328us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:04.636132 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":70207,"reported_tablets":4,"spinlock_wait_cycles":273901952,"child_traces":[["op",{"apply.queue_time_us":231959,"apply.run_cpu_time_us":1606,"apply.run_wall_time_us":14063,"num_ops":1,"prepare.queue_time_us":265324,"prepare.run_cpu_time_us":3182,"prepare.run_wall_time_us":16250,"replication_time_us":149333,"thread_start_us":381624,"threads_started":2}]]}
I20260709 13:19:04.692426 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:04.695812 16953 raft_consensus.cc:2393] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:04.702425 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.696138 18529 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:04.704550 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 83638.1us
I20260709 13:19:04.702000 16708 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:04.690644 18462 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:04.711290 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.712815 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.713346 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:04.714004 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:04.715158 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:04.729070 16950 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:04.729566 16959 raft_consensus.cc:2393] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:04.716540 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.716802 16956 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:19:04.729868 16708 catalog_manager.cc:5697] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.716624 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:04.717272 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.717382 18364 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.717976 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.718165 16958 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:19:04.719534 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.697329 18463 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.721297 18529 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.720865 18454 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.721308 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:04.735742 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:04.737085 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:04.739100 16952 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:04.723891 18353 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.727926 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.731642 17527 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.731769 18498 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.703925 18530 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.733892 16708 catalog_manager.cc:5697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.735057 18462 raft_consensus.cc:697] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:04.755873 18462 consensus_queue.cc:237] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.739231 16950 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:04.741310 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.731964 16955 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:04.744688 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:04.744990 18554 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:04.724896 18484 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:04.747881 18531 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:04.749130 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:04.746510 18504 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.754179 16801 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:04.735226 18463 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.758081 18331 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:04.760257 18214 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.761494 18314 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.765854 18491 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.768203 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:04.773252 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 56723.1us
I20260709 13:19:04.774771 18427 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.738201 18505 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:04.779881 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.816846 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.817229 18491 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.817737 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.818641 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.742022 18498 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:04.778656 18544 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:04.809067 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.798013 18256 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.812628 18542 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.812798 18456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89c4a22bddc9425886aa0574ae085451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:04.813169 18529 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:04.813489 18493 consensus_queue.cc:1059] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:04.815209 16850 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:04.779037 18504 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:04.826112 18498 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.780405 18490 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.810135 17492 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:04.781308 18414 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.827186 18268 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:04.822067 17524 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:04.827924 18484 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.839432 18543 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:04.827425 18505 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:04.837741 18542 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.805830 18554 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.849170 18506 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:04.866487 18506 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:04.867373 18506 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.868697 18506 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.869119 18554 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.847703 18492 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:04.871759 18492 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:04.872637 18492 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.827795 18256 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.857211 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:04.859180 16950 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:04.876585 16959 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:04.860101 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 50043.6us
I20260709 13:19:04.813170 18489 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.845947 18504 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.866060 18491 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:04.855955 18543 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.855691 18420 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:04.852403 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:04.891168 16955 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.893652 16850 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:04.856346 18484 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.859751 18544 raft_consensus.cc:697] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:19:04.889112 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 70554.4us
I20260709 13:19:04.861953 18542 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.878058 18256 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.899986 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.900199 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:04.900755 18531 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:04.900981 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:04.901631 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.901329 18544 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.902261 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:04.920495 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:04.904595 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:04.904893 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:04.925325 16950 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:04.905341 18491 raft_consensus.cc:697] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:04.927691 16877 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.928323 18491 consensus_queue.cc:237] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:04.928983 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.929664 16806 raft_consensus.cc:2368] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:04.930471 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.906019 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.889398 18543 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.908648 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.938922 16810 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:04.908231 16807 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.890443 18492 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.919601 16808 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.905912 18489 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.931558 16809 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:04.932093 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.884064 18490 consensus_queue.cc:1059] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:19:04.897001 18484 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.936961 16877 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.937572 16880 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.937831 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.937922 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.941115 16848 leader_election.cc:400] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:04.945046 16801 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.951071 16848 leader_election.cc:403] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:04.906632 18364 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.904590 18414 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.957988 16810 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
W20260709 13:19:04.954037 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 47387.6us
I20260709 13:19:04.961637 18531 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:04.966941 16959 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:04.962332 16848 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:04.938946 18493 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:04.942116 18505 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:04.956223 18559 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:04.951869 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.970800 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:04.966182 16876 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:04.943161 18530 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:04.949162 18268 raft_consensus.cc:697] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:04.978055 16808 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.965132 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:04.981873 16880 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.942270 18503 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:04.969726 18314 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:04.980145 16848 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:04.971346 18500 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:04.984645 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:04.990721 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.973007 18331 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:04.988015 16807 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
W20260709 13:19:04.984740 18553 log.cc:927] Time spent T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:19:05.005666 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.043216 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.021911 16801 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:04.979933 16805 raft_consensus.cc:2376] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4. Re-sending same reply.
I20260709 13:19:05.004343 18500 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.056828 18500 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:05.057236 18214 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:05.056964 18268 consensus_queue.cc:237] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.046859 18462 consensus_queue.cc:1059] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:04.988900 18559 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:05.003736 17519 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:05.000713 16802 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:05.082289 16848 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:05.069641 18425 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:05.082078 16876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3291b51968ff4989a89ff1c802955900"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:37974
W20260709 13:19:05.087621 18552 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:19:04.994191 18497 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.091571 16848 leader_election.cc:400] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:05.092967 16848 leader_election.cc:403] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:05.113471 16848 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
W20260709 13:19:05.117228 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 192424us
I20260709 13:19:05.138707 16953 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:05.137193 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 210313us
I20260709 13:19:05.139631 16922 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:05.141571 16922 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:05.150913 18425 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:05.152266 18425 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:05.163477 18491 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:05.163879 18535 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:05.137713 18420 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:19:05.116832 18467 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:05.141429 18563 raft_consensus.cc:3055] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:05.164099 18491 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:05.188023 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:05.202342 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 49895.5us
I20260709 13:19:05.206418 18467 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:05.207216 18562 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:19:05.207974 18560 log.cc:927] Time spent T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:19:05.208037 16806 raft_consensus.cc:2410] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:05.092039 18505 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.216369 16922 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:05.189883 18563 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:05.225878 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 78923.8us
W20260709 13:19:05.214756 18513 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:19:05.212623 18499 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:05.212903 18562 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.234032 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:05.236411 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 123019us
I20260709 13:19:05.236330 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:05.240759 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 127630us
I20260709 13:19:05.241542 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.243688 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.242627 17524 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:05.243956 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:05.248420 16880 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.249037 16951 raft_consensus.cc:2368] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:05.244150 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:05.251168 16877 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.241513 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.252772 16954 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:05.231999 18499 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.239547 18353 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:05.209111 18559 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.238592 18562 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:05.361331 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.260392 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.363575 16959 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
W20260709 13:19:05.299661 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.261884 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.312316 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:05.295943 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.367219 16952 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:05.368427 17525 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:05.368209 16880 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:05.241555 18575 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:05.370611 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.378647 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.379630 16880 raft_consensus.cc:2393] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:05.245137 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.371249 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.275265 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.244983 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:05.383774 16884 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.323621 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.271490 16877 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:05.304546 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.310964 17492 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:05.393316 16958 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:05.245286 16922 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:05.396863 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.397513 16880 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:05.398449 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.399006 16880 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
W20260709 13:19:05.301278 18565 log.cc:927] Time spent T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:19:05.404697 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:05.317310 18564 log.cc:927] Time spent T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.325s	user 0.002s	sys 0.000s
I20260709 13:19:05.400925 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.405452 16883 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:05.405689 16877 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:05.311501 17520 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
W20260709 13:19:05.406610 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 95708.9us
I20260709 13:19:05.402262 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.259536 18484 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.315294 18454 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:05.408643 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.416214 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.413998 16804 raft_consensus.cc:2410] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:05.440656 16959 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:05.424947 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 179796us
I20260709 13:19:05.409525 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:05.408869 16881 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:05.434756 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.441696 16922 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:05.442343 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 206079us
I20260709 13:19:05.442438 16954 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:19:05.443364 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.408315 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.433214 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.253830 18503 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:05.311520 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:05.323464 18453 raft_consensus.cc:3055] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:19:05.427438 18542 consensus_meta.cc:287] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.000s
I20260709 13:19:05.450016 16924 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:05.452517 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:05.453008 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.454102 16883 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:05.411667 18467 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:05.322018 18427 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:05.300666 18497 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:05.494539 18577 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.498127 18577 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.499918 18484 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:05.500954 18215 consensus_meta.cc:287] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.921s	user 0.008s	sys 0.003s
I20260709 13:19:05.501442 18215 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:05.503160 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 55200.9us
I20260709 13:19:05.503988 16924 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:05.409873 18581 consensus_queue.cc:1059] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:19:05.377697 18462 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:05.504935 18462 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:05.505095 16924 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:05.258965 18504 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:05.500962 18577 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:05.507030 18531 consensus_meta.cc:287] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.538s	user 0.003s	sys 0.006s
I20260709 13:19:05.507252 18504 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:05.507495 18531 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:05.508001 18504 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:05.508795 16803 raft_consensus.cc:2393] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:05.508870 18467 raft_consensus.cc:697] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:05.427587 18578 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:05.509999 18467 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:05.510452 18578 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:05.508401 18504 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.512624 18504 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.512735 18578 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:05.513394 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.514834 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.515954 17523 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:05.516728 18497 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.436478 18563 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:05.517407 18497 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.517333 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.518324 16952 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.482028 18453 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:05.519771 18453 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:05.463759 18492 consensus_queue.cc:1059] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:19:05.521903 18492 raft_consensus.cc:3055] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:05.522325 18492 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:05.523552 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.524682 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.525172 16954 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:05.525522 18543 consensus_meta.cc:287] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.002s
I20260709 13:19:05.525950 18543 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.529670 18427 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:05.321619 18500 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:05.471220 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.479534 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:05.533756 17524 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:05.274310 18499 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:05.391573 16955 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:05.420961 18575 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:05.428200 18582 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.491076 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:05.302721 18463 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.409580 18569 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:05.409147 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.408573 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.437611 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:05.436718 18491 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:05.321663 18498 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.476264 18535 raft_consensus.cc:697] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:05.496536 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.496997 18580 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.535431 18215 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:05.455232 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.535408 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:05.475566 16957 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:05.449817 16884 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:05.541703 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.550567 18214 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:19:05.570057 16953 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:19:05.548543 16810 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:19:05.505395 18256 consensus_meta.cc:287] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 13:19:05.551870 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:05.562541 16954 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:05.575188 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.505442 18462 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:05.545608 18493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.028s	sys 0.037s
I20260709 13:19:05.577983 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.578212 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.578519 16953 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:05.548684 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:05.578052 18493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.029s	sys 0.037s
I20260709 13:19:05.580386 18493 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:05.580487 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.580953 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:05.581545 18331 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:05.581367 18493 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.582778 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:05.583132 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:05.583876 18583 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:05.584326 18583 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:05.584708 18583 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.492996 18542 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.586568 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:05.523180 18492 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:05.575429 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:05.576058 16959 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:05.576099 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.592238 16957 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:05.581107 16883 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:05.593657 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.588807 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:05.573756 16880 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:05.660334 16957 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:05.590785 16775 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:05.551651 18569 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:05.591915 18543 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:05.591441 16953 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:05.577175 16951 raft_consensus.cc:2368] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:05.658563 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.658901 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.572834 18578 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.578903 18268 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:05.894985 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.568974 16882 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:05.552577 18581 consensus_queue.cc:1059] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:05.551124 18506 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:05.590303 18414 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:05.894292 18268 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:19:05.875540 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.560621 18582 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.903703 18578 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.930855 18578 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:05.936125 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.937090 16959 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:05.590111 18491 raft_consensus.cc:2764] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:19:05.883961 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 300872us
I20260709 13:19:05.940981 16924 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:05.885987 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.876546 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.887434 16884 raft_consensus.cc:2393] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:05.890673 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.892263 16957 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
W20260709 13:19:05.896780 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.874348 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:05.588135 18256 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:05.590493 18503 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.294s
I20260709 13:19:05.904037 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:05.873248 18484 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:05.907612 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 316851us
W20260709 13:19:06.012691 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.910861 18594 log.cc:927] Time spent T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.215s	user 0.000s	sys 0.011s
I20260709 13:19:05.910723 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:05.911254 18529 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:05.893676 18453 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:05.913200 18555 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:05.915967 16956 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:19:05.564705 18454 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:19:05.888700 18569 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.027340 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:06.028095 16880 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:19:05.945001 16954 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:05.962037 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.924489 18268 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:06.015480 16883 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:19:06.043169 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:06.043809 16883 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:19:06.044659 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:06.045352 16883 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:06.046057 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:05.935300 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:06.048537 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:06.049085 18256 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:06.049343 18562 consensus_meta.cc:287] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.001s
I20260709 13:19:06.049783 18562 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:06.050915 16950 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:06.049124 16879 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:06.052687 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:06.052863 18562 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:06.053023 16883 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:06.053455 16879 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:06.009689 18462 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:06.057539 18462 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:06.057821 18569 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:06.018782 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:06.011938 16955 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.025398 16953 raft_consensus.cc:2368] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:06.025987 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:06.102471 16884 raft_consensus.cc:2393] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:06.031606 17525 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
W20260709 13:19:06.034862 16952 consensus_meta.cc:287] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.000s
I20260709 13:19:06.103657 16952 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:06.107148 16952 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:19:06.035732 18586 log.cc:927] Time spent T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:19:06.036600 18542 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:06.037233 18593 log.cc:927] Time spent T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:19:06.037774 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:06.109186 16881 raft_consensus.cc:2393] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:06.039803 18581 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.109961 18581 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:06.110396 16952 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:06.112063 18581 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:06.041420 18492 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:06.060194 18420 consensus_meta.cc:287] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.875s	user 0.018s	sys 0.002s
I20260709 13:19:06.061426 16879 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:06.061074 18583 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:06.066656 18500 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:06.094580 18504 consensus_meta.cc:287] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.000s
I20260709 13:19:06.021569 18529 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.081760 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:06.082139 18463 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:05.921079 18535 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:06.138178 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 125183us
I20260709 13:19:06.141960 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:06.061964 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.013998 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:06.129763 16954 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
W20260709 13:19:06.143049 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.133020 16880 raft_consensus.cc:2376] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3. Re-sending same reply.
I20260709 13:19:06.094507 16959 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:19:06.096019 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:06.146977 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 133075us
I20260709 13:19:06.116858 18420 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:06.146432 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:06.131412 18214 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:06.145783 16954 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:06.131114 18498 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:06.152624 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:06.156829 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:06.158821 16924 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:06.159452 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.163807 18462 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:06.164328 18462 raft_consensus.cc:697] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:06.150147 18575 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:06.165218 18462 consensus_queue.cc:237] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:06.167181 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.145017 18543 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.167958 18543 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:06.168303 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.169041 16806 raft_consensus.cc:2368] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:06.169003 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.169906 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.170042 18543 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:06.170163 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.170578 16806 raft_consensus.cc:2368] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:06.171510 18341 raft_consensus.cc:2764] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:19:06.148757 18542 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:06.171989 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.172101 18542 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:06.172622 18542 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.171352 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.172892 16807 raft_consensus.cc:2410] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:06.173377 16885 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:06.173795 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.174453 16807 raft_consensus.cc:2368] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:06.175197 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.176031 16801 raft_consensus.cc:2410] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:06.172423 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.176535 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:06.171422 17524 consensus_meta.cc:287] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.632s	user 0.005s	sys 0.000s
I20260709 13:19:06.136301 18529 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.156121 16959 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:06.177138 16808 raft_consensus.cc:2368] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:06.178203 16804 raft_consensus.cc:2368] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:06.178583 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.178795 17524 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:06.168609 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:06.154399 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 565586us
I20260709 13:19:06.179919 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:06.178225 16810 raft_consensus.cc:1240] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:06.171280 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.181826 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.155385 18503 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:06.185303 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.188863 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.195083 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.185770 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:06.172941 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:06.135689 18504 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:06.217126 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.197217 16924 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:06.190436 16882 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:06.196430 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.219223 16924 leader_election.cc:400] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:06.186357 18498 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:06.220273 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:06.221400 16801 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:06.222802 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.176270 18454 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:19:06.224148 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.220525 16924 leader_election.cc:403] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:06.191460 18575 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:06.190140 18562 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:06.184547 18597 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:06.232072 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.195627 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:06.220163 18505 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:06.220008 18364 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:06.221481 18497 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:06.231068 16805 raft_consensus.cc:2393] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:06.242796 16808 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:19:06.227447 18314 raft_consensus.cc:3055] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:06.221338 18256 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:19:06.336016 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.228781 18555 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:06.346987 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:06.347774 16801 raft_consensus.cc:2368] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:06.236095 18467 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:06.231468 18598 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:06.347654 16809 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:06.228564 18581 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.233368 18582 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:06.238016 18491 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:06.366032 18497 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:06.366253 18364 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.366581 18583 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:06.366755 18364 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:06.368871 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:06.366068 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:06.370821 16807 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:19:06.367290 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:06.368785 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:06.235491 18268 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:06.409029 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.408772 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:06.373580 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:06.373039 17527 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:06.350932 18543 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:06.347361 18555 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:06.424835 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:06.425526 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.359300 18597 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:06.428596 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 209525us
I20260709 13:19:06.345839 18314 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:06.430686 16924 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:06.437095 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.374094 16803 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:06.393160 18569 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:06.414193 18584 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:06.410403 18498 raft_consensus.cc:697] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:06.384991 16876 raft_consensus.cc:606] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:06.417817 18562 raft_consensus.cc:697] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:06.428175 18555 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:06.444550 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:06.424741 18505 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:06.424800 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:06.436053 18454 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:06.368453 18581 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:06.451171 18491 raft_consensus.cc:697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:06.463164 18491 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:06.465981 16951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1621) took 1148 ms. Trace:
I20260709 13:19:06.451627 18562 consensus_queue.cc:237] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:06.461619 18601 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:19:06.461220 18505 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:06.466360 16951 rpcz_store.cc:276] 0709 13:19:05.317203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.917845 (+600642us) service_pool.cc:224] Handling call
0709 13:19:05.918259 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.918509 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.918546 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.046283 (+127737us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b2c0012df38. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:19:06.046680 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.193221 (+146541us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:06.392510 (+199289us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.409110 (+ 16600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.409187 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.465540 (+ 56353us) raft_consensus.cc:1685] finished
0709 13:19:06.465644 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.465896 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11031,"prepare.queue_time_us":263568,"raft.queue_time_us":15915,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10508,"spinlock_wait_cycles":4026240,"thread_start_us":307747,"threads_started":2,"wal-append.queue_time_us":321837}
I20260709 13:19:06.462200 18581 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:06.446656 18462 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:06.427811 18543 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:06.438608 18597 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:06.483527 18555 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:06.479889 18256 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:06.498041 17524 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:06.498183 18256 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:06.499006 18555 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:06.506328 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 137610us
I20260709 13:19:06.478686 18364 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:06.485872 18544 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.478201 18454 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:06.514726 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 70277.7us
I20260709 13:19:06.515453 18618 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:19:06.515396 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 89195us
W20260709 13:19:06.521332 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.531924 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:06.540418 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:06.541646 16952 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
W20260709 13:19:06.540820 17492 leader_election.cc:336] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.617s (SENT)
I20260709 13:19:06.545879 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.509577 18504 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:06.512020 18581 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.549158 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.554741 16953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1624) took 1236 ms. Trace:
I20260709 13:19:06.554792 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.555248 16953 rpcz_store.cc:276] 0709 13:19:05.318004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.894737 (+576733us) service_pool.cc:224] Handling call
0709 13:19:06.554572 (+659835us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002d3a54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:06.554687 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298139520}
I20260709 13:19:06.555711 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:06.556607 18492 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:06.556975 18492 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.557278 18492 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:06.557281 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:06.558017 16882 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:06.561921 16810 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:06.562695 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:06.563298 16810 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:06.563910 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:06.564070 16807 raft_consensus.cc:1275] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:06.477574 18498 consensus_queue.cc:237] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:06.530417 18467 raft_consensus.cc:697] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:06.568768 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:06.571076 16809 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:06.572582 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:06.516386 18364 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:19:06.553218 18341 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:06.550024 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:06.578397 16804 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:06.504105 18314 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:06.560760 18618 raft_consensus.cc:697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:06.596439 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:06.552979 18620 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:19:06.564977 18581 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:06.581420 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:06.565968 18575 raft_consensus.cc:697] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:06.565968 18598 raft_consensus.cc:697] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:19:07.013695 18499 consensus_meta.cc:287] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 1.452s	user 0.010s	sys 0.002s
W20260709 13:19:07.045105 16955 consensus_meta.cc:287] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.929s	user 0.010s	sys 0.000s
I20260709 13:19:06.581504 18331 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:06.588748 17519 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.084821 18341 raft_consensus.cc:697] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:06.599269 18610 log.cc:927] Time spent T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:19:06.682715 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.090561 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.093076 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:07.090708 16805 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:19:06.600013 18615 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:19:07.114753 16807 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:19:06.957465 18456 consensus_meta.cc:287] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 1.385s	user 0.003s	sys 0.010s
W20260709 13:19:07.115448 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.601502 18314 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:07.089732 18529 consensus_meta.cc:287] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.900s	user 0.007s	sys 0.005s
W20260709 13:19:07.016654 17521 consensus_meta.cc:287] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.003s
W20260709 13:19:07.017863 18453 consensus_meta.cc:287] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.993s	user 0.011s	sys 0.000s
W20260709 13:19:06.741729 18542 consensus_meta.cc:287] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.000s
I20260709 13:19:06.583878 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:06.695952 18484 consensus_meta.cc:287] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.672s	user 0.003s	sys 0.007s
I20260709 13:19:07.091483 18563 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:07.166643 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.597254 16884 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:07.105903 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.155495 16881 raft_consensus.cc:1275] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:07.158083 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:06.597256 18268 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:06.968115 18625 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:06.668097 18597 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:06.984345 18619 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:07.192495 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:07.192576 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:06.644481 18622 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:07.104910 16955 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
W20260709 13:19:07.180313 16775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.003s	sys 0.009s
W20260709 13:19:07.196308 16775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.008s	sys 0.014s
W20260709 13:19:07.196915 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 616162us
I20260709 13:19:07.090582 18499 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.164317 17521 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:07.240007 16884 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
W20260709 13:19:07.254446 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 56434.6us
I20260709 13:19:06.644289 18454 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.193528 18484 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.198607 18625 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.159641 18631 consensus_queue.cc:1059] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:19:07.191813 16879 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.161628 18529 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.262955 16878 raft_consensus.cc:2393] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:06.668893 18618 consensus_queue.cc:237] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:06.657420 18467 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.268308 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.269023 16884 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:07.252772 18543 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.271250 16956 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
W20260709 13:19:07.273239 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.264906 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 167501us
I20260709 13:19:07.199914 18463 raft_consensus.cc:2764] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:19:07.203955 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:07.255462 16955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 1546) took 1670 ms (client timeout 1941 ms). Trace:
W20260709 13:19:07.273744 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.262656 18331 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:07.258064 18624 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:19:07.283886 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.203649 18619 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.277707 18498 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:07.273550 18638 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.296000 18638 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:07.297874 18492 consensus_meta.cc:287] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.740s	user 0.008s	sys 0.000s
I20260709 13:19:07.298166 18638 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.298292 18492 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.299141 18581 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:07.280735 18636 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.300159 18636 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.302173 18636 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.303108 16802 raft_consensus.cc:2368] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:07.303889 18597 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:07.304589 16882 consensus_meta.cc:287] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.746s	user 0.005s	sys 0.005s
I20260709 13:19:07.304406 18597 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.304930 16882 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:07.305189 16884 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:07.306062 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.306351 18597 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:07.306787 16884 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:07.307646 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.308212 16884 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.309561 16879 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:07.309739 18498 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:07.310314 18498 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.170449 18542 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.312409 18542 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.313442 18543 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.209465 18453 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.202798 18622 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:07.310628 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.314600 16806 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:07.304874 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:07.275342 17492 leader_election.cc:336] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.750s (SENT)
I20260709 13:19:07.313889 18543 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.321638 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:07.207962 18598 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:07.308849 16775 connection.cc:256] RPC call timeout handler was delayed by -1.2277694220001649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:19:07.292438 18633 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
I20260709 13:19:07.308173 18492 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:07.322476 16775 connection.cc:256] RPC call timeout handler was delayed by -1.1795849520001411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
I20260709 13:19:07.326510 16884 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:07.327222 18331 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.329119 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.330364 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.332403 16884 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:07.333316 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.312417 18498 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.257736 18575 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:07.280645 16955 rpcz_store.cc:269] 0709 13:19:05.532716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.575051 (+ 42335us) service_pool.cc:224] Handling call
0709 13:19:07.202877 (+1627826us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:07.338289 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 62974.8us
I20260709 13:19:07.337038 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.339133 16881 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:07.265414 18341 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:07.339339 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 146893us
I20260709 13:19:07.340121 16922 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:07.326618 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.343659 16882 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:07.341691 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:07.329980 18638 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.331032 18597 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:07.331826 16879 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:07.331504 18634 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:07.322903 18453 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.348261 16884 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:07.352641 18530 raft_consensus.cc:3055] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:07.365818 18530 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:07.365954 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:07.366606 17523 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
I20260709 13:19:07.367123 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44626 (request call id 511) took 1824 ms. Trace:
I20260709 13:19:07.366727 18530 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.369175 18456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44636 (request call id 529) took 6075 ms. Trace:
I20260709 13:19:07.353138 18645 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:07.355453 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:07.356215 18258 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.356472 18592 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 1.547s	user 0.004s	sys 0.013s
I20260709 13:19:07.350190 18215 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.351397 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:07.344974 16882 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:07.350082 18638 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.349231 16805 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:07.369544 18456 rpcz_store.cc:276] 0709 13:19:01.303760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.315186 (+ 11426us) service_pool.cc:224] Handling call
0709 13:19:02.202408 (+887222us) ts_tablet_manager.cc:934] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
0709 13:19:04.810824 (+2608416us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:05.529641 (+718817us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:05.529754 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:07.169280 (+1639526us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:07.208025 (+ 38745us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:07.368994 (+160969us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:07.369095 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":59517,"tablet-copy.queue_time_us":741650,"thread_start_us":553167,"threads_started":2}
W20260709 13:19:07.377763 16802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 1465) took 1212 ms (client timeout 1571 ms). Trace:
I20260709 13:19:07.378625 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 570) took 1461 ms. Trace:
I20260709 13:19:07.404592 17525 rpcz_store.cc:276] 0709 13:19:05.917721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.923073 (+  5352us) service_pool.cc:224] Handling call
0709 13:19:05.946323 (+ 23250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.103333 (+157010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.378431 (+1275098us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b54006428d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:07.378575 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195645184}
W20260709 13:19:07.379382 16950 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 1550) took 1845 ms (client timeout 1795 ms). Trace:
I20260709 13:19:07.383268 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:07.389832 16804 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:07.389814 16879 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:07.398151 18215 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.361431 18646 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:19:07.405619 16950 rpcz_store.cc:269] 0709 13:19:05.534021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.564999 (+ 30978us) service_pool.cc:224] Handling call
0709 13:19:07.379213 (+1814214us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54003098d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:07.379327 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085250304}
I20260709 13:19:07.399636 18530 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:07.413429 16880 raft_consensus.cc:1275] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:07.396454 18505 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:19:07.382148 18634 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.413203 18499 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.367448 17523 rpcz_store.cc:276] 0709 13:19:05.542723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.545833 (+  3110us) service_pool.cc:224] Handling call
0709 13:19:07.365825 (+1819992us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b5800011198. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71eee 0000000000375939 00007feef3fe51e0 00007feef40ae0c4 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:07.367070 (+  1245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11454720}
I20260709 13:19:07.403740 16955 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
W20260709 13:19:07.495879 16878 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 176) took 2122 ms (client timeout 1665 ms). Trace:
I20260709 13:19:07.489095 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:07.496287 16878 rpcz_store.cc:269] 0709 13:19:05.373084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.373196 (+   112us) service_pool.cc:224] Handling call
0709 13:19:07.495642 (+2122446us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400341f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:07.495788 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4189636480}
I20260709 13:19:07.399410 18258 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.508209 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:07.456544 16884 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:07.510339 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:07.409299 18619 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:07.511929 18619 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.512676 18619 raft_consensus.cc:697] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:07.516422 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:07.488055 18544 consensus_meta.cc:287] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.957s	user 0.009s	sys 0.002s
I20260709 13:19:07.410144 18498 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:07.520751 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:07.407997 18638 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:07.417131 18543 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:07.480032 18646 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:07.525641 16951 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:19:07.487557 18580 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.419888 18456 tablet_copy_client.cc:806] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:07.408699 18625 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:07.418762 18529 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.529372 16924 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:07.418504 17519 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
W20260709 13:19:07.404520 16802 rpcz_store.cc:269] 0709 13:19:06.164932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.172683 (+  7751us) service_pool.cc:224] Handling call
0709 13:19:07.377556 (+1204873us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002a9754. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:07.377689 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2449150336}
I20260709 13:19:07.517948 18649 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.517956 18645 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.525534 18544 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:07.533344 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:07.536110 18563 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.536559 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34330 (request call id 1547) took 2003 ms. Trace:
I20260709 13:19:07.536903 16954 rpcz_store.cc:276] 0709 13:19:05.533136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.143407 (+610271us) service_pool.cc:224] Handling call
0709 13:19:06.143783 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.150513 (+  6730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.536353 (+1385840us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b54002094d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:07.536507 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4067072}
I20260709 13:19:07.536581 18563 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:07.538749 18563 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.541298 17518 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:07.541949 17518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 517) took 1185 ms. Trace:
I20260709 13:19:07.542243 17518 rpcz_store.cc:276] 0709 13:19:06.356218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.359878 (+  3660us) service_pool.cc:224] Handling call
0709 13:19:07.540934 (+1181056us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800011198. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:07.541120 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.541703 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.541899 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33076096}
I20260709 13:19:07.525416 18617 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:07.569514 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:07.520035 18618 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:19:07.534883 18498 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.572227 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:07.574275 18639 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:07.577502 18258 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.544560 17520 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:07.513952 18619 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.574733 18649 raft_consensus.cc:697] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:07.413604 18622 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.531754 18580 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.573205 18645 raft_consensus.cc:697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:07.612851 18645 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.581722 18498 raft_consensus.cc:697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:07.614821 16805 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:07.606088 18639 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:07.615104 18498 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.616161 18639 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.617544 16956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1623) took 2299 ms. Trace:
I20260709 13:19:07.617942 16956 rpcz_store.cc:276] 0709 13:19:05.317742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.030979 (+713237us) service_pool.cc:224] Handling call
0709 13:19:06.031294 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.278938 (+1247644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.617345 (+338407us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000528d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:07.617490 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2851111168}
I20260709 13:19:07.573788 18215 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:07.581561 18453 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:07.636217 16801 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3. Ops: []
W20260709 13:19:07.636603 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 227783us
I20260709 13:19:07.637552 16807 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:19:07.646672 16807 pending_rounds.cc:85] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 1
I20260709 13:19:07.647802 16804 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:19:07.648483 16804 pending_rounds.cc:85] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 1
I20260709 13:19:07.584080 16802 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:07.646785 18621 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:07.655290 18628 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.847s	user 0.000s	sys 0.024s
I20260709 13:19:07.607030 18646 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.580241 18456 tablet_copy_client.cc:670] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:07.662505 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:07.647636 18462 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.648015 16807 pending_rounds.cc:107] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:19:07.648773 16804 pending_rounds.cc:107] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:19:07.666647 16807 raft_consensus.cc:2889] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:07.668984 18634 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.670524 16879 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:07.666604 16881 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:07.668483 16804 raft_consensus.cc:2889] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:07.723637 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.669693 18618 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:07.718267 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 49021.6us
I20260709 13:19:07.669375 18649 consensus_queue.cc:237] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:07.668088 18653 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:19:07.720942 18563 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:07.729389 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.638727 18484 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.721638 16807 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:07.722450 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.730542 16880 raft_consensus.cc:2393] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:07.730183 18484 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.732573 18484 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.733112 18484 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:19:07.727088 16775 leader_election.cc:336] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.972s (SENT)
I20260709 13:19:07.665752 18621 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.668895 18462 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.734160 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:07.724615 18617 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:07.733649 18484 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.755786 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.756209 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:07.729862 18563 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.750799 18341 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:07.738250 18618 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:07.754953 18617 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:07.783988 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.132155 16878 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:07.806641 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.132231 16775 leader_election.cc:336] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.132s (SENT)
W20260709 13:19:07.862444 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:07.781013 18484 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.832248 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.170953 16884 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.174482 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:08.167871 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.175225 16881 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.171947 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:07.830710 18621 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:07.795583 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37974 (request call id 18) took 2739 ms. Trace:
I20260709 13:19:08.182543 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.185348 16878 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.165783 18645 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:08.188565 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.188750 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:07.831199 18542 raft_consensus.cc:3055] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:08.194914 16880 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.195546 16884 raft_consensus.cc:2368] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3.
I20260709 13:19:07.831655 18588 raft_consensus.cc:3055] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:08.206727 16881 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:08.207827 16810 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
W20260709 13:19:08.208549 16810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 1115) took 1644 ms (client timeout 1697 ms). Trace:
I20260709 13:19:08.206694 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.210525 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.210525 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.212940 16884 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.213729 16881 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:19:08.209000 16810 rpcz_store.cc:269] 0709 13:19:06.563856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.564158 (+   302us) service_pool.cc:224] Handling call
0709 13:19:07.829941 (+1265783us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b58001d0498. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:08.208478 (+378537us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178198400}
I20260709 13:19:08.198331 18542 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:08.215770 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.183158 16876 rpcz_store.cc:276] 0709 13:19:05.056457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.074911 (+ 18454us) service_pool.cc:224] Handling call
0709 13:19:07.795311 (+2720400us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400191c54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef090853 00007feef405e60a 00007feeed5e47d4 00007feeed5e4762 00007feeed5e4691 00007feeed5e460c 00007feeed5e38c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:07.795460 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2926263040}
I20260709 13:19:08.231791 16878 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:08.229233 17527 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:19:08.204245 18588 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:08.234759 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.203986 18563 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.236910 16878 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.215822 18462 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.249974 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.250769 17527 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:08.203547 18645 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.236428 17519 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:08.254180 16876 raft_consensus.cc:1240] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:19:08.254690 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:08.261045 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:08.257555 18639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.036s	sys 0.061s
I20260709 13:19:08.265339 17518 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:08.272790 16881 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:08.273021 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:08.273545 17527 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.274399 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.275329 16881 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.280611 16878 raft_consensus.cc:1240] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:19:08.268798 18639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.036s	sys 0.062s
W20260709 13:19:08.292217 16804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.028s
W20260709 13:19:08.292655 16804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.005s	sys 0.028s
I20260709 13:19:08.281385 18617 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:08.305111 18645 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:08.313949 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.316380 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:08.318635 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.318778 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.318907 16881 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:08.319351 16884 raft_consensus.cc:2410] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:19:08.319254 16881 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:08.320382 16881 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.321403 16881 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.325497 18575 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.326093 18575 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.329037 16876 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:08.330163 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:08.330441 16885 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 182) took 2955 ms (client timeout 2056 ms). Trace:
I20260709 13:19:08.330744 16876 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
W20260709 13:19:08.330843 16885 rpcz_store.cc:269] 0709 13:19:05.374670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.452211 (+ 77541us) service_pool.cc:224] Handling call
0709 13:19:08.330285 (+2878074us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b5400134f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:08.330382 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578189184}
I20260709 13:19:08.311998 18425 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.333000 16884 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:08.332942 18425 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.334376 16956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:08.335006 16956 raft_consensus.cc:606] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:08.335035 18425 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:08.287725 18542 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.336241 18542 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.339156 16882 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:08.337589 16876 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:08.341697 18575 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:08.287531 18588 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.340440 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.342880 18588 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.345052 17527 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:08.345849 16884 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:08.351975 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.352378 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.352806 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:08.353070 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.353535 16884 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:08.357647 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.351817 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.359481 16881 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:08.360383 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.362630 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.363462 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.364253 16884 raft_consensus.cc:2393] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.367139 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.367748 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.368521 16881 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:08.368441 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.361776 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:08.362203 18632 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:08.373435 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.376030 16884 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:08.376451 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.377079 16884 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:19:08.370651 18493 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.352186 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.381999 18493 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.379060 18632 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.384946 18493 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:08.385705 18632 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.375623 17518 raft_consensus.cc:2376] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4. Re-sending same reply.
I20260709 13:19:08.391949 17519 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:19:08.394595 18607 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 1.985s	user 0.013s	sys 0.016s
I20260709 13:19:08.401417 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:08.401953 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 194) took 2868 ms. Trace:
I20260709 13:19:08.402571 16803 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:08.403254 16803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 1108) took 1845 ms. Trace:
I20260709 13:19:08.404147 16803 rpcz_store.cc:276] 0709 13:19:06.558040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.563564 (+  5524us) service_pool.cc:224] Handling call
0709 13:19:08.401179 (+1837615us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b58001d0498. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:08.403177 (+  1998us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12312960}
I20260709 13:19:08.402513 16883 rpcz_store.cc:276] 0709 13:19:05.533150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.053676 (+520526us) service_pool.cc:224] Handling call
0709 13:19:06.053975 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.054268 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.054299 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:06.054856 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:19:06.214011 (+159155us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:06.419247 (+205236us) log.cc:844] Serialized 14 byte log entry
0709 13:19:06.419435 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.419509 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.323977 (+1904468us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b18003eaac0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebfa9522 00007feeebfab7c1 00007feeebfab779 00007feeebfab709 00007feeebfab6d1 00007feeebfaa9cd 000000000038f354 000000000038f199 00007feeebf8c83a
0709 13:19:08.393880 (+ 69903us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:08.399747 (+  5867us) raft_consensus.cc:1685] finished
0709 13:19:08.399777 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.401854 (+  2077us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7728,"prepare.queue_time_us":295995,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":29044,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":25713,"spinlock_wait_cycles":23403008,"thread_start_us":347521,"threads_started":2,"wal-append.queue_time_us":287988}
I20260709 13:19:08.412096 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.412897 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.413594 16881 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.414321 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.414997 16881 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.415772 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.416424 16881 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.412912 16883 raft_consensus.cc:2393] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.418653 18542 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:08.419265 18542 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.419503 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:08.421934 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.428510 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.429208 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:08.429639 16884 raft_consensus.cc:2376] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3. Re-sending same reply.
I20260709 13:19:08.429777 16880 raft_consensus.cc:2376] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4. Re-sending same reply.
I20260709 13:19:08.431486 16808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:43212
W20260709 13:19:08.430689 18599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.874s	user 0.028s	sys 0.037s
W20260709 13:19:08.432106 18599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.884s	user 0.028s	sys 0.037s
I20260709 13:19:08.432106 16808 raft_consensus.cc:606] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:08.434026 18624 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.434446 18624 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.440349 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.441066 16880 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.441841 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.442034 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.442378 16880 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:08.442682 16882 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:08.442862 18624 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.443315 16884 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:19:08.444988 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.445779 16885 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:08.446202 16885 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:08.447089 16885 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.448007 16885 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.448854 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.448954 16803 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:08.452080 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 513) took 2102 ms. Trace:
I20260709 13:19:08.452507 17524 rpcz_store.cc:276] 0709 13:19:06.349632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.349732 (+   100us) service_pool.cc:224] Handling call
0709 13:19:06.349991 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.498570 (+148579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.451851 (+1953281us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540043bf54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:08.451992 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339902720}
I20260709 13:19:08.454805 16885 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.455364 18580 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:08.459287 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:08.459748 18662 log.cc:927] Time spent T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.707s	user 0.008s	sys 0.010s
I20260709 13:19:08.459806 16881 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:08.461303 16883 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:08.461508 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:08.456152 18542 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:08.456216 16877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 187) took 3075 ms (client timeout 1823 ms). Trace:
I20260709 13:19:08.462158 16803 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
W20260709 13:19:08.462284 16877 rpcz_store.cc:269] 0709 13:19:05.380742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.443110 (+ 62368us) service_pool.cc:224] Handling call
0709 13:19:08.456028 (+3012918us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b5400191c54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:08.456154 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2121794816}
I20260709 13:19:08.464264 18618 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.465077 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:08.467368 16773 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:08.468184 16773 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:08.445127 18624 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:08.456754 18620 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.468724 18683 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:08.469030 18620 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.474195 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:08.474993 16803 raft_consensus.cc:2410] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:08.476353 18620 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:08.471938 16877 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:08.457567 16808 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:08.476351 18542 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:08.478417 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.478806 18542 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.477927 16773 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:08.461370 16951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 120) took 1925 ms. Trace:
I20260709 13:19:08.479651 18683 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:08.480158 18683 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.479818 16951 rpcz_store.cc:276] 0709 13:19:06.536043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.537825 (+  1782us) service_pool.cc:224] Handling call
0709 13:19:06.563347 (+ 25522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.526902 (+963555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.461169 (+934267us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b540030a2d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:08.461317 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209214592}
I20260709 13:19:08.456648 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 515) took 2101 ms. Trace:
I20260709 13:19:08.473485 16881 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:08.481349 18256 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.473999 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.481755 18568 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:08.482020 16883 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:08.481851 18256 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.482240 18568 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.482699 18568 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.479343 18542 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.483611 16773 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:08.483852 18562 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:08.484337 18427 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:08.484337 18562 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.484990 18427 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:08.485874 18427 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.486474 18562 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.487538 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:08.488248 16957 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:08.489099 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.489717 16956 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:08.501698 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 192) took 2243 ms. Trace:
I20260709 13:19:08.502069 16806 rpcz_store.cc:276] 0709 13:19:06.258663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.350418 (+ 91755us) service_pool.cc:224] Handling call
0709 13:19:06.350691 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.320825 (+970134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.501462 (+1180637us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b5400098dd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:08.501624 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2216264064}
I20260709 13:19:08.503479 18568 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:08.503952 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.522825 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.522768 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.479758 18504 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.522459 16705 catalog_manager.cc:5697] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 2 to 3, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 3 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:08.523375 16850 connection.cc:256] RPC call timeout handler was delayed by -2.1045668820001993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:19:08.523891 16850 connection.cc:256] RPC call timeout handler was delayed by -2.1045668820001993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 13:19:08.523643 18504 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:08.524185 16850 connection.cc:256] RPC call timeout handler was delayed by -2.0568668820001221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 13:19:08.524588 16850 connection.cc:256] RPC call timeout handler was delayed by -1.9749668820002171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
W20260709 13:19:08.524904 16850 connection.cc:256] RPC call timeout handler was delayed by -1.9533668820001822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 13:19:08.525187 16850 connection.cc:256] RPC call timeout handler was delayed by -1.9533668820001822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 13:19:08.525460 16850 connection.cc:256] RPC call timeout handler was delayed by -1.9425668820001647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:19:08.525746 18504 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.526734 16950 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:08.528328 18568 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:08.465490 17526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44626 (request call id 514) took 2110 ms (client timeout 2687 ms). Trace:
I20260709 13:19:08.472788 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.541755 16879 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
W20260709 13:19:08.541548 17526 rpcz_store.cc:269] 0709 13:19:06.355021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.355164 (+   143us) service_pool.cc:224] Handling call
0709 13:19:08.465310 (+2110146us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540026edd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:08.465415 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2568941824}
I20260709 13:19:08.481082 17520 rpcz_store.cc:276] 0709 13:19:06.355504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.359378 (+  3874us) service_pool.cc:224] Handling call
0709 13:19:06.414123 (+ 54745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.633104 (+1218981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.456440 (+823336us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540026f7d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:08.456593 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2572445952}
I20260709 13:19:08.511129 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:08.512039 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.513163 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 1481) took 2098 ms. Trace:
I20260709 13:19:08.543290 16954 raft_consensus.cc:2410] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:08.542984 16801 rpcz_store.cc:276] 0709 13:19:06.414597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.414728 (+   131us) service_pool.cc:224] Handling call
0709 13:19:06.438579 (+ 23851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:07.638063 (+1199484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.512967 (+874904us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000992d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:08.513111 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2753847552}
I20260709 13:19:08.514261 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.544124 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.544421 16956 raft_consensus.cc:2410] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:08.544680 16954 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:08.545176 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.545400 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.514799 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:08.545884 16954 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:08.546402 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.546571 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.547080 16954 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:08.547421 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:08.548156 18490 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:08.548949 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.549669 18490 consensus_queue.cc:1059] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:08.514886 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.515292 18425 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.550536 18425 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.550879 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.551357 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:08.551908 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:08.552556 18490 consensus_queue.cc:1059] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:08.516824 18256 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.552773 18425 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.516695 16883 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:08.517074 16708 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51366 (request call id 183) took 3953 ms. Trace:
I20260709 13:19:08.519358 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.553416 18644 raft_consensus.cc:3055] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:08.553763 18644 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:08.553813 16881 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:08.519910 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:08.519358 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:08.554543 18644 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.555279 16878 raft_consensus.cc:2410] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:08.520473 16877 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:08.555814 18644 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:08.550550 18503 raft_consensus.cc:3055] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:08.556797 18503 raft_consensus.cc:740] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:08.557492 16955 raft_consensus.cc:1240] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:08.557662 18503 consensus_queue.cc:260] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.558930 18503 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.515461 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.530126 16950 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:08.531370 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:08.525743 16850 connection.cc:256] RPC call timeout handler was delayed by -1.9425668820001647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:19:08.532871 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.524152 16705 catalog_manager.cc:5697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.532366 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:08.561381 16850 connection.cc:256] RPC call timeout handler was delayed by -1.9344668820001516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
I20260709 13:19:08.486940 18562 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.548128 16958 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:08.561699 16953 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 1.
I20260709 13:19:08.562099 18562 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.562639 16705 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 2 to 3, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 3 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.559847 16708 rpcz_store.cc:276] 0709 13:19:04.564247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.564441 (+   194us) service_pool.cc:224] Handling call
0709 13:19:08.517018 (+3952577us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:04.959872 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:04.973994 (+ 14122us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:04.974026 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:19:04.974039 (+    13us) tablet.cc:662] Decoding operations
0709 13:19:04.976649 (+  2610us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:04.976750 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:04.976774 (+    24us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:19:04.977222 (+   448us) tablet.cc:701] Row locks acquired
0709 13:19:04.977236 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:19:04.977362 (+   126us) write_op.cc:270] Start()
0709 13:19:04.977459 (+    97us) write_op.cc:276] Timestamp: P: 1783603144977324 usec, L: 0
0709 13:19:04.977474 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:19:05.073299 (+ 95825us) log.cc:844] Serialized 2416 byte log entry
0709 13:19:05.587088 (+513789us) op_driver.cc:464] REPLICATION: finished
0709 13:19:06.250867 (+663779us) write_op.cc:301] APPLY: starting
0709 13:19:06.349953 (+ 99086us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:06.363334 (+ 13381us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:06.367625 (+  4291us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:06.429483 (+ 61858us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:06.452579 (+ 23096us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:19:06.459815 (+  7236us) write_op.cc:312] APPLY: finished
0709 13:19:06.510871 (+ 51056us) log.cc:844] Serialized 53 byte log entry
0709 13:19:08.321216 (+1810345us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeebf8c0ac 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b
0709 13:19:08.432801 (+111585us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:08.432909 (+   108us) write_op.cc:454] Released schema lock
0709 13:19:08.432957 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:08.433298 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:08.433329 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7067,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":627573,"apply.run_cpu_time_us":78654,"apply.run_wall_time_us":2196079,"num_ops":6,"prepare.queue_time_us":121550,"prepare.run_cpu_time_us":4462,"prepare.run_wall_time_us":143118,"replication_time_us":584328,"spinlock_wait_cycles":6377344,"thread_start_us":2292270,"threads_started":3,"wal-append.queue_time_us":1923416}]]}
I20260709 13:19:08.551451 16957 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
W20260709 13:19:08.518967 16924 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.697s (SENT) [suppressed 40 similar messages]
W20260709 13:19:08.529042 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 45502.4us
W20260709 13:19:08.561733 16850 connection.cc:256] RPC call timeout handler was delayed by -1.9344668820001516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
I20260709 13:19:08.551955 16954 raft_consensus.cc:2376] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4. Re-sending same reply.
I20260709 13:19:08.563627 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:08.564405 16705 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 2 to 3, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 3 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.563818 18490 consensus_queue.cc:1059] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:19:08.584753 18490 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:08.585348 18490 raft_consensus.cc:3055] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:08.585728 18490 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:08.586570 18490 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.565274 16956 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.573024 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:08.564085 18562 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:08.588063 16808 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
W20260709 13:19:08.571843 16850 connection.cc:256] RPC call timeout handler was delayed by -1.8795668820000628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
I20260709 13:19:08.571959 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:08.570775 18341 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:19:08.564707 16955 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:19:08.588902 16850 connection.cc:256] RPC call timeout handler was delayed by -1.8795668820000628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:19:08.591012 16850 connection.cc:256] RPC call timeout handler was delayed by -1.8345668820002174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 13:19:08.591334 16850 connection.cc:256] RPC call timeout handler was delayed by -1.8066668820001723s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:19:08.591624 16850 connection.cc:256] RPC call timeout handler was delayed by -1.8066668820001723s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:19:08.591930 16850 connection.cc:256] RPC call timeout handler was delayed by -1.7769668820001243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
W20260709 13:19:08.592234 16850 connection.cc:256] RPC call timeout handler was delayed by -1.579866882000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 13:19:08.592540 16850 connection.cc:256] RPC call timeout handler was delayed by -1.579866882000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 13:19:08.592806 16850 connection.cc:256] RPC call timeout handler was delayed by -1.5753668820000257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 13:19:08.593073 16850 connection.cc:256] RPC call timeout handler was delayed by -1.5636668820002342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 13:19:08.593356 16850 connection.cc:256] RPC call timeout handler was delayed by -1.5636668820002342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 13:19:08.593664 16850 connection.cc:256] RPC call timeout handler was delayed by -1.2585668820001956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24580000000000002s for a response
W20260709 13:19:08.593938 16850 connection.cc:256] RPC call timeout handler was delayed by -1.2144668820001243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25070000000000003s for a response
W20260709 13:19:08.594201 16850 connection.cc:256] RPC call timeout handler was delayed by -1.2144668820001243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25070000000000003s for a response
W20260709 13:19:08.594477 16850 connection.cc:256] RPC call timeout handler was delayed by -1.1739668820000588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25520000000000004s for a response
W20260709 13:19:08.594748 16850 connection.cc:256] RPC call timeout handler was delayed by -1.1739668820000588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25520000000000004s for a response
W20260709 13:19:08.595007 16850 connection.cc:256] RPC call timeout handler was delayed by -1.1118668820001858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2621s for a response
W20260709 13:19:08.595276 16850 connection.cc:256] RPC call timeout handler was delayed by -1.1118668820001858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2621s for a response
I20260709 13:19:08.596231 18490 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.598445 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:08.599661 16850 leader_election.cc:400] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:08.600725 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:08.601390 16803 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:08.601691 16850 leader_election.cc:400] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:08.602872 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:08.606676 16850 leader_election.cc:403] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.607327 18425 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:08.607708 16802 raft_consensus.cc:3055] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:08.608121 16802 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:08.609396 16850 leader_election.cc:400] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:08.605062 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:08.611091 16808 raft_consensus.cc:2368] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:08.611212 16850 leader_election.cc:400] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:08.609164 16802 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.608049 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:08.612226 16802 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.612847 18568 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:08.613229 18568 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.613618 18568 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.615741 18644 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:08.617316 16955 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:08.611562 16850 leader_election.cc:403] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.522483 18542 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.620718 18425 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:08.621423 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:08.621914 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:08.613216 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:08.624218 18427 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:08.624714 16954 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.625475 18425 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:08.625982 18542 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.626456 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.626928 16850 leader_election.cc:400] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:08.637734 16850 leader_election.cc:403] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.628631 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:08.638415 16808 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:08.630353 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:08.631443 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 1.28381e+06us
I20260709 13:19:08.495136 18683 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.633369 16955 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:08.634883 16956 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:08.644601 17523 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:08.647485 18683 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.645524 18425 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:08.647929 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.650187 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.652241 17525 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:08.645066 16850 leader_election.cc:400] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:08.653409 16850 leader_election.cc:403] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.635520 16802 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:08.636444 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:19:08.637056 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:08.624636 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:08.641074 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.658463 17526 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.659005 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:08.659237 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:08.659579 17524 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.660066 18258 consensus_queue.cc:1059] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:19:08.640743 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 121781us
I20260709 13:19:08.662657 16924 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:08.654500 16850 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:08.663548 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:08.664286 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:08.657924 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:08.666513 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.667066 17525 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:08.667796 18530 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:08.668620 18562 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:08.669093 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:08.669438 16850 leader_election.cc:400] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:08.669674 17520 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.670476 18256 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:08.670710 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:08.670866 18256 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:08.656213 18425 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:08.671319 18256 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:08.665683 18600 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:08.672037 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:08.672477 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.673449 18425 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.673144 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:08.676851 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.677978 18573 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:08.678146 18504 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:08.679217 18573 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:08.661873 18258 raft_consensus.cc:3055] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:08.679973 18258 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:08.679289 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:08.680721 18258 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.681452 18585 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:08.681794 18585 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:08.682031 18258 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.682173 18585 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.687158 17520 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:08.687844 17527 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:08.689015 18568 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.689431 18575 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:08.691115 18568 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:08.691121 18530 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:08.691689 18530 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.691865 16924 leader_election.cc:400] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:08.692102 18530 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.692641 18585 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.692229 16924 leader_election.cc:403] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:08.695205 18575 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.695927 17524 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:08.696362 18425 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:08.696660 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:08.697294 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.696749 18425 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:08.697575 17523 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:08.698294 18425 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.699972 18425 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.700533 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:08.701341 18600 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:08.702502 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:08.703271 18600 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:08.703749 18542 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:19:08.704123 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.704164 18542 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.704722 18542 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.704968 16924 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:08.702663 18575 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:08.707849 18585 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.707930 16773 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:08.708544 18562 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:08.712949 18562 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:08.713351 18562 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:08.713558 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.714416 17519 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:08.709041 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.709316 18505 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:08.710072 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.716174 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.710602 17522 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:08.717003 17519 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:08.717664 18683 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:08.718104 18683 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:08.711377 18268 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:08.711885 18575 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:08.712024 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.710705 18644 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:08.679580 17526 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:08.718289 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:08.719089 17525 raft_consensus.cc:1240] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:19:08.719415 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 56025.4us
I20260709 13:19:08.718585 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:08.724088 16773 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:08.734994 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:08.736725 16773 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:08.738572 16850 leader_election.cc:400] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:08.724727 18427 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:08.718297 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.742058 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:08.725001 18683 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:08.725926 18256 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.774519 18256 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:08.743382 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:08.743645 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:08.782092 17525 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:08.745913 18505 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:08.746268 18427 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:08.746811 18588 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:08.747247 18341 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:08.747952 18425 raft_consensus.cc:2764] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:19:08.749012 16694 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4b60b701acc7473e87e3e529a2a34689 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:08.711457 18530 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:08.874583 17492 connection.cc:256] RPC call timeout handler was delayed by -1.3665710689999742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
W20260709 13:19:08.918509 16694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 169537us
W20260709 13:19:08.787961 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 45995.4us
W20260709 13:19:08.919325 17492 leader_election.cc:336] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.549s (SENT)
I20260709 13:19:08.875788 16953 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:19:08.804903 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.919974 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:08.875380 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.787961 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:08.920789 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.859539 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:08.921255 17492 leader_election.cc:336] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.615s (SENT)
I20260709 13:19:08.875386 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:08.934703 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.783969 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:08.938539 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.939770 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.934784 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:08.934841 16957 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:08.925069 16924 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:08.789951 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:08.795410 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:08.870452 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:08.784011 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:08.947467 16956 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:08.936635 16808 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:08.740948 18568 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:08.782943 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:08.784785 18644 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:08.864842 18484 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:08.972873 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 51660.6us
W20260709 13:19:08.976645 17492 leader_election.cc:336] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.628s (SENT)
I20260709 13:19:08.977145 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:08.978415 17492 leader_election.cc:336] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.665s (SENT)
I20260709 13:19:08.978900 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:08.921885 18620 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:08.962391 18588 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:08.994382 18588 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.998647 18575 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:08.989543 18683 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.004034 18683 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:09.004918 18683 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:08.868896 18562 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.008998 18562 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:09.008558 18427 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.009859 16954 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:09.012315 18258 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:08.973157 18425 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.013653 18425 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.014696 18542 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:08.980316 18568 raft_consensus.cc:697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:09.017307 18542 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:08.864660 18600 consensus_queue.cc:1059] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
I20260709 13:19:08.960602 18546 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:09.020331 18600 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:09.020617 18546 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:09.021193 18600 raft_consensus.cc:3055] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:09.021629 18600 raft_consensus.cc:740] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:09.017077 18568 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:08.784192 18505 raft_consensus.cc:697] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:09.030169 18530 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:08.990762 18364 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:09.022729 18600 consensus_queue.cc:260] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:09.071833 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 146846us
I20260709 13:19:09.065713 18505 consensus_queue.cc:237] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.077733 18588 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:09.103355 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 230047us
I20260709 13:19:09.087823 18600 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.110764 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:09.126840 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 186200us
I20260709 13:19:09.113126 16922 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:09.104343 18562 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:19:09.105365 18425 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:09.102399 18605 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:19:09.102421 18484 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260709 13:19:09.130594 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 190946us
I20260709 13:19:09.128705 16924 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:09.130422 16848 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:09.133313 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:09.123330 18588 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:09.125025 18268 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:09.124950 18573 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:19:09.146970 18268 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.137099 18425 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:09.160972 18580 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:09.172156 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 388181us
W20260709 13:19:09.178843 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 200439us
I20260709 13:19:09.170182 18268 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:09.184700 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:09.177903 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 393911us
I20260709 13:19:09.147543 18588 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.179961 18618 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:09.196393 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:09.198393 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.199294 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 64205.1us
I20260709 13:19:09.200875 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:09.201021 16922 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:09.201686 16808 raft_consensus.cc:2410] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:09.203953 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:09.204005 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.205852 16806 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:09.181222 18341 raft_consensus.cc:697] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:09.207309 16808 raft_consensus.cc:2410] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:19:09.234107 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:09.234767 18698 log.cc:927] Time spent T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:09.235757 18704 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.236341 18704 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.238595 18704 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:09.239248 18530 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:09.191627 18585 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:09.242434 18585 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.242823 18585 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.181659 18256 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:19:09.179853 18706 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:19:09.208701 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.250283 18704 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:09.251940 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:09.253855 18704 raft_consensus.cc:2764] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:19:09.254362 18588 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:09.254938 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.256706 18704 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:09.258322 16850 leader_election.cc:400] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:09.199693 18618 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.260108 18618 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.264982 16850 leader_election.cc:400] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 2. Current term is 3.
I20260709 13:19:09.264380 18341 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.266134 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.206384 18575 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:09.267486 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:09.269273 18575 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:09.269822 18575 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:09.208557 17525 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:19:09.274988 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 74131.5us
W20260709 13:19:09.280256 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 146996us
I20260709 13:19:09.280385 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:09.281574 16801 raft_consensus.cc:2410] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 4 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:09.281316 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:09.283318 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.285400 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.197099 18425 consensus_queue.cc:1059] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:19:09.288338 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.291323 16885 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:09.289009 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.290132 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.290650 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.291285 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.292801 16881 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:09.294037 16884 raft_consensus.cc:2376] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3. Re-sending same reply.
I20260709 13:19:09.292732 16877 raft_consensus.cc:2410] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:19:09.294996 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.206339 18702 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:09.292659 16775 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:09.298281 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.299125 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:09.299589 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.300056 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.291137 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:09.287760 18256 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:09.291742 18258 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:09.303819 18542 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:09.304067 16880 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:09.304345 18542 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.304719 18542 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.305353 16880 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:09.305910 18707 raft_consensus.cc:3055] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:09.306274 18707 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:09.306628 16880 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:09.287719 18600 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:09.307008 18707 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.298461 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.307966 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:09.293229 16883 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:09.308655 18707 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.300879 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.309501 16884 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:09.300963 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.310443 16878 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:09.311528 18703 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:09.311975 18703 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:09.312386 18703 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:09.314376 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.303777 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:09.315658 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.315881 18573 consensus_queue.cc:1059] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:09.316437 16881 raft_consensus.cc:2410] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:09.288116 18588 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:19:09.316907 18573 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.312404 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:09.317618 16955 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.283982 18619 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:09.318629 16884 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:09.320010 16808 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:09.286401 18704 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:09.299151 16877 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
W20260709 13:19:09.295233 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 113700us
I20260709 13:19:09.297112 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.324620 16877 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:09.320856 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:09.194903 18700 consensus_queue.cc:1059] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:19:09.322630 16884 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:09.322630 16807 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:19:09.326532 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:09.327286 16885 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:09.327289 16954 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
W20260709 13:19:09.324738 17492 leader_election.cc:336] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.973s (SENT)
I20260709 13:19:09.331115 17492 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:09.330147 16775 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:09.317389 18573 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.334172 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:09.334863 16804 raft_consensus.cc:2368] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4.
I20260709 13:19:09.336758 16775 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:09.337255 16877 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:09.338265 16802 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:19:09.338508 16878 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:09.338953 18580 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.340801 18710 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:09.307345 18618 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.343654 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.325727 18619 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.373157 16801 raft_consensus.cc:1240] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:09.326156 18702 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:09.338644 16802 pending_rounds.cc:85] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 1
I20260709 13:19:09.333755 18490 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:09.378371 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:09.344336 18504 raft_consensus.cc:3055] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:09.380113 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:09.371812 18711 log.cc:927] Time spent T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:19:09.384518 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.385447 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:09.341236 18712 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:09.373207 18683 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:09.352100 18588 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:09.387334 16877 raft_consensus.cc:2376] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4. Re-sending same reply.
I20260709 13:19:09.362236 18364 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.353408 18710 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:09.390450 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:09.352679 16879 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:09.377812 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:09.376487 18619 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:09.374930 18722 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:19:09.394121 16924 leader_election.cc:400] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4.
I20260709 13:19:09.377971 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.393011 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.383250 18504 raft_consensus.cc:740] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:09.402649 16924 leader_election.cc:403] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:19:09.405539 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.393110 18600 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.390924 18580 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:09.407034 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.379539 16802 pending_rounds.cc:107] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:19:09.407948 18717 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.408231 18683 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.427098 18256 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:19:09.408353 18719 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:09.408406 18700 consensus_queue.cc:1059] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:09.394995 18427 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:09.404023 18503 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:19:09.402462 18490 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:19:09.456454 16805 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:09.456969 16810 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:09.458153 16810 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:09.410051 18702 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.394764 18588 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:09.393518 18701 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.425573 18484 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:19:09.428339 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:09.398471 18706 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:19:09.400205 18605 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:19:09.398536 18710 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.400542 18364 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.440760 16803 raft_consensus.cc:2393] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:09.426052 16882 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:09.415500 18622 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:19:09.397487 18713 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:19:09.441108 16802 raft_consensus.cc:2917] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:19:09.489280 16802 raft_consensus.cc:2889] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:09.489898 16802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42332 (request call id 15) took 9235 ms. Trace:
I20260709 13:19:09.451738 18268 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.415328 16876 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:09.455029 16955 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:09.404291 18712 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:19:09.424674 18580 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:09.498757 18580 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.500128 18580 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.461360 16810 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:09.459172 18542 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.426483 18600 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.481827 18730 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:09.485620 16804 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:09.432301 18562 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:19:09.472950 18588 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.473433 18700 consensus_queue.cc:1243] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer 96eaa6dafb3e4bbe914e54dc12507912 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:09.493920 18683 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:09.493040 16805 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:09.494405 18618 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:09.530962 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:09.493742 18568 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 13:19:09.564103 18727 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.194s	user 0.004s	sys 0.000s
W20260709 13:19:09.564709 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.575870 18705 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.576597 18705 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.577289 18364 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:09.583704 16884 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:09.476146 18701 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.584888 18600 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:09.586292 18701 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:09.588687 18503 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.589210 18268 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:09.588899 18504 consensus_queue.cc:260] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.589370 18503 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.590356 18504 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.594087 18717 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4.
I20260709 13:19:09.558384 18573 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:09.606451 16705 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58326 (request call id 271) took 1292 ms. Trace:
W20260709 13:19:09.607028 18725 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:19:09.527657 18730 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:09.609026 18710 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.606832 16705 rpcz_store.cc:276] 0709 13:19:08.314013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.314183 (+   170us) service_pool.cc:224] Handling call
0709 13:19:09.606371 (+1292188us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:08.622776 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:08.623340 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:08.623379 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:19:08.623398 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:08.624025 (+   627us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:08.643788 (+ 19763us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:08.655431 (+ 11643us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:19:08.675613 (+ 20182us) tablet.cc:701] Row locks acquired
0709 13:19:08.675633 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:08.675780 (+   147us) write_op.cc:270] Start()
0709 13:19:08.675885 (+   105us) write_op.cc:276] Timestamp: P: 1783603148675742 usec, L: 0
0709 13:19:08.675906 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:19:08.676532 (+   626us) log.cc:844] Serialized 1672 byte log entry
0709 13:19:08.997800 (+321268us) op_driver.cc:464] REPLICATION: finished
0709 13:19:09.391239 (+393439us) write_op.cc:301] APPLY: starting
0709 13:19:09.395601 (+  4362us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:09.415664 (+ 20063us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:09.442380 (+ 26716us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:09.482097 (+ 39717us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:09.482258 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:19:09.482299 (+    41us) write_op.cc:312] APPLY: finished
0709 13:19:09.482502 (+   203us) log.cc:844] Serialized 41 byte log entry
0709 13:19:09.482653 (+   151us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:09.482742 (+    89us) write_op.cc:454] Released schema lock
0709 13:19:09.482778 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:09.483121 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:09.483145 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":376658,"apply.run_cpu_time_us":2376,"apply.run_wall_time_us":96475,"num_ops":4,"prepare.queue_time_us":19796,"prepare.run_cpu_time_us":3137,"prepare.run_wall_time_us":77262,"replication_time_us":321693,"thread_start_us":304730,"threads_started":2}]]}
I20260709 13:19:09.555935 18707 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:19:09.558595 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 143457us
I20260709 13:19:09.559037 18585 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.490231 16802 rpcz_store.cc:276] 0709 13:19:00.254137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.254275 (+   138us) service_pool.cc:224] Handling call
0709 13:19:00.333592 (+ 79317us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b2c000264b8. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99ea0a 00007feeed99e693 00007feeed99e631 00007feeef0d1902 00007feeef0d16dd 00007feeef09cf3f 00007feeef09c6b3 00007feef405cd29 00007feeed5db1d4 00007feeed5db162
0709 13:19:00.567862 (+234270us) log.cc:844] Serialized 492 byte log entry
0709 13:19:00.884989 (+317127us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b5400065ca0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00f142 00007feeeefefeaa 00007feeeeff6d53 00007feeeeff6cd9 00007feeeeff6c69 00007feeeeff6c31 00007feeeeff5dfd 000000000038f354 000000000038f199 00007feeebfa9475
0709 13:19:00.908047 (+ 23058us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5400065ca0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00f142 00007feeeefefeaa 00007feeeeff6d53 00007feeeeff6cd9 00007feeeeff6c69 00007feeeeff6c31 00007feeeeff5dfd 000000000038f354 000000000038f199 00007feeebfa9475
0709 13:19:09.489793 (+8581746us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3434,"raft.queue_time_us":19348,"raft.run_cpu_time_us":5295,"raft.run_wall_time_us":644053,"spinlock_wait_cycles":84831104,"thread_start_us":25026,"threads_started":1,"wal-append.queue_time_us":127649,"wal-append.run_cpu_time_us":2013,"wal-append.run_wall_time_us":1059562}
I20260709 13:19:09.527109 18703 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.553782 18683 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:09.597344 18588 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.599852 18542 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:09.551635 18575 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.602731 18546 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.494539 18256 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:19:09.642174 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:09.579308 18705 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:09.616319 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.611450 18710 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:09.618402 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:09.619055 18707 raft_consensus.cc:697] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:09.629755 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:09.638146 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:09.668916 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.669610 16883 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:09.638604 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:09.640524 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:09.671239 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:09.640882 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:09.643409 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:09.651710 16806 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:09.673018 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:09.673741 16878 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.673938 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.609952 18730 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.674880 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:09.675109 16850 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:09.615483 18562 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.619880 17525 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:09.663626 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:09.686544 16958 raft_consensus.cc:2393] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:09.665619 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:09.687187 16881 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:09.624150 18709 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.689113 18705 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:09.689723 18600 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:09.689812 18425 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:09.690851 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.695276 16957 raft_consensus.cc:2393] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:09.698817 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 271093us
I20260709 13:19:09.620357 18620 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:19:09.728518 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:09.729311 16883 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:09.730370 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:09.674880 16708 catalog_manager.cc:5697] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.734064 16708 catalog_manager.cc:5697] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 3, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:09.714413 16952 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:09.660811 18712 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:09.716569 16924 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:09.795712 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:09.786600 16708 catalog_manager.cc:5697] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:09.804522 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 88025.3us
I20260709 13:19:09.805042 16708 catalog_manager.cc:5697] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 3, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:09.807027 16708 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 3, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:09.698491 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:09.798739 16956 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:09.810035 16881 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:09.811726 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:09.810256 16878 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:09.671515 18364 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:19:09.814327 16956 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:09.819269 16708 catalog_manager.cc:5697] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 3, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 3 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.715564 18530 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:09.699508 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:09.824360 16956 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:09.800295 18708 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.831966 16956 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:19:09.832553 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 178105us
I20260709 13:19:09.829937 16959 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:19:09.692557 18683 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.700325 18562 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.808986 18600 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:09.793908 18573 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:19:09.812373 18644 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:09.839440 16708 catalog_manager.cc:5697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.840219 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:09.729214 18717 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 13:19:09.802220 18341 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:09.662034 18546 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.812042 18700 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:09.874605 16708 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 3, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:09.841786 18718 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.830240 18712 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:19:09.717379 18709 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:09.879981 16708 catalog_manager.cc:5697] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 3, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 3 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.826668 18427 consensus_queue.cc:1059] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:19:09.831924 18619 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:09.882942 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 80027.1us
I20260709 13:19:09.946013 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:09.948601 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 114901us
I20260709 13:19:09.861155 18644 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:09.949720 16880 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:09.952541 16708 catalog_manager.cc:5697] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:09.953783 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:09.954337 16880 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:09.875952 18700 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:09.838759 18707 consensus_queue.cc:237] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:09.892230 16756 auto_rebalancer.cc:629] Failed to schedule move for tablet 89c4a22bddc9425886aa0574ae085451: Aborted: Op aborted by new leader
I20260709 13:19:09.876570 18341 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.962083 18341 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:09.951462 18364 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:19:09.958228 18542 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.828171 18737 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 13:19:09.969074 18542 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.971089 18542 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:09.971504 18709 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:09.971822 18258 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.972090 18709 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.972323 18258 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.892676 18747 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:09.860044 18600 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:09.982977 16954 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:09.981338 16953 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:09.976287 18546 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:09.983270 18575 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:09.997951 18530 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.983184 18747 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:09.998901 18542 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:09.994161 16880 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:09.963796 18703 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:09.956573 18644 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:10.005084 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:10.119105 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 114103us
I20260709 13:19:10.120077 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:10.041100 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:10.027956 18258 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:09.958240 18700 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:09.958113 18717 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:19:10.028831 18747 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:10.041659 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 84530.3us
I20260709 13:19:10.131240 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:10.132560 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:10.132828 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:10.133594 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:10.122643 18490 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:09.999979 18588 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:09.843597 18708 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.982589 18341 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:19:10.174208 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:10.175042 16878 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.041818 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:10.176504 16880 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:10.134083 18504 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:10.134738 18745 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:19:10.188120 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:10.189411 16876 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:19:10.135823 18575 consensus_queue.cc:1059] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:10.190950 16876 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:10.191115 18575 raft_consensus.cc:3055] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:10.191753 18575 raft_consensus.cc:740] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:10.136485 18605 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:10.128296 18751 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 13:19:10.192866 18605 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:10.193815 18605 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.196015 18505 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:10.196565 18505 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:10.197638 18505 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:09.886495 18718 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:10.034719 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 153377us
I20260709 13:19:10.207461 16880 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:10.122438 18568 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:09.956216 18268 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:19:10.027871 18530 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:10.218863 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 218015us
I20260709 13:19:10.156592 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:10.165102 18490 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:10.145615 18730 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.170960 18708 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.198902 18505 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:10.211277 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:10.146190 18749 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:19:10.210608 18562 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:10.221692 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 65213.2us
I20260709 13:19:10.147516 18703 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:10.199371 18742 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
W20260709 13:19:10.234041 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 100503us
I20260709 13:19:10.209683 18718 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:10.209928 18425 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:10.296181 18530 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.294557 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:10.297086 18730 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.238505 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:10.234141 18490 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:10.143656 18573 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:19:10.308825 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:10.218473 18712 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:19:10.325608 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:10.326109 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:10.315486 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 77048.3us
W20260709 13:19:10.327049 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 88254.3us
I20260709 13:19:10.326901 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:10.330770 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:10.327775 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:10.332475 18750 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:19:10.333870 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:10.334587 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:10.335345 16802 raft_consensus.cc:2393] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:10.335779 18427 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:10.336407 18427 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:10.330865 16807 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:10.223155 18700 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.329522 16806 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:10.310034 18542 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.344080 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1153) took 1014 ms. Trace:
I20260709 13:19:10.298942 18546 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:10.308252 18703 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:10.347292 16801 rpcz_store.cc:276] 0709 13:19:09.329555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.390328 (+ 60773us) service_pool.cc:224] Handling call
0709 13:19:09.390602 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.406546 (+ 15944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.406574 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.416589 (+ 10015us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.621057 (+204468us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:09.621098 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.701833 (+ 80735us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b540011a3d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:09.701895 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.316332 (+614437us) raft_consensus.cc:1685] finished
0709 13:19:10.316358 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.344022 (+ 27664us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3134,"raft.queue_time_us":4406,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":28520832,"thread_start_us":161526,"threads_started":1,"wal-append.queue_time_us":388481}
I20260709 13:19:10.348057 18427 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:10.337180 18718 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:10.324966 18490 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:10.315693 18737 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:10.352119 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:10.238150 18755 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:10.357889 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:10.365952 16884 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:10.366901 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:10.367010 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:10.367494 16884 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:10.368340 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:10.368422 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:10.359311 18605 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:10.354456 18542 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:10.362684 16878 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:10.363124 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:10.374112 16952 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.363535 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:10.370101 18755 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.372753 18718 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:10.373212 16882 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:19:10.383189 16952 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:10.385838 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:10.325546 18425 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.353542 18708 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.352538 18703 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.362190 18364 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:10.353699 18619 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:10.362514 18600 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:10.397806 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.371800 18737 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.390935 16882 pending_rounds.cc:85] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 5
I20260709 13:19:10.384603 18710 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:10.385246 18341 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:10.389582 18751 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:10.385073 18755 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.388250 18546 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:10.369200 18754 consensus_queue.cc:1059] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:19:10.409145 16882 pending_rounds.cc:107] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:19:10.401805 18364 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:10.433689 16878 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:10.408524 18737 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.436708 16878 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:19:10.396050 18588 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:19:10.389402 18605 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:10.440338 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 90384.4us
I20260709 13:19:10.446293 18425 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:10.403335 18708 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:10.447867 16924 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:10.439007 16882 raft_consensus.cc:2889] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.439556 18364 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:10.454223 18762 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:19:10.439684 18710 consensus_queue.cc:1059] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:19:10.435715 18751 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:10.456923 16951 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:10.457502 16924 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:10.454545 18753 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:10.460955 18542 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.461957 18683 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:10.463091 18754 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.465766 18710 raft_consensus.cc:3055] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:10.454656 18700 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:10.458963 18736 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:19:10.468648 18751 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:10.448431 18341 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:10.473489 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 96275us
I20260709 13:19:10.475324 16951 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:10.435339 18747 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:10.516467 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 89048.8us
I20260709 13:19:10.489084 18710 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:10.513329 18268 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:10.527602 16775 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:10.536507 18737 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.533012 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1141) took 1144 ms. Trace:
I20260709 13:19:10.541711 16885 rpcz_store.cc:276] 0709 13:19:09.388170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.542770 (+154600us) service_pool.cc:224] Handling call
0709 13:19:09.543113 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.543442 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.543466 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.550571 (+  7105us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.208980 (+658409us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b1800281e60. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec360d1 00007feeef051a0f
0709 13:19:10.227920 (+ 18940us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:10.227977 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.228088 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.528121 (+300033us) raft_consensus.cc:1685] finished
0709 13:19:10.528139 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.532953 (+  4814us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2083,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5145,"spinlock_wait_cycles":117833600,"thread_start_us":18730,"threads_started":1,"wal-append.queue_time_us":667073}
I20260709 13:19:10.463888 18718 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:10.563237 18772 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:10.563803 18772 raft_consensus.cc:697] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:10.563998 18585 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:10.511313 18754 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.543831 18503 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.560104 18780 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.561246 18268 raft_consensus.cc:697] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:10.565913 18708 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.526124 18341 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:10.577172 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 97887.3us
I20260709 13:19:10.569152 18605 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:10.601737 18341 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:10.601760 18754 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.602507 18754 consensus_queue.cc:1059] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:10.603747 18754 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.603919 18737 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.604212 18754 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.579694 18772 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.624280 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1637) took 1250 ms. Trace:
I20260709 13:19:10.624681 16954 rpcz_store.cc:276] 0709 13:19:09.373610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.373807 (+   197us) service_pool.cc:224] Handling call
0709 13:19:09.374197 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:09.997159 (+622962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.624063 (+626904us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b540030a7d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:10.624231 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388567936}
I20260709 13:19:10.626992 18753 raft_consensus.cc:697] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:10.630658 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:10.632359 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:10.633633 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:10.634163 16804 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:10.634944 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:10.636883 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:10.637392 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:10.635528 16804 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:10.612850 18456 tablet_copy_client.cc:538] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:10.637938 17525 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:10.680393 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:10.636090 18341 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.636014 18683 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.681207 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:10.589098 18780 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:10.679764 18776 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.608255 18364 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.699146 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:10.710151 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:10.711457 18783 log.cc:927] Time spent T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:19:10.697821 18341 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:10.721711 16810 raft_consensus.cc:2393] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:10.679852 18775 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:19:10.691629 18718 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:10.726550 18600 raft_consensus.cc:3055] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:10.647809 18268 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.628019 18753 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.725008 18747 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.750535 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:10.753866 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:10.760241 16957 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:10.684271 18755 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:10.714776 18703 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.765887 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:10.769575 16958 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:10.754990 16953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 1584) took 1114 ms. Trace:
I20260709 13:19:10.709048 18490 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:10.756758 18781 log.cc:927] Time spent T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:10.697495 18683 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:10.761052 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:10.770079 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 72868us
I20260709 13:19:10.770731 16953 rpcz_store.cc:276] 0709 13:19:09.640441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.640584 (+   143us) service_pool.cc:224] Handling call
0709 13:19:10.754834 (+1114250us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54002085d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:10.754938 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693856128}
I20260709 13:19:10.731107 18600 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:10.778539 16773 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:10.781126 16810 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:19:10.785625 18754 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.776656 18775 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:10.786342 18775 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:10.786481 16756 auto_rebalancer.cc:629] Failed to schedule move for tablet 06e6de173e42433e8df1572e54437e03: Illegal state: Replica 4b60b701acc7473e87e3e529a2a34689 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:10.786712 18775 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.788178 18600 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.789490 18600 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:10.796937 16808 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:10.760757 18546 raft_consensus.cc:3055] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:10.794420 16773 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:10.800980 16809 raft_consensus.cc:2393] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:10.704787 18776 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.733412 18718 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:10.904671 18644 consensus_meta.cc:287] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.777s	user 0.010s	sys 0.000s
I20260709 13:19:10.785627 16805 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:10.776226 18588 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:19:10.801172 18546 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:10.912720 16950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34330 (request call id 1589) took 1262 ms. Trace:
W20260709 13:19:10.912889 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 112256us
W20260709 13:19:10.912927 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.915292 18704 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:10.806391 18778 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:10.879735 18425 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.917341 16950 rpcz_store.cc:276] 0709 13:19:09.649839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.696265 (+ 46426us) service_pool.cc:224] Handling call
0709 13:19:10.341061 (+644796us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b5800004298. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:10.341225 (+   164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.443372 (+102147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.443452 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.455525 (+ 12073us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.551598 (+ 96073us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:10.551654 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.551767 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:10.906823 (+355056us) raft_consensus.cc:1685] finished
0709 13:19:10.906843 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.912645 (+  5802us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8230,"raft.queue_time_us":17437,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"spinlock_wait_cycles":13061888,"thread_start_us":130021,"threads_started":2,"wal-append.queue_time_us":282734}
I20260709 13:19:10.906183 18754 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:10.889468 18530 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:10.927207 18683 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.913070 18747 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.914350 18644 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:10.936668 16810 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:10.942377 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:10.931219 18703 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:10.801172 18503 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:10.908102 18775 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:10.946518 18784 log.cc:927] Time spent T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:19:10.929338 18704 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:10.946728 18341 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.948444 18503 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.939517 18530 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:10.933362 18425 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.943845 18747 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.965368 18364 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.939195 18600 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.934154 18754 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.964025 18546 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:10.994213 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:10.979161 18503 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:10.992517 18490 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:10.990331 18530 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.992194 18704 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:11.029469 18782 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:19:11.022110 18785 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.252s	user 0.001s	sys 0.001s
I20260709 13:19:10.991055 18775 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:10.989912 18755 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:11.040908 18759 log.cc:927] Time spent T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.741s	user 0.007s	sys 0.006s
I20260709 13:19:11.027078 18546 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:11.049216 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1147) took 1220 ms. Trace:
I20260709 13:19:11.058480 16877 rpcz_store.cc:276] 0709 13:19:09.829160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.134494 (+305334us) service_pool.cc:224] Handling call
0709 13:19:10.134767 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.135083 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.135108 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.135552 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.216554 (+ 81002us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:10.216613 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.216702 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.035409 (+818707us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:11.046252 (+ 10843us) raft_consensus.cc:1685] finished
0709 13:19:11.046277 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.049140 (+  2863us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5578,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4376,"spinlock_wait_cycles":34797312,"thread_start_us":78802,"threads_started":1,"wal-append.queue_time_us":159526}
I20260709 13:19:10.989334 18780 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.024569 18600 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.091377 18718 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:11.093803 18425 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:11.144500 18775 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:11.173559 17492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.019s	sys 0.017s
W20260709 13:19:11.177896 17492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.019s	sys 0.017s
I20260709 13:19:11.171825 18364 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:11.144083 18622 raft_consensus.cc:3055] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:11.169162 18588 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:11.101507 18542 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:19:11.168807 18427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.010s	sys 0.026s
W20260709 13:19:11.179862 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 589158us
I20260709 13:19:11.169018 18776 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:11.183240 18588 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:11.197463 16925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.018s	sys 0.021s
I20260709 13:19:11.174768 18775 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:11.203001 16804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.008s	sys 0.018s
I20260709 13:19:11.181974 18622 raft_consensus.cc:740] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:11.196556 18427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.011s	sys 0.027s
W20260709 13:19:11.203344 16804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.008s	sys 0.018s
I20260709 13:19:11.210023 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:11.210297 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:11.210974 16878 raft_consensus.cc:2368] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3.
W20260709 13:19:11.199443 16925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.019s	sys 0.021s
I20260709 13:19:11.207458 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:11.208357 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:11.212597 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:11.213215 16878 raft_consensus.cc:2368] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:11.213133 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:11.213696 16884 raft_consensus.cc:2376] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3. Re-sending same reply.
I20260709 13:19:11.211472 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:11.214591 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.216590 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:11.217259 16953 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.217301 16956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34330 (request call id 1593) took 1559 ms. Trace:
I20260709 13:19:11.210709 16877 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:11.217844 16956 rpcz_store.cc:276] 0709 13:19:09.657736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.833086 (+175350us) service_pool.cc:224] Handling call
0709 13:19:09.833422 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.882782 (+ 49360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.882820 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.451391 (+568571us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b2c0012df38. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:19:10.455140 (+  3749us) log.cc:844] Serialized 26 byte log entry
0709 13:19:10.514631 (+ 59491us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:10.515245 (+   614us) log.cc:844] Serialized 14 byte log entry
0709 13:19:10.540741 (+ 25496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.216940 (+676199us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b54002ebb54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:11.217009 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.217064 (+    55us) raft_consensus.cc:1685] finished
0709 13:19:11.217083 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.217239 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25467,"prepare.queue_time_us":156,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":68442,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":65342,"spinlock_wait_cycles":109114496,"thread_start_us":48799,"threads_started":1,"wal-append.queue_time_us":335593}
I20260709 13:19:11.214514 16959 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:11.196780 18542 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:11.182514 18364 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.224399 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:11.224457 16881 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:11.234244 16953 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:11.203243 18747 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.224186 16803 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:19:11.245309 18575 consensus_queue.cc:260] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.209347 18704 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:11.209470 18425 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:11.221364 18718 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.215873 18258 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.257036 16802 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.005s	sys 0.035s
W20260709 13:19:11.254359 18799 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:11.246443 18575 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:11.258453 16802 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.006s	sys 0.035s
W20260709 13:19:11.260293 16801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.001s	sys 0.044s
W20260709 13:19:11.261757 16801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.002s	sys 0.044s
I20260709 13:19:11.262990 16880 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:11.259807 18754 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:11.256556 18425 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.259991 18258 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.258353 18704 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.258633 18718 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.275784 18542 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.261723 18622 consensus_queue.cc:260] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.276649 18775 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.280659 16878 raft_consensus.cc:1240] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:19:11.282431 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:11.283425 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:11.284224 16878 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:11.284785 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:11.285701 17524 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:19:11.293915 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.297659 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:11.298415 16885 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:11.305531 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.307307 16885 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:11.309309 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:11.310604 16876 raft_consensus.cc:2410] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:11.309502 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:11.313470 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:11.317473 17527 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:11.314530 17492 leader_election.cc:400] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3.
I20260709 13:19:11.316213 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:11.318629 17492 leader_election.cc:400] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:11.318379 16883 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:19:11.316108 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:11.295993 18542 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:11.317024 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:11.297358 18622 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:11.281559 18737 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:11.320225 18588 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.328621 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:11.330061 18804 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:11.331146 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:11.320953 18811 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.332185 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 82382.2us
I20260709 13:19:11.338820 18258 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:11.339346 18258 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:11.339808 18258 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.341738 18717 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:11.341951 18718 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:11.342546 18718 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:11.342343 18717 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.343006 18718 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:11.344146 18810 log.cc:927] Time spent T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:11.344084 17523 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:11.344897 18737 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.423748 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:11.424356 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:11.424427 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 76954.3us
I20260709 13:19:11.423985 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:11.426608 16952 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:19:11.426541 16956 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:11.427115 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:11.328030 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:11.448836 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:11.452061 16957 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.452478 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:11.453265 16959 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:11.450414 16950 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:11.454154 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:11.344373 18717 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:11.447144 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.460824 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:11.462899 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:11.346263 18754 consensus_queue.cc:1059] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:19:11.446938 18620 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:11.467628 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:11.346421 18811 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.486112 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:11.486483 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.487205 16959 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:11.489251 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:11.493939 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:11.454888 18805 consensus_queue.cc:1059] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:19:11.494964 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 75164.8us
I20260709 13:19:11.496295 16924 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:11.496140 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:11.468402 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:11.469658 18812 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:11.485265 18620 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:11.500072 16959 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:11.500803 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:11.511448 17527 raft_consensus.cc:2393] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 2: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:11.491104 18258 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:11.529672 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:11.535113 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:11.507596 18747 raft_consensus.cc:3055] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:11.541502 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:11.506321 18753 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:11.527846 18806 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:19:11.530049 16957 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:11.549321 18754 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:11.527064 18620 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:11.526153 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:11.559239 18700 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:11.532368 18755 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:19:11.542836 18258 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:11.542415 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:11.543718 18822 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:11.544484 18425 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.544308 18747 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:11.562027 18754 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.567734 18700 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:11.594399 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 126821us
I20260709 13:19:11.595259 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:11.596473 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:11.581570 17523 raft_consensus.cc:2368] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:11.610386 18830 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:11.598874 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:11.610901 18830 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.611212 17519 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:11.612859 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:11.614365 18824 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:19:11.614379 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:11.617810 18821 log.cc:927] Time spent T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:19:11.621011 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.580019 18718 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:11.607007 18700 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.581395 18258 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:11.652333 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.591609 18822 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.635929 18830 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:11.609570 18754 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.628314 18747 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:11.660596 18819 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:19:11.660707 18747 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:11.662204 18817 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:11.663285 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1175) took 1029 ms. Trace:
I20260709 13:19:11.659586 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:11.665890 17523 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:11.666741 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:11.667462 18754 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.668474 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:11.669180 18822 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.669675 16953 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:11.672276 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:11.673070 17518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44636 (request call id 608) took 1046 ms. Trace:
I20260709 13:19:11.673406 17518 rpcz_store.cc:276] 0709 13:19:10.626816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.628528 (+  1712us) service_pool.cc:224] Handling call
0709 13:19:11.672159 (+1043631us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b5800011198. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71eee 0000000000375939 00007feef3fe51e0 00007feef40ae0c4 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:11.673013 (+   854us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9128192}
I20260709 13:19:11.652069 18812 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:11.676710 17518 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:19:11.677423 16951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 1598) took 1313 ms (client timeout 1617 ms). Trace:
I20260709 13:19:11.677048 18812 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:11.677788 16951 rpcz_store.cc:269] 0709 13:19:10.363591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.363762 (+   171us) service_pool.cc:224] Handling call
0709 13:19:11.677263 (+1313501us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b54002e2cd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:11.677372 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150705536}
W20260709 13:19:11.678460 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.678781 16959 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:11.666916 17522 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:11.681182 18258 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.663625 16804 rpcz_store.cc:276] 0709 13:19:10.634036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.639472 (+  5436us) service_pool.cc:224] Handling call
0709 13:19:10.639974 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.209781 (+569807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.209812 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.215702 (+  5890us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.420263 (+204561us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:11.420317 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.420390 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.663063 (+242673us) raft_consensus.cc:1685] finished
0709 13:19:11.663086 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.663230 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1367,"raft.queue_time_us":68962,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":5697,"thread_start_us":737085,"threads_started":2,"wal-append.queue_time_us":259120}
I20260709 13:19:11.695899 18832 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:11.696180 18712 raft_consensus.cc:3055] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:11.696527 18832 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.696687 18712 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:11.697098 18832 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.697590 18712 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.700404 18747 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:11.700256 18754 consensus_queue.cc:1059] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:11.704022 18754 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:11.700734 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:11.655421 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 125832us
I20260709 13:19:11.703394 18747 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.708906 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:11.719436 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:11.723220 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 126805us
I20260709 13:19:11.726011 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:11.723528 18747 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:11.708630 18811 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.735625 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:11.704607 18754 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.754528 16804 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:11.723719 18712 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:11.727824 18484 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:11.727205 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:11.765501 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:11.752826 17519 raft_consensus.cc:2410] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:19:11.728942 18258 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:11.727715 18755 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:11.731014 18425 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:11.731230 18683 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.731135 18830 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:11.753535 18707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.453s	user 0.008s	sys 0.021s
I20260709 13:19:11.735868 18837 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.764659 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44636 (request call id 607) took 1138 ms. Trace:
I20260709 13:19:11.763944 18811 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:11.783224 18755 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.786233 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:11.778826 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 50455us
I20260709 13:19:11.790611 18837 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.780663 18258 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.790611 18838 raft_consensus.cc:3055] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:11.792150 17521 rpcz_store.cc:276] 0709 13:19:10.626623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.628951 (+  2328us) service_pool.cc:224] Handling call
0709 13:19:11.700570 (+1071619us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b5800011198. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:11.755867 (+ 55297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6088960}
I20260709 13:19:11.799281 16801 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.807337 16955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34330 (request call id 1599) took 1443 ms. Trace:
I20260709 13:19:11.779656 18836 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:11.802157 18794 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:11.802956 18841 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:11.803323 18755 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:11.803722 18258 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:11.805065 18837 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:11.842386 18820 log.cc:927] Time spent T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:19:11.805279 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 1496) took 1479 ms. Trace:
I20260709 13:19:11.843847 16809 rpcz_store.cc:276] 0709 13:19:10.326062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.326254 (+   192us) service_pool.cc:224] Handling call
0709 13:19:11.805075 (+1478821us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54000d89d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:11.805212 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065458560}
I20260709 13:19:11.845310 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1641) took 1096 ms. Trace:
I20260709 13:19:11.845366 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:11.845844 16954 rpcz_store.cc:276] 0709 13:19:10.749063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.749448 (+   385us) service_pool.cc:224] Handling call
0709 13:19:10.749832 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.916795 (+166963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.916839 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.916891 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:10.916931 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.845084 (+928153us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54002e45d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:11.845129 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.845258 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383463168}
I20260709 13:19:11.846936 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:11.788221 18707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.487s	user 0.008s	sys 0.022s
I20260709 13:19:11.779234 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:11.844415 18826 log.cc:927] Time spent T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260709 13:19:11.799552 18764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.234s	user 0.007s	sys 0.010s
I20260709 13:19:11.805495 18838 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:11.786816 18425 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.789942 18683 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.860682 18644 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.861248 18754 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:11.863335 18542 consensus_meta.cc:287] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.537s	user 0.003s	sys 0.007s
I20260709 13:19:11.807753 18811 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.863730 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:11.864506 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44636 (request call id 610) took 1184 ms. Trace:
I20260709 13:19:11.864814 17525 rpcz_store.cc:276] 0709 13:19:10.680337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.680598 (+   261us) service_pool.cc:224] Handling call
0709 13:19:11.863559 (+1182961us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800011198. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:11.864448 (+   889us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3616128}
I20260709 13:19:11.865351 18811 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.866503 18620 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.867843 18794 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:11.868181 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:11.869882 18546 consensus_meta.cc:287] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.792s	user 0.008s	sys 0.001s
I20260709 13:19:11.873790 16801 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:11.875809 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:11.876964 16809 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
W20260709 13:19:11.890885 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.872413 18704 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.867076 18747 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:11.798516 18830 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.807904 18700 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:11.831537 18836 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:11.966675 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:12.000128 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.172614 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 407149us
W20260709 13:19:11.854976 18764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.007s	sys 0.010s
W20260709 13:19:12.073724 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.188143 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:12.039937 16756 auto_rebalancer.cc:629] Failed to schedule move for tablet f4f36dd72a75406881b100b0ebbaeaff: Illegal state: Replica 4b60b701acc7473e87e3e529a2a34689 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
W20260709 13:19:12.101577 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.180883 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.970048 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:11.930740 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.155241 18503 consensus_meta.cc:287] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 1.127s	user 0.006s	sys 0.006s
I20260709 13:19:12.197889 16809 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:12.201277 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:12.193223 18812 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:12.082402 18258 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.203655 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:12.188764 18456 tablet_bootstrap.cc:492] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
W20260709 13:19:12.205264 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.180565 18575 consensus_meta.cc:287] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.917s	user 0.011s	sys 0.000s
I20260709 13:19:12.203111 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:12.215098 16879 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:12.208304 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:12.041138 18811 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:12.179049 18836 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:11.859431 16803 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:12.211123 16878 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:12.204373 16848 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:11.929492 18707 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:12.040335 18704 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:12.036078 18620 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:11.807750 16955 rpcz_store.cc:276] 0709 13:19:10.363902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.364023 (+   121us) service_pool.cc:224] Handling call
0709 13:19:11.806695 (+1442672us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b5800004298. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71eee 0000000000375939 00007feef3fe51e0 00007feef40ae0c4 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:11.806850 (+   155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.807026 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.807052 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.807092 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:11.807125 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.807181 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.807284 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8803712}
I20260709 13:19:12.187844 18834 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.965871 18530 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:12.213589 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.218415 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:12.193773 18644 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:12.211369 18622 consensus_meta.cc:287] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.873s	user 0.002s	sys 0.008s
I20260709 13:19:12.211599 18503 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:12.226209 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.229100 16878 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:12.230551 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:12.231772 16877 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:12.232460 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:12.277704 16880 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:12.233218 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:12.238077 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.254778 18542 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:12.279474 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.205500 18845 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:12.242467 16958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34330 (request call id 1596) took 1880 ms. Trace:
I20260709 13:19:12.243222 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:12.282877 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 90824.4us
I20260709 13:19:12.246229 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.284732 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.285998 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.246805 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:12.254812 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.255630 16808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 1493) took 1930 ms. Trace:
I20260709 13:19:12.288064 16879 raft_consensus.cc:2410] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:12.259004 16801 raft_consensus.cc:1240] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:12.287981 16808 rpcz_store.cc:276] 0709 13:19:10.325130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.325290 (+   160us) service_pool.cc:224] Handling call
0709 13:19:12.255386 (+1930096us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b540011add4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:12.255561 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075334912}
I20260709 13:19:12.211884 18812 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.221544 18764 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.266935 16809 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:12.266702 18530 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.267179 18425 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.268467 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:12.263729 18832 consensus_meta.cc:287] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
I20260709 13:19:12.239240 18837 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.214043 18258 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:12.240761 18836 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:12.257588 18704 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.287182 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.283020 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:12.083652 18838 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:12.254997 18702 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:12.264969 18834 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:12.327194 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 79394.6us
I20260709 13:19:12.221446 18811 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.331143 16884 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:12.282491 16958 rpcz_store.cc:276] 0709 13:19:10.362453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.362594 (+   141us) service_pool.cc:224] Handling call
0709 13:19:10.760271 (+397677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.770011 (+  9740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.242299 (+1472288us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54002085d0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:12.242416 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913782528}
I20260709 13:19:12.245352 18707 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.269281 18847 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:12.277356 18484 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:12.317142 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.293386 18542 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:12.320298 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 57941.4us
I20260709 13:19:12.322744 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:12.282361 18845 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.325103 16883 raft_consensus.cc:2410] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:12.293531 18622 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:12.305373 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.328941 16922 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:12.329296 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:12.312209 16803 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:12.335484 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.276196 18644 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.314658 18546 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:12.344739 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.290606 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.330394 18794 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:12.351064 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:12.349869 16848 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:12.333133 18683 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.308202 18764 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.332321 18702 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.331990 18747 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.367591 16953 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:12.372455 16958 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:12.319448 18837 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:12.324648 18836 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.317113 18832 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:12.405786 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.378932 16956 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:12.378953 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 50276.6us
I20260709 13:19:12.413195 16922 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:12.415997 16958 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:19:12.418875 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 67880.5us
I20260709 13:19:12.374770 16951 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:19:12.419646 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:12.422772 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 54943us
W20260709 13:19:12.361115 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 130661us
I20260709 13:19:12.347628 18853 consensus_queue.cc:1059] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:19:12.424232 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:12.427032 16958 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:19:12.359179 18620 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:12.428471 16958 pending_rounds.cc:85] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 1
W20260709 13:19:12.426941 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 77176.1us
I20260709 13:19:12.352404 18484 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:12.436275 16958 pending_rounds.cc:107] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:19:12.438529 16958 raft_consensus.cc:2889] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.439201 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:12.440132 16877 raft_consensus.cc:2410] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:19:12.441036 16775 connection.cc:256] RPC call timeout handler was delayed by -1.0779105529998105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
I20260709 13:19:12.362741 18847 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:12.363631 18622 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.444263 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:12.398450 18830 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.444337 16922 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:12.385998 18700 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:12.410490 18794 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:12.355557 18845 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:12.447561 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:12.436393 18620 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.458644 16880 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:12.437829 18754 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:12.396916 18618 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:12.441512 18805 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:12.429701 18868 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:12.462607 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:12.450013 18854 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:12.378172 18546 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:12.461706 18830 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:12.367702 18425 consensus_queue.cc:1059] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:19:12.456573 18794 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:12.448704 18865 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:12.474888 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:12.486459 16881 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:12.472143 18852 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:19:12.462666 18620 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:12.488977 18849 log.cc:927] Time spent T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:19:12.470561 18805 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:12.492549 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1165) took 1862 ms. Trace:
I20260709 13:19:12.495126 16802 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:12.503778 18868 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:12.504941 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 60671.6us
W20260709 13:19:12.490454 18862 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:19:12.486047 18712 consensus_meta.cc:287] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.721s	user 0.010s	sys 0.000s
I20260709 13:19:12.511566 16806 rpcz_store.cc:276] 0709 13:19:10.630572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.630721 (+   149us) service_pool.cc:224] Handling call
0709 13:19:10.681055 (+ 50334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.729519 (+ 48464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.729560 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.730099 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.172374 (+442275us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:11.172430 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.492050 (+1319620us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b54000d93d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:12.492136 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:12.492199 (+    63us) raft_consensus.cc:1685] finished
0709 13:19:12.492219 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:12.492479 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1880,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":1748,"spinlock_wait_cycles":110625536,"thread_start_us":441941,"threads_started":1,"wal-append.queue_time_us":520871,"wal-append.run_cpu_time_us":2198,"wal-append.run_wall_time_us":1092448}
W20260709 13:19:12.476884 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 52764.1us
I20260709 13:19:12.471530 18754 raft_consensus.cc:697] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:12.477413 18854 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.522322 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.485596 18530 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.522975 16952 raft_consensus.cc:1240] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:19:12.527623 16953 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:12.533754 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.536837 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.537523 16959 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:12.539788 16881 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:12.541778 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:12.516664 18805 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:12.504710 18503 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:12.544672 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 125109us
I20260709 13:19:12.544689 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.549588 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:12.573513 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:12.530870 18854 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:12.581282 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:12.581831 16802 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:12.523876 18704 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.523734 18847 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:19:12.576465 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 132053us
I20260709 13:19:12.577585 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:12.586313 17524 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:12.524319 18700 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:19:12.579780 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:12.540740 18618 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:12.505106 18865 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.570138 18542 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.586251 16775 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:12.578967 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:12.581054 18755 consensus_meta.cc:287] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.000s
W20260709 13:19:12.609591 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.593804 16806 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:12.570784 18707 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.587586 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:12.595827 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:12.596741 18622 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.609864 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:12.597236 18710 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.618685 18710 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:12.620153 18874 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:12.620644 18874 raft_consensus.cc:697] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:12.621511 18874 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:12.582559 18834 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:12.600680 18837 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:12.603160 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:12.609201 17527 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:12.624729 16884 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:12.625288 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:12.625523 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:12.626080 17527 raft_consensus.cc:2368] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:12.627022 18837 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.627548 18837 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:12.630913 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 101371us
I20260709 13:19:12.631717 16922 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:12.630841 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 139255us
I20260709 13:19:12.632671 18834 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:12.629928 18837 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.634727 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:12.637298 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:12.654129 16959 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:12.655365 17524 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:12.656379 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:12.661855 16959 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:12.637641 16922 leader_election.cc:400] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:12.663368 16922 leader_election.cc:403] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:19:12.592312 18644 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:12.684027 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 78851.2us
I20260709 13:19:12.601612 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:12.587033 18747 consensus_queue.cc:1059] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:19:12.574640 18858 consensus_queue.cc:1059] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:19:12.607858 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:12.595821 18851 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:12.660375 18503 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:12.692459 18588 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:19:12.692703 18836 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.666376 18755 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.712138 18484 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:12.716074 18542 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:19:12.696298 18622 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:19:12.735697 18775 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:12.738214 18503 raft_consensus.cc:697] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:12.769547 16805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1169) took 2137 ms. Trace:
I20260709 13:19:12.713711 18644 consensus_queue.cc:1059] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:19:12.736225 18851 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:12.766148 18710 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:12.736912 18867 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
W20260709 13:19:12.764180 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.783917 16802 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:12.785018 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:12.774574 18546 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:12.779772 18879 log.cc:927] Time spent T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:19:12.798234 16954 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:12.591339 18847 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.724248 18794 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:12.793138 16882 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:12.776432 18832 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.716764 18754 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:12.800262 18622 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:12.813602 18546 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:12.809624 16876 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:12.816118 18873 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:19:12.806986 18588 raft_consensus.cc:3055] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:12.795629 18775 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:12.810964 18841 consensus_meta.cc:287] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.964s	user 0.011s	sys 0.000s
I20260709 13:19:12.764932 18877 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:19:12.833674 16848 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:12.835830 18876 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:12.836210 18876 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:12.836556 18876 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:12.803826 18710 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.840890 18755 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:12.842772 17521 raft_consensus.cc:2393] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:12.825546 18622 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:12.826037 18546 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.792814 16805 rpcz_store.cc:276] 0709 13:19:10.632296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.635149 (+  2853us) service_pool.cc:224] Handling call
0709 13:19:10.689924 (+ 54775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.910655 (+220731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:12.769224 (+1858569us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b54001a8454. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:12.769470 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190495616}
I20260709 13:19:12.849293 18737 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.832357 18588 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:12.837841 18841 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:12.856598 18546 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:12.854836 18707 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.876986 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:12.879051 16882 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:12.880124 18851 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:12.844743 18503 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:12.880378 16882 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:12.895833 18588 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:13.005894 16925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.009s	sys 0.015s
I20260709 13:19:13.229857 18837 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:12.988897 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.233043 16925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.012s	sys 0.018s
W20260709 13:19:13.104598 16922 leader_election.cc:336] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.566s (SENT)
W20260709 13:19:13.252010 17492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.012s	sys 0.007s
W20260709 13:19:13.279464 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.290840 18866 raft_consensus.cc:3055] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:13.291257 18644 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.291338 18866 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:19:13.292925 17492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.013s	sys 0.008s
W20260709 13:19:13.293303 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 658672us
W20260709 13:19:13.244271 16879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.005s	sys 0.011s
W20260709 13:19:13.297984 16879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.005s	sys 0.012s
W20260709 13:19:13.381472 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 276893us
I20260709 13:19:13.232568 18588 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.330868 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:12.945200 18542 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.405968 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1180) took 2753 ms. Trace:
W20260709 13:19:13.431566 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 100795us
I20260709 13:19:13.431253 16810 rpcz_store.cc:276] 0709 13:19:10.652187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.782128 (+129941us) service_pool.cc:224] Handling call
0709 13:19:10.816414 (+ 34286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.937145 (+120731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.405723 (+2468578us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540018a1d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:13.405908 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276039040}
I20260709 13:19:12.877102 18865 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:13.404150 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.437276 16775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.006s	sys 0.035s
I20260709 13:19:13.111266 18710 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:12.875375 18845 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:13.439769 16775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.006s	sys 0.035s
I20260709 13:19:13.073168 18794 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:13.433951 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:13.229218 18712 consensus_queue.cc:1059] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.206s
W20260709 13:19:13.445464 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 731273us
I20260709 13:19:13.327379 18837 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:12.893548 18622 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:13.450695 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.893229 18707 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:12.875249 18854 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.459184 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:13.459981 18854 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:13.432775 18775 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:13.460412 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:13.457934 17522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44648 (request call id 255) took 2155 ms (client timeout 1876 ms). Trace:
I20260709 13:19:13.461054 17521 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 1.
I20260709 13:19:13.291968 18644 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:13.436637 18542 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:13.455696 17518 raft_consensus.cc:2410] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:13.456261 18622 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.457912 18707 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:13.438102 18737 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:13.442276 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:13.461226 17522 rpcz_store.cc:269] 0709 13:19:11.302245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.497378 (+195133us) service_pool.cc:224] Handling call
0709 13:19:13.457727 (+1960349us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b540043bf54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:13.457870 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200234240}
I20260709 13:19:13.466409 18847 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.474782 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:13.473249 18898 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:13.446660 18866 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:13.516019 16805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.009s	sys 0.014s
I20260709 13:19:13.476737 18737 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:13.541253 16805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.010s	sys 0.014s
I20260709 13:19:13.535404 18898 raft_consensus.cc:697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:13.542423 18866 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:13.547304 18892 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:19:13.545562 17518 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 1. Current term is 2. Ops: []
W20260709 13:19:13.561794 16809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.000s	sys 0.034s
W20260709 13:19:13.566020 16809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.000s	sys 0.034s
I20260709 13:19:13.547513 18851 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:13.568143 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 161462us
I20260709 13:19:13.548409 18794 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.572618 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:13.553695 18751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.989s	user 0.006s	sys 0.038s
I20260709 13:19:13.573612 16950 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:13.567909 18774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.872s	user 0.014s	sys 0.022s
I20260709 13:19:13.579213 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:13.584756 16950 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
W20260709 13:19:13.589242 17492 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 2.169s (SENT) [suppressed 23 similar messages]
W20260709 13:19:13.590363 18830 consensus_meta.cc:287] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 1.109s	user 0.011s	sys 0.001s
W20260709 13:19:13.580111 18774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.975s	user 0.015s	sys 0.022s
W20260709 13:19:13.578243 18751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.013s	user 0.006s	sys 0.039s
I20260709 13:19:13.567657 17523 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
W20260709 13:19:13.591750 18897 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:19:13.573237 18851 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.578873 18794 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.603598 18830 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:13.618324 18893 log.cc:927] Time spent T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:19:13.612275 18644 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.618395 18837 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.625110 18774 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:19:13.638362 18890 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
I20260709 13:19:13.625983 18898 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.644889 18832 raft_consensus.cc:3055] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:19:13.638291 18816 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 2.018s	user 0.010s	sys 0.013s
W20260709 13:19:13.648003 18899 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:19:13.649626 18805 consensus_meta.cc:287] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 1.064s	user 0.006s	sys 0.006s
I20260709 13:19:13.650035 18805 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.650864 18812 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.651588 18845 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.653795 18805 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:13.646724 18832 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:13.655710 18811 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:13.656908 18876 consensus_meta.cc:287] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.820s	user 0.008s	sys 0.004s
I20260709 13:19:13.656533 18832 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.657301 18876 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:13.628818 18620 consensus_meta.cc:287] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 1.112s	user 0.007s	sys 0.004s
I20260709 13:19:13.619509 18542 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.645388 18774 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.764631 18794 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.661080 18851 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.779496 18620 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.781025 18876 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:13.777262 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.781746 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.739835 18737 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.704154 17525 raft_consensus.cc:2410] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:19:13.688586 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.689019 16802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.008s	sys 0.032s
I20260709 13:19:13.746192 16775 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:13.699223 17522 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:13.697875 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1159) took 1260 ms. Trace:
I20260709 13:19:13.725466 17518 raft_consensus.cc:1240] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:13.790541 17527 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:13.792744 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.794056 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.795010 18644 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:13.796392 16804 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 206) took 2012 ms (client timeout 2169 ms). Trace:
W20260709 13:19:13.797073 16883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 1527) took 1567 ms (client timeout 1715 ms). Trace:
I20260709 13:19:13.795938 18644 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:13.797595 16883 rpcz_store.cc:269] 0709 13:19:12.229836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.232968 (+  3132us) service_pool.cc:224] Handling call
0709 13:19:13.796630 (+1563662us) spinlock_profiling.cc:243] Waited 46.2 ms on lock 0x7b5400134a54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:13.796884 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106302336}
I20260709 13:19:13.798811 18503 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.795998 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1189) took 1961 ms. Trace:
I20260709 13:19:13.729487 18706 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.804101 16952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 136) took 2358 ms. Trace:
W20260709 13:19:13.796829 16804 rpcz_store.cc:269] 0709 13:19:11.776105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.776390 (+   285us) service_pool.cc:224] Handling call
0709 13:19:13.781327 (+2004937us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b58001d0498. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:13.788787 (+  7460us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4026624}
W20260709 13:19:13.557186 16803 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.020s	sys 0.020s
I20260709 13:19:13.808109 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:13.808911 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 1603) took 1570 ms. Trace:
I20260709 13:19:13.810423 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:13.811709 18644 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.700918 16922 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:13.812831 17519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44648 (request call id 248) took 2515 ms (client timeout 2829 ms). Trace:
I20260709 13:19:13.813520 17524 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 13:19:13.814343 18546 consensus_meta.cc:287] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.920s	user 0.002s	sys 0.016s
W20260709 13:19:13.815076 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 69265.4us
I20260709 13:19:13.816072 18622 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:13.700192 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1195) took 1205 ms. Trace:
W20260709 13:19:13.818080 16802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.012s	sys 0.038s
W20260709 13:19:13.708408 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 119256us
I20260709 13:19:13.697556 16805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1194) took 1203 ms. Trace:
I20260709 13:19:13.818290 16952 rpcz_store.cc:276] 0709 13:19:11.445843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.446123 (+   280us) service_pool.cc:224] Handling call
0709 13:19:11.446472 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.528600 (+1082128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.803386 (+1274786us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003976d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:13.803840 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2474937216}
I20260709 13:19:13.824942 18706 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:13.825814 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 125375us
W20260709 13:19:13.823575 16803 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.025s	sys 0.030s
I20260709 13:19:13.824005 16810 rpcz_store.cc:276] 0709 13:19:12.494114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.436796 (+942682us) service_pool.cc:224] Handling call
0709 13:19:13.447316 (+ 10520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.447557 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:13.464581 (+ 17024us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.699390 (+234809us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.699495 (+   105us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:13.699615 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.699768 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.699997 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19796,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":13129,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":329,"thread_start_us":232922,"threads_started":1,"wal-append.queue_time_us":163495}
I20260709 13:19:13.824949 18546 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:13.821686 17519 rpcz_store.cc:269] 0709 13:19:11.297853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.614054 (+316201us) service_pool.cc:224] Handling call
0709 13:19:13.812278 (+2198224us) spinlock_profiling.cc:243] Waited 65.9 ms on lock 0x7b5400158954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:13.812567 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151605504}
I20260709 13:19:13.821887 17524 pending_rounds.cc:85] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 4
I20260709 13:19:13.827023 18364 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:13.830322 18895 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:19:13.831215 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.831919 18546 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.833279 18706 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:13.836238 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:13.823443 18503 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:13.838660 17526 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:13.849436 18546 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.841181 18258 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:13.819574 16954 rpcz_store.cc:276] 0709 13:19:12.237977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.254570 (+ 16593us) service_pool.cc:224] Handling call
0709 13:19:13.808408 (+1553838us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b540032b4d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:13.808643 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166360960}
I20260709 13:19:13.846670 18895 raft_consensus.cc:697] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:13.850309 18546 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.829427 17524 pending_rounds.cc:107] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:19:13.852154 17524 raft_consensus.cc:2889] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.853413 16957 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:13.853820 18503 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.853943 16957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 1608) took 1560 ms. Trace:
I20260709 13:19:13.854431 16957 rpcz_store.cc:276] 0709 13:19:12.293654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.298917 (+  5263us) service_pool.cc:224] Handling call
0709 13:19:13.809912 (+1510995us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b5800004298. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:13.853881 (+ 43969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16845056}
I20260709 13:19:13.855034 18764 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:13.856441 16922 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:13.861418 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:13.861447 18718 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:13.823936 18622 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:13.865227 18718 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:13.872247 18833 raft_consensus.cc:3055] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:13.874502 18833 raft_consensus.cc:740] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:13.876294 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.877862 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.866540 18620 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:13.880915 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.869221 18622 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:13.885927 18901 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:13.887187 16810 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:13.868816 18718 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:13.862552 18895 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.885176 18838 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.887228 18853 raft_consensus.cc:3055] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:13.887499 18546 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.789554 16879 rpcz_store.cc:276] 0709 13:19:12.437295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.437522 (+   227us) service_pool.cc:224] Handling call
0709 13:19:12.437839 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.438028 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:12.447891 (+  9863us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.696993 (+1249102us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.697135 (+   142us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:13.697268 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.697386 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.697596 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131809,"prepare.queue_time_us":26324,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":3775,"raft.queue_time_us":162287,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":68,"thread_start_us":1158906,"threads_started":2,"wal-append.queue_time_us":1090708}
I20260709 13:19:13.886744 18901 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.818117 16809 rpcz_store.cc:276] 0709 13:19:11.833581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.306160 (+472579us) service_pool.cc:224] Handling call
0709 13:19:12.317679 (+ 11519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.438367 (+120688us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:12.798839 (+360472us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.566471 (+767632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.566521 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:13.566560 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.795015 (+228455us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540011a3d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:13.795079 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.795379 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11621,"prepare.queue_time_us":93352,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":81,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":2651,"spinlock_wait_cycles":276930944,"thread_start_us":1099519,"threads_started":2,"wal-append.queue_time_us":811555}
I20260709 13:19:13.897434 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:13.898257 16876 consensus_meta.cc:287] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 1.069s	user 0.004s	sys 0.015s
I20260709 13:19:13.877513 18833 consensus_queue.cc:260] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.899161 16876 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:19:13.899240 18833 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.900038 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.900813 16804 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:13.901664 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.902884 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.898351 16809 raft_consensus.cc:2393] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:13.904099 16804 raft_consensus.cc:2410] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:13.904206 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1180) took 1115 ms. Trace:
I20260709 13:19:13.905515 16876 rpcz_store.cc:276] 0709 13:19:12.784651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.784753 (+   102us) service_pool.cc:224] Handling call
0709 13:19:13.899617 (+1114864us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:13.907357 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 84153.1us
I20260709 13:19:13.907620 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:13.908499 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:13.909444 18503 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:13.909945 18856 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 1.586s	user 0.003s	sys 0.010s
I20260709 13:19:13.827872 16805 rpcz_store.cc:276] 0709 13:19:12.493894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.874527 (+380633us) service_pool.cc:224] Handling call
0709 13:19:12.913408 (+ 38881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.920324 (+  6916us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:12.920712 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.564547 (+643835us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.569178 (+  4631us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:13.696615 (+127437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.696905 (+   290us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.697311 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":718,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":2897,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":5146,"thread_start_us":627606,"threads_started":1,"wal-append.queue_time_us":684129}
I20260709 13:19:13.913573 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.915710 16810 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:13.916441 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:13.916764 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.895222 18853 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:13.917402 18503 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:13.930560 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.931517 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1179) took 1173 ms. Trace:
I20260709 13:19:13.931960 16881 rpcz_store.cc:276] 0709 13:19:12.757713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.758146 (+   433us) service_pool.cc:224] Handling call
0709 13:19:13.930334 (+1172188us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b580013ef98. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:13.930674 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.931002 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.931026 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.931084 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:13.931134 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.931184 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.931308 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9094528}
I20260709 13:19:13.932173 16805 raft_consensus.cc:2410] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:13.936317 18774 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:13.921896 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:13.928175 18889 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.416s	user 0.003s	sys 0.000s
I20260709 13:19:13.940986 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.940271 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1173) took 1428 ms. Trace:
I20260709 13:19:13.937971 16802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1193) took 1444 ms. Trace:
I20260709 13:19:13.937028 18855 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.939980 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.942188 16884 rpcz_store.cc:276] 0709 13:19:12.511882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.626428 (+114546us) service_pool.cc:224] Handling call
0709 13:19:13.806804 (+1180376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.807332 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.807364 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.807430 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:13.807463 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.807545 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.940001 (+132456us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400134a50. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:13.940097 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2697513728}
I20260709 13:19:13.945662 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:13.946448 16952 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:13.946975 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:13.945104 16810 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
W20260709 13:19:13.950688 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.953097 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:13.954051 16957 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:13.953078 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.958002 18503 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:13.956112 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:13.958470 18503 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.966415 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:13.966933 18503 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:13.967305 16954 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:13.942447 16802 rpcz_store.cc:276] 0709 13:19:12.493647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.805669 (+312022us) service_pool.cc:224] Handling call
0709 13:19:12.806035 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.806271 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:12.818577 (+ 12306us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.865852 (+1047275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.878824 (+ 12972us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:13.891951 (+ 13127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.895748 (+  3797us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.937914 (+ 42166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17588,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":380,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":164,"thread_start_us":1005901,"threads_started":1,"wal-append.queue_time_us":807211}
I20260709 13:19:13.971946 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.936713 18853 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.951391 18774 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:13.972177 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.974485 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:13.947459 18855 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:13.981992 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.973069 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:13.986927 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:13.987946 16880 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:13.988579 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1178) took 1263 ms. Trace:
I20260709 13:19:13.988906 16880 rpcz_store.cc:276] 0709 13:19:12.725366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.726390 (+  1024us) service_pool.cc:224] Handling call
0709 13:19:13.986568 (+1260178us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b580013ef98. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:13.988515 (+  1947us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13518080}
I20260709 13:19:13.991118 18707 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:13.958392 16803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1191) took 2107 ms. Trace:
I20260709 13:19:13.995971 16952 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:13.996884 18707 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:13.996439 18855 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:14.001484 18707 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:14.001715 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 263) took 1419 ms. Trace:
I20260709 13:19:14.002101 18707 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.002161 17524 rpcz_store.cc:276] 0709 13:19:12.582360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.657168 (+ 74808us) service_pool.cc:224] Handling call
0709 13:19:13.812569 (+1155401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.852812 (+ 40243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.001448 (+148636us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400158950. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:14.001638 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2656194944}
I20260709 13:19:13.997131 18542 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:14.003994 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:14.005271 18811 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:19:14.008589 18872 log.cc:927] Time spent T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 1.498s	user 0.013s	sys 0.008s
I20260709 13:19:14.008665 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:14.009774 18811 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:14.010215 18811 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.010581 18811 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.015759 18456 tablet_bootstrap.cc:492] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:19:14.017356 18456 tablet_bootstrap.cc:492] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:19:14.017171 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:14.018618 18456 ts_tablet_manager.cc:1403] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 1.944s	user 0.019s	sys 0.021s
I20260709 13:19:14.002933 18707 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.023916 16810 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:14.026224 18774 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.023077 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:14.023309 16924 connection.cc:256] RPC call timeout handler was delayed by -1.2315280159998565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23660000000000003s for a response
I20260709 13:19:14.026947 16808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1190) took 2178 ms. Trace:
I20260709 13:19:14.029647 18901 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:14.030165 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.030489 18600 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:14.032469 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.032187 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:14.034479 16804 raft_consensus.cc:2410] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:14.033062 16880 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:14.037142 16957 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:14.036413 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:14.029148 16808 rpcz_store.cc:276] 0709 13:19:11.848835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.304950 (+456115us) service_pool.cc:224] Handling call
0709 13:19:12.305206 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:12.305477 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.305498 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:12.305913 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:19:12.438239 (+132326us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:14.007617 (+1569378us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:14.008100 (+   483us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b1800345880. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeeec3e4bc 00007feeebf8c48b 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa6455 00007feef2a8e3c7 00007feeef0a09a7 00007feeef0b00bf
0709 13:19:14.008278 (+   178us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.026458 (+ 18180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.026567 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.026607 (+    40us) raft_consensus.cc:1685] finished
0709 13:19:14.026622 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.026782 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17311,"prepare.queue_time_us":93216,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":71045,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":13360,"spinlock_wait_cycles":21355520,"thread_start_us":191373,"threads_started":2,"wal-append.queue_time_us":133717}
I20260709 13:19:14.040591 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.041020 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.042253 17519 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.042397 18847 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:14.042995 18847 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:14.044366 16808 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:14.044306 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.045197 16881 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:19:14.045182 18847 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:14.048213 16879 raft_consensus.cc:2410] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:19:14.043212 18774 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:14.056185 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:14.058013 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 88204.7us
I20260709 13:19:14.060882 18618 raft_consensus.cc:3055] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:14.061362 18618 raft_consensus.cc:740] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:14.062638 18618 consensus_queue.cc:260] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.055930 18901 consensus_queue.cc:1059] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:19:14.064597 18901 raft_consensus.cc:3055] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:14.064947 18901 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:14.065939 18901 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.067304 18901 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.067533 16954 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:14.068140 16807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1181) took 3383 ms. Trace:
W20260709 13:19:14.068395 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.068696 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:14.068588 16807 rpcz_store.cc:276] 0709 13:19:10.685490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.246347 (+560857us) service_pool.cc:224] Handling call
0709 13:19:13.404858 (+2158511us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b58001d0498. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71eee 0000000000375939 00007feef3fe51e0 00007feef40ae0c4 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:13.405048 (+   190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.698343 (+293295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.698397 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.790817 (+ 92420us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.865261 (+ 74444us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:13.865317 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.875399 (+ 10082us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.059387 (+183988us) raft_consensus.cc:1685] finished
0709 13:19:14.059409 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.067916 (+  8507us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15849,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":15352,"spinlock_wait_cycles":3371008,"thread_start_us":342999,"threads_started":2,"wal-append.queue_time_us":146402}
I20260709 13:19:14.072139 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:14.070640 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:14.073356 18618 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.073504 16878 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.074235 18811 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.074681 18702 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:14.057677 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 208) took 2270 ms. Trace:
I20260709 13:19:14.072817 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.072911 16885 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.075313 16801 rpcz_store.cc:276] 0709 13:19:11.787298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.192470 (+405172us) service_pool.cc:224] Handling call
0709 13:19:12.258775 (+ 66305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.288711 (+ 29936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.057328 (+1768617us) spinlock_profiling.cc:243] Waited 65.9 ms on lock 0x7b540011add0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:14.057526 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151575424}
I20260709 13:19:14.084090 16883 raft_consensus.cc:2368] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:14.092629 16884 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:14.098610 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.099910 16879 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:14.103253 16954 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:19:13.995906 16803 rpcz_store.cc:276] 0709 13:19:11.851149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.403307 (+552158us) service_pool.cc:224] Handling call
0709 13:19:12.422450 (+ 19143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.437795 (+ 15345us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:13.830476 (+1392681us) log.cc:844] Serialized 14 byte log entry
0709 13:19:13.904201 (+ 73725us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:13.941778 (+ 37577us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:13.957924 (+ 16146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.958088 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:13.958316 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21223,"prepare.queue_time_us":86817,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":3428,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":1740,"thread_start_us":1381667,"threads_started":2,"wal-append.queue_time_us":125888}
I20260709 13:19:14.110592 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:14.110872 18924 log.cc:927] Time spent T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:14.111333 16803 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:14.113996 17523 raft_consensus.cc:1240] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:14.114894 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.055639 18503 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:14.116461 18928 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:14.116976 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.118495 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.119951 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 614) took 3191 ms. Trace:
I20260709 13:19:14.094926 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:14.132934 17526 rpcz_store.cc:276] 0709 13:19:10.928433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.928551 (+   118us) service_pool.cc:224] Handling call
0709 13:19:12.834398 (+1905847us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b5800011198. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:12.834580 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.838271 (+1003691us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540055ec20. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00ddc0 00007feeef0981c0 00007feeef099231 00007feeef095d8f 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c
0709 13:19:13.849669 (+ 11398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.096954 (+247285us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540055e954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:14.119872 (+ 22918us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968443136}
I20260709 13:19:14.154681 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.156388 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.150836 16807 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:14.183804 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:14.198583 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.093887 18622 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.203747 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:14.197710 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 89433us
I20260709 13:19:14.210543 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.211625 18456 raft_consensus.cc:359] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:14.212533 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1192) took 1719 ms. Trace:
I20260709 13:19:14.217149 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.219128 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:14.219710 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 160082us
I20260709 13:19:14.223491 16879 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:14.218077 16806 rpcz_store.cc:276] 0709 13:19:12.493348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.616583 (+123235us) service_pool.cc:224] Handling call
0709 13:19:12.616967 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:12.685631 (+ 68664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:12.685658 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:12.685697 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:12.685724 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.202376 (+1516652us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x7b5400267854. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:14.212068 (+  9692us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.212343 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157464832}
I20260709 13:19:14.231150 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:14.231268 16877 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:14.233824 16801 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 1.
W20260709 13:19:14.253005 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.231905 18811 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:14.258265 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.262732 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:14.262264 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.285633 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:14.286607 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 44988.5us
W20260709 13:19:14.273000 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.260800 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.296054 16878 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:14.235379 16805 raft_consensus.cc:2393] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:14.259756 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.348637 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.348790 18811 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.349181 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:14.349584 16806 raft_consensus.cc:2410] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:14.349411 18811 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:14.349833 16807 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:14.350472 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.350689 18853 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:14.351577 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:14.351501 18811 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:14.354444 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.355186 16810 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:14.358394 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:14.364065 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.364362 16806 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:14.364884 16810 raft_consensus.cc:2368] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:14.234974 18600 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.231946 18895 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:14.280243 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:14.283833 18707 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:14.322984 16885 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:14.324110 18622 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:14.329754 17522 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:14.330794 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.331102 17519 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
W20260709 13:19:14.331619 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 56186.6us
I20260709 13:19:14.332166 18718 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.380551 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.381433 16802 raft_consensus.cc:2410] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:14.382197 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:14.382678 18718 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:14.383210 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.384624 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.385164 16885 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:14.385885 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.386451 16885 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:14.332325 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.387207 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.335107 16958 raft_consensus.cc:1240] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:19:14.387976 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:14.388521 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.388861 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.389197 16958 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:14.389526 16880 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:14.390125 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.390403 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.391052 16880 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:14.336882 17518 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:14.392190 16957 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:14.393304 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:14.394057 17518 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:14.394167 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.337273 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 260) took 1755 ms. Trace:
I20260709 13:19:14.395045 16957 raft_consensus.cc:2410] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:14.395249 17527 rpcz_store.cc:276] 0709 13:19:12.581633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.626511 (+ 44878us) service_pool.cc:224] Handling call
0709 13:19:12.626739 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:13.791124 (+1164385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.337017 (+545893us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54005d0a54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:14.337200 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2658663168}
I20260709 13:19:14.396181 17523 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:19:14.396005 18909 consensus_queue.cc:1059] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:14.396553 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:14.396934 18909 consensus_queue.cc:1243] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer 599f9a88b6cd4e818a1c59a0b4522480 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:14.397545 18909 consensus_queue.cc:1059] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:14.398102 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:14.398909 17523 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:14.399873 18841 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.400884 16959 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:14.329792 18717 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:19:14.400964 18600 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.388556 16879 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.403157 18600 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:14.339854 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.286118 18456 raft_consensus.cc:740] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:19:14.287264 16954 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:14.333048 18702 consensus_queue.cc:1059] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:14.277922 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.340842 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.341614 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44626 (request call id 536) took 1763 ms. Trace:
I20260709 13:19:14.342142 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.342604 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.343528 16956 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:19:14.345958 18832 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.406533 17525 rpcz_store.cc:276] 0709 13:19:12.577776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:12.579494 (+  1718us) service_pool.cc:224] Handling call
0709 13:19:14.341382 (+1761888us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001da454. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:14.341537 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2558804224}
I20260709 13:19:14.368304 16848 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:14.373181 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.286849 18503 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:14.369836 18901 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:14.375418 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:14.376730 16877 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:14.377609 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:14.379513 18927 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.466s	user 0.003s	sys 0.000s
I20260709 13:19:14.380143 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:14.387411 16809 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:14.413615 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.413895 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:14.414621 16809 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:14.414829 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.415592 16876 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:14.416429 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.416991 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1197) took 1922 ms. Trace:
I20260709 13:19:14.417136 16876 raft_consensus.cc:2410] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:14.400002 18588 raft_consensus.cc:3055] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:14.417867 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.418025 18588 raft_consensus.cc:740] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:14.418864 18588 consensus_queue.cc:260] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.400583 18841 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.276165 16803 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:14.284399 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.283799 18885 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:14.391297 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.399657 18909 raft_consensus.cc:3055] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:14.408480 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.417645 18702 consensus_queue.cc:1243] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer 599f9a88b6cd4e818a1c59a0b4522480 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:14.417338 16810 rpcz_store.cc:276] 0709 13:19:12.494555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.416140 (+1921585us) service_pool.cc:224] Handling call
0709 13:19:14.416473 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.416659 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.416683 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.416722 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:14.416763 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.416810 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.416910 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.415434 16885 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:14.415424 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.430449 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.433568 16809 raft_consensus.cc:2410] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:14.428934 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:14.429381 16806 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:14.412016 18901 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:14.432051 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:14.432307 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 64139.6us
I20260709 13:19:14.395053 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:14.405475 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 125360us
I20260709 13:19:14.436002 16958 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:14.436501 16950 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 1.
I20260709 13:19:14.424808 18618 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:14.441843 16879 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:14.441063 18901 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.411589 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:14.450495 16808 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:14.449673 16883 raft_consensus.cc:2410] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:14.430811 18909 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:14.447829 18885 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:14.454025 18885 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:14.455777 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.457262 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.458020 16806 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:14.430949 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:14.461537 17527 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:14.459313 16880 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
W20260709 13:19:14.459656 16775 connection.cc:256] RPC call timeout handler was delayed by -1.7485262269999566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 13:19:14.462770 16775 connection.cc:256] RPC call timeout handler was delayed by -1.7017262270001083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
I20260709 13:19:14.472445 17522 raft_consensus.cc:2410] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:14.474788 18707 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.476101 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 117875us
I20260709 13:19:14.476806 16957 raft_consensus.cc:2410] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:14.449272 18588 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:14.428678 18895 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:14.478313 17518 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:14.475636 18542 raft_consensus.cc:3055] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:14.464785 18618 raft_consensus.cc:697] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:14.476697 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.486127 18600 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:14.501868 16802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42332 (request call id 16) took 2238 ms. Trace:
I20260709 13:19:14.502276 16802 rpcz_store.cc:276] 0709 13:19:12.262960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.500775 (+2237815us) service_pool.cc:224] Handling call
0709 13:19:14.501793 (+  1018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:14.504909 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 616) took 3518 ms. Trace:
I20260709 13:19:14.505460 17520 rpcz_store.cc:276] 0709 13:19:10.986031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.566043 (+2580012us) service_pool.cc:224] Handling call
0709 13:19:13.587117 (+ 21074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.835568 (+248451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.835639 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:13.839232 (+  3593us) log.cc:844] Serialized 26 byte log entry
0709 13:19:13.881644 (+ 42412us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:13.881703 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.881831 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.378805 (+496974us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:14.493728 (+114923us) raft_consensus.cc:1685] finished
0709 13:19:14.493785 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.504713 (+ 10928us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8968,"raft.queue_time_us":16294,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":15508,"spinlock_wait_cycles":23207296,"thread_start_us":152753,"threads_started":2,"wal-append.queue_time_us":72790}
I20260709 13:19:14.507774 18718 consensus_queue.cc:1059] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:14.494074 18542 raft_consensus.cc:740] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:14.508728 18718 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:14.509142 18718 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:14.509375 18542 consensus_queue.cc:260] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.510162 18718 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:14.511044 18542 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:14.511739 18833 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.512295 18833 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:14.513856 16756 auto_rebalancer.cc:629] Failed to schedule move for tablet 57dfb70986d346cdb015b37c0f58dce3: Illegal state: Replica 96eaa6dafb3e4bbe914e54dc12507912 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:14.514467 18833 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:14.475539 18707 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.516999 18707 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:14.522092 16882 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:14.523537 18618 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:14.528936 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:14.530176 16803 raft_consensus.cc:2410] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:14.497449 18841 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:14.481506 18885 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:19:14.537078 18600 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:14.537710 18600 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:14.542021 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:14.545368 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 47297.4us
I20260709 13:19:14.549110 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.439354 18456 consensus_queue.cc:260] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:14.550153 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:14.551405 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.552098 18456 ts_tablet_manager.cc:1434] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.533s	user 0.013s	sys 0.003s
W20260709 13:19:14.552467 18456 ts_tablet_manager.cc:1467] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Tablet startup took 533ms
I20260709 13:19:14.553658 16801 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:19:14.553992 16801 pending_rounds.cc:85] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 2
I20260709 13:19:14.554222 16801 pending_rounds.cc:107] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:14.554466 16801 raft_consensus.cc:2889] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:14.557008 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:14.560768 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.562520 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.562605 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:14.566107 16775 connection.cc:256] RPC call timeout handler was delayed by -1.61622622699997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
W20260709 13:19:14.566592 16775 connection.cc:256] RPC call timeout handler was delayed by -1.5910262270001567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 13:19:14.566972 16775 connection.cc:256] RPC call timeout handler was delayed by -1.5478262270000869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 13:19:14.567312 16775 connection.cc:256] RPC call timeout handler was delayed by -1.4830262269999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:19:14.567662 16775 connection.cc:256] RPC call timeout handler was delayed by -1.4830262269999821s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:19:14.568017 16775 connection.cc:256] RPC call timeout handler was delayed by -1.2967262270001356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2453s for a response
I20260709 13:19:14.565270 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.511570 18718 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:14.564574 16773 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:14.570025 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.573386 16953 raft_consensus.cc:2393] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:14.578960 16850 connection.cc:256] RPC call timeout handler was delayed by -1.7869375779998791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 13:19:14.580435 16850 connection.cc:256] RPC call timeout handler was delayed by -1.7542832239998916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260709 13:19:14.585665 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:14.570976 18841 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:14.594059 16956 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:14.603330 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.606930 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:14.552767 18456 ts_tablet_manager.cc:1469] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Trace:
0709 13:19:01.303760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.315186 (+ 11426us) service_pool.cc:224] Handling call
0709 13:19:02.202408 (+887222us) ts_tablet_manager.cc:934] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
0709 13:19:04.810824 (+2608416us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:05.529641 (+718817us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:05.529754 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:07.169280 (+1639526us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:07.208025 (+ 38745us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:07.368994 (+160969us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:07.369095 (+   101us) inbound_call.cc:177] Queueing success response
0709 13:19:11.965159 (+4596064us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:19:14.019174 (+2054015us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:19:14.103986 (+ 84812us) tablet_replica.cc:261] Starting instrumentation
0709 13:19:14.104767 (+   781us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":59517,"raft.queue_time_us":1536,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":184,"tablet-copy.queue_time_us":741650,"tablet-download-pool.queue_time_us":61475,"tablet-download-pool.run_cpu_time_us":2183,"tablet-download-pool.run_wall_time_us":2868957,"thread_start_us":553167,"threads_started":2}
W20260709 13:19:14.634089 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 44627us
I20260709 13:19:14.634563 16804 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:14.560985 18622 consensus_queue.cc:1059] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:19:14.638624 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.589179 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.594516 18644 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:19:14.651870 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 45006.1us
I20260709 13:19:14.656471 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.656705 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:14.606612 18841 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.638695 18833 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:14.651263 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:14.663240 16957 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:19:14.648744 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.665393 16708 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51366 (request call id 184) took 5887 ms. Trace:
I20260709 13:19:14.650473 18717 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.668202 18717 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.633841 18258 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.582929 18702 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:19:14.670771 16956 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:14.668360 16704 catalog_manager.cc:5697] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 3 to 4, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 4 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.662349 18832 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:14.678767 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.660833 18841 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.676354 18258 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.682014 16704 catalog_manager.cc:5697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 2 to 3, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.683157 18258 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:14.683641 16704 catalog_manager.cc:5697] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 1 to 2, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.685530 16704 catalog_manager.cc:5697] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 3 to 4, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 4 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.688098 18895 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:14.676157 18774 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:14.688371 18838 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:14.689004 18774 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:14.689478 18774 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:14.693111 18717 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:14.655483 18909 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.697160 18909 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:14.701274 16884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:37974
W20260709 13:19:14.703183 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.706368 16807 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:14.710685 16808 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:19:14.673684 18833 raft_consensus.cc:697] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:14.716933 16704 catalog_manager.cc:5697] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.729059 17524 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:14.712833 18622 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.711413 18832 raft_consensus.cc:697] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:14.728073 18901 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.735352 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:14.665781 16708 rpcz_store.cc:276] 0709 13:19:08.682495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.682636 (+   141us) service_pool.cc:224] Handling call
0709 13:19:14.562184 (+5879548us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:10.224277 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:10.225068 (+   791us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:10.225112 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:19:10.225138 (+    26us) tablet.cc:662] Decoding operations
0709 13:19:10.226352 (+  1214us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:10.226463 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:10.226539 (+    76us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:19:10.227667 (+  1128us) tablet.cc:701] Row locks acquired
0709 13:19:10.227711 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:19:10.227893 (+   182us) write_op.cc:270] Start()
0709 13:19:10.228046 (+   153us) write_op.cc:276] Timestamp: P: 1783603150227837 usec, L: 0
0709 13:19:10.228606 (+   560us) op_driver.cc:348] REPLICATION: starting
0709 13:19:10.349294 (+120688us) log.cc:844] Serialized 3920 byte log entry
0709 13:19:10.604987 (+255693us) op_driver.cc:464] REPLICATION: finished
0709 13:19:11.183636 (+578649us) write_op.cc:301] APPLY: starting
0709 13:19:11.183744 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:11.183980 (+   236us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:11.196056 (+ 12076us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:13.861165 (+2665109us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b5c0021978c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef5288331 00007feef5288221 00007feef5282f6c 00007feef29e330b 00007feef29e2fd3 00007feef2ae1e34 00007feef2acd97c 00007feef2ad1d61 00007feef2ad1d19 00007feef2ad1ca9 00007feef2ad1c71
0709 13:19:13.862438 (+  1273us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:13.862810 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:19:13.862883 (+    73us) write_op.cc:312] APPLY: finished
0709 13:19:13.864153 (+  1270us) log.cc:844] Serialized 77 byte log entry
0709 13:19:13.968561 (+104408us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:14.028272 (+ 59711us) write_op.cc:454] Released schema lock
0709 13:19:14.035583 (+  7311us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:14.188815 (+153232us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:14.191876 (+  3061us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":571017,"apply.run_cpu_time_us":30079,"apply.run_wall_time_us":2944288,"num_ops":10,"prepare.queue_time_us":178426,"prepare.run_cpu_time_us":5428,"prepare.run_wall_time_us":140078,"replication_time_us":363474,"spinlock_wait_cycles":9275264,"thread_start_us":552987,"threads_started":3,"wal-append.queue_time_us":94071}]]}
I20260709 13:19:14.750803 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:14.755349 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.735954 18622 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:14.746860 18717 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.773563 18588 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:14.757151 16955 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:14.788302 18901 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:14.789119 18901 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.789674 18901 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:14.798048 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.799714 18901 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:14.768564 18600 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.776044 18717 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.771330 18833 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.813087 16884 raft_consensus.cc:606] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:14.814723 16884 raft_consensus.cc:614] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:14.805316 18702 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:14.775992 18832 consensus_queue.cc:237] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.882997 18622 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:14.889437 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 293332us
W20260709 13:19:14.866670 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.867215 18600 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:14.878279 16810 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:19:14.865005 17522 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:19:14.896804 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 44093.8us
I20260709 13:19:14.886565 18702 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.913642 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:14.910099 18503 raft_consensus.cc:3055] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:14.930867 18717 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:14.931396 18949 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:19:14.932879 16850 connection.cc:256] RPC call timeout handler was delayed by -1.5382354609998856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 13:19:14.919740 18702 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.935384 18573 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:14.935791 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 225) took 1027 ms. Trace:
I20260709 13:19:14.936183 16810 rpcz_store.cc:276] 0709 13:19:13.923260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.432550 (+509290us) service_pool.cc:224] Handling call
0709 13:19:14.442966 (+ 10416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.891499 (+448533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.935554 (+ 44055us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54000988d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:14.935737 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000057216}
W20260709 13:19:14.933530 16850 connection.cc:256] RPC call timeout handler was delayed by -1.3321832239998912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 13:19:14.941208 16850 connection.cc:256] RPC call timeout handler was delayed by -1.2925832240000545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 13:19:14.941610 16850 connection.cc:256] RPC call timeout handler was delayed by -1.2028238959999271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 13:19:14.941969 16850 connection.cc:256] RPC call timeout handler was delayed by -1.2007832239999061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
W20260709 13:19:14.942332 16850 connection.cc:256] RPC call timeout handler was delayed by -1.1497238960000686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:19:14.942677 16850 connection.cc:256] RPC call timeout handler was delayed by -1.1496846380000534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:19:14.943035 16850 connection.cc:256] RPC call timeout handler was delayed by -1.1460846380000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:19:14.943394 16850 connection.cc:256] RPC call timeout handler was delayed by -1.1236238960000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 13:19:14.943756 16850 connection.cc:256] RPC call timeout handler was delayed by -1.0182846380000683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 13:19:14.944169 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.944573 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:14.938231 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 263511us
I20260709 13:19:14.947232 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:14.924232 18909 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:14.928026 18503 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:14.935804 18573 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.949271 18644 raft_consensus.cc:697] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:14.956423 18573 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:14.956877 18600 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:14.991971 18942 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:19:14.998740 18644 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:14.957156 18909 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:15.006891 18909 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:15.007396 18618 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.007959 18618 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.010908 18618 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:15.011153 18947 log.cc:927] Time spent T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:19:14.985704 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:14.985224 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.986112 18901 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:15.008401 18958 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.024329 18958 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.021657 18901 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:15.025252 16924 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:15.025411 18901 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:14.990124 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 267) took 1284 ms. Trace:
W20260709 13:19:14.988116 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 43620us
I20260709 13:19:15.029701 18717 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:15.029992 18573 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:15.032649 18573 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:15.033145 18956 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:15.026077 18895 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:19:15.049548 17520 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:15.043185 18956 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.075075 18791 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:15.062311 18956 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:15.035801 18503 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.089970 18958 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:15.103919 18503 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:15.125892 18774 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.129165 18774 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:15.087587 18841 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.164757 18956 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.167083 18956 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:15.378499 18841 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:15.379405 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.378201 18901 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.392279 18901 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:15.392427 18702 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:15.394816 18702 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:15.420296 18945 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.546s	user 0.003s	sys 0.000s
I20260709 13:19:15.445497 18573 raft_consensus.cc:3055] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:15.446007 18573 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:15.447001 18573 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.448432 18573 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:15.453475 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.456454 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.457154 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.457662 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.470285 16775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.013s	sys 0.025s
W20260709 13:19:15.470638 16775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.013s	sys 0.025s
W20260709 13:19:15.470909 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 720117us
I20260709 13:19:15.472316 18644 consensus_queue.cc:1059] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:15.473459 18644 raft_consensus.cc:3055] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:15.473821 18644 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:15.474701 18644 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.475930 18644 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.485658 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:15.486925 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:15.487812 18600 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:15.488174 18600 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:15.488541 18600 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:15.492290 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:15.493360 16950 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:15.512192 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:15.518285 18600 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:15.527527 18600 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:15.528127 18600 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:15.530684 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.546451 18600 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:15.573772 16952 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:15.577653 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:15.578474 16958 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:15.600087 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.600381 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:15.601498 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 531965us
I20260709 13:19:15.602296 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:15.603579 16924 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:15.606112 16774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.002s	sys 0.019s
W20260709 13:19:15.606670 16774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.002s	sys 0.019s
I20260709 13:19:15.609799 17518 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:19:15.611500 16958 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
W20260709 13:19:15.623414 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.643910 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 157065us
I20260709 13:19:15.645309 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:15.645507 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:15.647341 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:15.651433 18979 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:15.652281 18979 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:15.652837 17519 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:15.653108 18979 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:15.654086 18979 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:15.657747 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 168851us
I20260709 13:19:15.659888 18503 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:15.662209 18503 consensus_queue.cc:1059] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:15.664295 18975 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:15.665272 18975 raft_consensus.cc:2764] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:15.669581 18841 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.670150 18841 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.677469 18503 raft_consensus.cc:3055] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:15.680477 18503 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:15.678733 16850 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:15.681318 18503 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.681764 18975 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.682567 18503 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:15.683597 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:15.678959 17518 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:15.684965 18841 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:15.028941 17521 rpcz_store.cc:276] 0709 13:19:13.581614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.582856 (+  1242us) service_pool.cc:224] Handling call
0709 13:19:14.186738 (+603882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.187106 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:14.187497 (+   391us) log.cc:844] Serialized 14 byte log entry
0709 13:19:14.590734 (+403237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:14.602663 (+ 11929us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:14.605852 (+  3189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.638124 (+ 32272us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:14.719098 (+ 80974us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b1800105820. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf772a6 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4
0709 13:19:14.813590 (+ 94492us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54005befd0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:14.865341 (+ 51751us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5917,"prepare.queue_time_us":3833,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":11881,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":14094,"spinlock_wait_cycles":1182108416,"thread_start_us":383882,"threads_started":1,"wal-append.queue_time_us":496236}
I20260709 13:19:15.697319 18979 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:15.692330 18975 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:15.701576 18975 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:15.712637 18975 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:15.716331 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:15.718334 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:15.719949 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 74571.8us
I20260709 13:19:15.725281 16951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34330 (request call id 1638) took 1303 ms. Trace:
I20260709 13:19:15.727034 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:15.730928 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1679) took 1125 ms. Trace:
I20260709 13:19:15.732371 18981 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:15.733474 16954 rpcz_store.cc:276] 0709 13:19:14.605282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.605437 (+   155us) service_pool.cc:224] Handling call
0709 13:19:14.648970 (+ 43533us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:14.665865 (+ 16895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.665895 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:14.676778 (+ 10883us) log.cc:844] Serialized 52 byte log entry
0709 13:19:15.061050 (+384272us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:15.061096 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.061165 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.730732 (+669567us) raft_consensus.cc:1685] finished
0709 13:19:15.730752 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.730885 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2158,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6357,"thread_start_us":369290,"threads_started":1,"wal-append.queue_time_us":472034}
I20260709 13:19:15.735116 18984 consensus_queue.cc:1059] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:15.736249 18984 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.737022 18984 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:15.739202 18984 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:15.740602 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:15.741556 17521 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:15.740778 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:15.742892 16809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.016s	sys 0.030s
I20260709 13:19:15.742735 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:15.743196 18984 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.743392 16809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.017s	sys 0.030s
I20260709 13:19:15.742903 16773 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:15.745751 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:15.749006 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 105311us
I20260709 13:19:15.726504 16951 rpcz_store.cc:276] 0709 13:19:14.421736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.421868 (+   132us) service_pool.cc:224] Handling call
0709 13:19:14.432065 (+ 10197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.457347 (+ 25282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.457377 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.457832 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:19:14.740106 (+282274us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:14.740158 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:14.740247 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.419740 (+679493us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:15.721008 (+301268us) raft_consensus.cc:1685] finished
0709 13:19:15.721028 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.725191 (+  4163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5402,"raft.queue_time_us":18448,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":9268,"spinlock_wait_cycles":30817152,"thread_start_us":281878,"threads_started":1,"wal-append.queue_time_us":415618}
W20260709 13:19:15.809617 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 82680.7us
I20260709 13:19:15.742666 18975 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:15.830772 18979 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:15.869889 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:15.750330 18984 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:15.938769 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.955586 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.023269 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.026182 18985 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:16.026743 18985 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:16.027163 18985 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.027869 18979 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:16.028523 18979 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.032003 18988 raft_consensus.cc:3055] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:16.032517 18988 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:16.033507 18988 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.034963 18988 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.059769 18989 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:16.060408 18989 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:16.060832 18989 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.065158 18984 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.066085 18984 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:16.066485 18984 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.066854 18984 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:16.067622 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.070103 18975 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.070845 18975 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:16.083106 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.071568 18975 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:16.031337 18979 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:16.136030 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 393147us
W20260709 13:19:16.137405 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.144330 18985 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.146010 18985 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.123524 18992 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:16.152508 18992 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:16.153095 18992 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:16.156517 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.158499 18841 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.159008 18841 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.161377 18841 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:16.164394 18990 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:16.167622 18990 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.176528 18990 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.165938 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 226) took 2209 ms. Trace:
I20260709 13:19:16.186342 16809 rpcz_store.cc:276] 0709 13:19:13.961197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.440223 (+479026us) service_pool.cc:224] Handling call
0709 13:19:14.450603 (+ 10380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:14.464051 (+ 13448us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:14.738058 (+274007us) log.cc:844] Serialized 14 byte log entry
0709 13:19:16.165537 (+1427479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:16.165596 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:16.165682 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.165751 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.165872 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":369,"prepare.queue_time_us":516390,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":335805,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":209,"spinlock_wait_cycles":465152,"thread_start_us":1631340,"threads_started":3,"wal-append.queue_time_us":325739,"wal-append.run_cpu_time_us":2279,"wal-append.run_wall_time_us":1003791}
W20260709 13:19:16.153461 17492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.127s	user 0.038s	sys 0.068s
W20260709 13:19:16.173385 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 336378us
I20260709 13:19:16.189740 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:16.191090 18981 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:16.191502 18981 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:16.191892 18981 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.192315 18885 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:16.168730 18503 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.196040 18979 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.195773 18503 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.196508 18979 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.198369 18979 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:16.199195 17492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.039s	sys 0.069s
W20260709 13:19:16.200042 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 1.21429e+06us
I20260709 13:19:16.200981 18990 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.203070 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:16.203769 17518 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.204022 18588 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.204627 18588 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.206408 18981 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.206867 18588 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:16.208390 18981 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:16.208892 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:16.209923 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.210980 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:16.198370 18503 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:16.212836 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.217398 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37974 (request call id 19) took 1516 ms. Trace:
I20260709 13:19:16.217882 16884 rpcz_store.cc:276] 0709 13:19:14.700968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.701097 (+   129us) service_pool.cc:224] Handling call
0709 13:19:16.217147 (+1516050us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000ee7d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef090853 00007feef405e60a 00007feeed5e47d4 00007feeed5e4762 00007feeed5e4691 00007feeed5e460c 00007feeed5e38c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:16.217282 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255436032}
I20260709 13:19:16.225237 17518 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
W20260709 13:19:16.225643 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.226225 18990 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.227931 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:16.236384 17519 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:16.238655 18989 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.228012 18993 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:16.228034 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 482276us
I20260709 13:19:16.240658 18993 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:16.230330 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 360511us
W20260709 13:19:16.230924 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 329980us
I20260709 13:19:16.241242 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.229442 16884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:19:16.247704 16884 raft_consensus.cc:606] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:16.248063 16884 raft_consensus.cc:614] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:16.241982 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:16.250435 18702 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:16.250639 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:16.244545 17518 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:16.245404 18990 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:16.248461 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 53300.9us
I20260709 13:19:16.249727 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:16.242388 18644 consensus_meta.cc:287] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.766s	user 0.020s	sys 0.000s
I20260709 13:19:16.254743 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:16.269328 17524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.220s	user 0.013s	sys 0.015s
I20260709 13:19:16.269662 17519 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:16.254938 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:16.270072 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.271236 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.255565 17520 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:16.256316 18984 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.258244 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:16.253954 16922 leader_election.cc:336] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.876s (SENT)
W20260709 13:19:16.269716 17524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.013s	sys 0.015s
I20260709 13:19:16.274052 18702 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:16.274780 18988 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:16.276471 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:16.276609 16773 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:16.276649 18988 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:16.277551 18588 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:16.277957 18588 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:16.278232 18988 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:16.275285 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 633) took 1239 ms. Trace:
I20260709 13:19:16.278790 18988 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.279237 16806 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:19:16.280977 18951 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 1.326s	user 0.028s	sys 0.057s
I20260709 13:19:16.280885 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.282600 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.281358 18984 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:16.282649 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:16.284366 17520 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.278936 17524 rpcz_store.cc:276] 0709 13:19:15.035881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:15.036029 (+   148us) service_pool.cc:224] Handling call
0709 13:19:15.036410 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:15.039369 (+  2959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:15.039412 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:15.042724 (+  3312us) log.cc:844] Serialized 26 byte log entry
0709 13:19:16.274952 (+1232228us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:16.274991 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:16.275068 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:16.275114 (+    46us) raft_consensus.cc:1685] finished
0709 13:19:16.275124 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:16.275231 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28684,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":84003,"thread_start_us":1225850,"threads_started":1,"wal-append.queue_time_us":129524}
I20260709 13:19:16.278308 18588 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.283484 16810 raft_consensus.cc:2393] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:16.289037 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.289743 16810 raft_consensus.cc:2368] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:16.284564 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.291198 18600 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:16.278249 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.292543 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.293160 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.284035 18995 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:16.293886 18995 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:16.294309 18995 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.295248 18600 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:16.295897 18644 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:16.279212 18988 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.300041 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.300714 16806 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:16.304245 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.304136 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.303041 16850 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:16.303969 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:16.307013 16806 raft_consensus.cc:2393] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:16.304342 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:16.310305 18600 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:16.319557 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 45151.4us
I20260709 13:19:16.326354 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:16.326481 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:16.327692 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:16.328290 18993 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:16.309729 18990 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.330586 18990 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.331774 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:16.320698 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.335393 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:16.336247 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:16.340677 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:16.319849 18987 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:16.335276 18600 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:16.342340 18987 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:16.342389 18600 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:16.323566 17520 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:16.345975 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:16.346532 16959 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:16.347069 18991 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:16.346695 16773 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:16.346055 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:16.334486 18981 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.351814 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:16.342952 18600 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.342905 18987 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.353787 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:16.355203 16924 leader_election.cc:400] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:16.355332 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:16.355587 16924 leader_election.cc:403] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:19:16.357328 16956 raft_consensus.cc:2410] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:16.357585 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:16.359196 18975 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.355316 18985 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:16.356685 18542 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:19:16.351095 18991 raft_consensus.cc:697] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:16.366428 18985 raft_consensus.cc:697] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:16.367869 18991 consensus_queue.cc:237] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.368462 18985 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.369300 18989 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.365129 18702 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:16.373238 18999 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3.
I20260709 13:19:16.377426 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:16.378427 17524 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:16.379968 18702 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:16.380880 18702 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.382114 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:16.384148 18984 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:16.386675 18987 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.387821 16957 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:16.396006 18990 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:16.398085 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:16.398684 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.406276 16924 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:16.407294 18885 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:16.407812 18885 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:16.408874 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.408699 18885 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.409355 16704 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58310 (request call id 264) took 7876 ms. Trace:
I20260709 13:19:16.410398 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.399986 18588 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.416041 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:16.423902 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:16.424736 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:16.425215 16876 raft_consensus.cc:2376] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5. Re-sending same reply.
I20260709 13:19:16.352463 18988 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.432739 16885 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:16.356917 18992 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.436420 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:16.433511 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.436757 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:16.438549 16810 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:16.438719 16878 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:16.437884 16880 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:16.439697 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:16.440313 16879 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:16.437364 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.445560 16881 raft_consensus.cc:1240] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:16.446449 17524 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:19:16.447029 16808 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:16.447002 16775 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:16.446837 17524 pending_rounds.cc:85] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 4
I20260709 13:19:16.450505 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.451574 16801 raft_consensus.cc:2410] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:19:16.448851 17524 pending_rounds.cc:107] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 13:19:16.453644 17524 raft_consensus.cc:2917] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 13:19:16.445297 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:16.454437 16882 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.455077 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:16.455619 16885 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.459146 17524 raft_consensus.cc:2889] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.459563 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:16.460448 17518 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:19:16.478704 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 68366.2us
I20260709 13:19:16.495812 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:16.512542 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.514904 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:16.524124 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:16.524878 16951 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:16.508018 18993 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:16.530414 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:16.531431 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.530273 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:16.508401 18989 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.532377 17524 raft_consensus.cc:2376] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5. Re-sending same reply.
I20260709 13:19:16.536754 16808 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:16.531849 16957 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:16.533420 16810 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:16.410611 16704 rpcz_store.cc:276] 0709 13:19:08.532530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:08.533292 (+   762us) service_pool.cc:224] Handling call
0709 13:19:16.409298 (+7876006us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:15.396407 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:15.398206 (+  1799us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:15.398265 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:19:15.398287 (+    22us) tablet.cc:662] Decoding operations
0709 13:19:15.399520 (+  1233us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:15.399631 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:15.399665 (+    34us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:19:15.400394 (+   729us) tablet.cc:701] Row locks acquired
0709 13:19:15.400445 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:19:15.400609 (+   164us) write_op.cc:270] Start()
0709 13:19:15.400760 (+   151us) write_op.cc:276] Timestamp: P: 1783603155400549 usec, L: 0
0709 13:19:15.400783 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:15.401558 (+   775us) log.cc:844] Serialized 2064 byte log entry
0709 13:19:15.413033 (+ 11475us) op_driver.cc:464] REPLICATION: finished
0709 13:19:15.414271 (+  1238us) write_op.cc:301] APPLY: starting
0709 13:19:15.414342 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:15.414514 (+   172us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:15.414652 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:15.418341 (+  3689us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:15.418541 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:19:15.418570 (+    29us) write_op.cc:312] APPLY: finished
0709 13:19:15.418753 (+   183us) log.cc:844] Serialized 47 byte log entry
0709 13:19:15.418912 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:15.419012 (+   100us) write_op.cc:454] Released schema lock
0709 13:19:15.419048 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:15.420632 (+  1584us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:15.420662 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":1032,"apply.run_cpu_time_us":2094,"apply.run_wall_time_us":6310,"num_ops":5,"prepare.queue_time_us":5072,"prepare.run_cpu_time_us":5368,"prepare.run_wall_time_us":6801,"raft.queue_time_us":7447,"raft.run_cpu_time_us":1239,"raft.run_wall_time_us":1240,"replication_time_us":12130,"spinlock_wait_cycles":17792,"thread_start_us":13506,"threads_started":4,"wal-append.queue_time_us":1552,"wal-append.run_cpu_time_us":8116,"wal-append.run_wall_time_us":1016248}]]}
I20260709 13:19:16.522039 16803 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:16.521653 18975 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:16.544924 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.541826 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:16.546298 18702 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:16.527202 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.540277 18984 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.523526 19011 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:16.556697 16885 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:16.531471 18993 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:16.558892 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.559111 16805 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:16.558916 18702 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:16.560124 19001 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:19:16.585995 17548 debug-util.cc:398] Leaking SignalData structure 0x7b0800145b60 after lost signal to thread 15723
I20260709 13:19:16.560887 18588 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.607057 18988 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:16.607383 17548 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd020 after lost signal to thread 16742
I20260709 13:19:16.608312 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:16.608741 17548 debug-util.cc:398] Leaking SignalData structure 0x7b0800325f60 after lost signal to thread 16834
I20260709 13:19:16.608912 16803 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:16.609041 17548 debug-util.cc:398] Leaking SignalData structure 0x7b08003b09a0 after lost signal to thread 16835
W20260709 13:19:16.610198 17548 debug-util.cc:398] Leaking SignalData structure 0x7b08003936a0 after lost signal to thread 16909
W20260709 13:19:16.610494 17548 debug-util.cc:398] Leaking SignalData structure 0x7b08003cb180 after lost signal to thread 16910
I20260709 13:19:16.567091 16809 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:16.543884 18989 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.574048 18995 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.555966 18573 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.525399 18644 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:19:16.665329 18644 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:16.665736 18644 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:16.539417 16705 catalog_manager.cc:5697] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.578608 16808 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:16.548831 19010 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.575233 18992 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.585008 16882 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:16.578015 19011 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:16.585853 19005 log.cc:927] Time spent T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:19:16.601753 18901 consensus_queue.cc:1059] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:16.602777 16810 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:16.603992 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:16.604708 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:16.604804 18600 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:16.605818 19006 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:16.601799 18987 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:16.628386 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:16.614355 17492 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:16.615178 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:16.619872 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.588402 18990 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:16.627342 16879 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:16.642060 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:16.613888 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:16.701107 16810 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:19:16.701509 16810 pending_rounds.cc:85] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 2
I20260709 13:19:16.701812 16810 pending_rounds.cc:107] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:16.702090 16810 raft_consensus.cc:2889] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.628098 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:16.582444 18993 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.580996 19009 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:16.605741 16954 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:16.697719 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.699404 16802 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:16.615340 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:16.702764 16878 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:16.704806 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 76474.2us
W20260709 13:19:16.717187 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 75241.2us
I20260709 13:19:16.704074 16705 catalog_manager.cc:5697] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.674364 18702 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.719456 16885 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:16.671038 19011 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:16.581120 18984 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:16.718618 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 222923us
I20260709 13:19:16.717244 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:16.721235 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:16.733319 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.670092 18573 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:16.711748 17548 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7920 after lost signal to thread 16983
I20260709 13:19:16.735886 16801 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:16.713069 19012 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:19:16.746730 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 160007us
I20260709 13:19:16.673166 19010 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.743141 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.729043 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:16.732765 19003 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:16.766593 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.737258 18981 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:16.742726 17548 debug-util.cc:398] Leaking SignalData structure 0x7b0800033120 after lost signal to thread 16984
I20260709 13:19:16.772053 17519 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.772713 18989 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:16.775122 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:16.750803 19012 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:16.777688 19012 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:16.671132 18644 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.780471 18995 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.782104 18984 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:16.783283 16878 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:16.752144 16705 catalog_manager.cc:5697] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.710450 18990 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:16.786185 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 49956.1us
W20260709 13:19:16.787585 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 51632.6us
I20260709 13:19:16.753537 18885 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.789994 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:16.790706 18901 raft_consensus.cc:3055] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:16.792022 17492 leader_election.cc:400] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:16.737375 19014 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:19:16.735613 18542 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:19:16.740397 18979 consensus_queue.cc:1059] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:19:16.787741 18995 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:16.796449 17492 leader_election.cc:403] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:16.783034 18981 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.809677 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.803278 16803 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:16.804224 18573 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:16.766435 19003 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.805529 16705 catalog_manager.cc:5697] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 5, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.811094 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.796444 18901 raft_consensus.cc:740] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:16.831107 19011 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.832402 19031 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:16.832885 19031 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:16.833289 19011 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.833702 19031 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.835322 19026 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:19:16.823782 17548 debug-util.cc:398] Leaking SignalData structure 0x7b08003db6c0 after lost signal to thread 17551
W20260709 13:19:16.835958 17548 debug-util.cc:398] Leaking SignalData structure 0x7b08003db660 after lost signal to thread 18456
I20260709 13:19:16.836254 19030 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:16.836812 19030 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:16.837256 19030 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.839780 19020 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:16.840242 19020 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:16.840663 19020 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.831382 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.844120 18985 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:16.844478 19011 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.850610 18644 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.852294 18901 consensus_queue.cc:260] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.853752 18901 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.810526 18981 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.828325 16705 catalog_manager.cc:5697] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 2, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:16.868418 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 68806.9us
I20260709 13:19:16.824582 19003 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.801321 18885 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.844586 18985 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:16.888331 18985 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.889506 18985 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.892239 18993 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.894281 18993 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:16.881162 18885 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:16.872781 18600 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.899914 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:16.903398 16959 raft_consensus.cc:2410] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:16.882164 17519 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
W20260709 13:19:16.882453 16756 auto_rebalancer.cc:629] Failed to schedule move for tablet 1555b08c459f47689fc0d1a7cf582a1b: Illegal state: Replica 96eaa6dafb3e4bbe914e54dc12507912 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:16.903977 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:16.904613 16957 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.883134 18990 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:16.909375 19010 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:16.873726 16705 catalog_manager.cc:5697] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.899870 16850 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:16.900017 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:16.917711 16705 catalog_manager.cc:5697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.923235 16773 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:16.927795 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:16.928053 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:16.909075 16959 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:16.929487 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:16.875061 19027 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:16.930119 17519 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:16.930424 19027 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEARNER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:16.909839 19012 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.936676 16951 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:16.937707 19012 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:16.936178 16705 catalog_manager.cc:5697] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.940346 16957 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:16.942270 16705 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:16.941951 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 70011.7us
I20260709 13:19:16.918862 19026 raft_consensus.cc:697] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:16.944517 16775 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:16.946165 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.946725 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 70222.9us
I20260709 13:19:16.935423 19030 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.952291 19030 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:16.952448 17520 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:16.947894 18992 consensus_queue.cc:1059] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:16.952280 16850 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:16.953480 18992 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:16.953860 18992 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:16.954624 18992 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.955061 18600 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:16.955904 18991 raft_consensus.cc:3055] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:16.943423 18542 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:16.956287 18991 raft_consensus.cc:740] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:16.956560 18542 raft_consensus.cc:697] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:16.958148 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:16.947533 16705 catalog_manager.cc:5697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.957151 18991 consensus_queue.cc:260] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:16.964241 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 154601us
I20260709 13:19:16.943089 19010 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:16.967182 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.967281 16773 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:16.945612 19011 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:16.968983 18573 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:16.965840 19030 consensus_queue.cc:1059] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:19:16.957405 18542 consensus_queue.cc:237] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.947301 19003 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.969420 16705 catalog_manager.cc:5697] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:16.963719 18992 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:16.967084 18984 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:19:16.978747 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.984676 16806 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:16.981530 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:16.987969 19027 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:16.988369 16957 raft_consensus.cc:3055] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:16.979074 19011 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:19:16.989115 19011 consensus_queue.cc:1243] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer 96eaa6dafb3e4bbe914e54dc12507912 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:19:16.989668 19034 consensus_queue.cc:1059] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:16.979429 18990 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:16.990414 18990 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.990746 18990 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.990903 19033 raft_consensus.cc:3055] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:16.991279 19033 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:16.991832 18984 raft_consensus.cc:697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:16.992158 19033 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.992749 18984 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.988756 16957 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:16.994290 16957 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:16.995182 16957 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:16.947157 18981 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:16.999492 18991 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:17.001291 18981 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:16.993212 19033 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:17.005352 16951 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:17.007184 19036 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:16.981773 16850 leader_election.cc:400] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:17.008397 16850 leader_election.cc:403] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.006429 19003 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:17.008787 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:17.014643 16951 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:16.976466 16705 catalog_manager.cc:5697] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 2 to 4, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 4 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.013120 19030 raft_consensus.cc:3055] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:17.013520 19027 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:16.935467 19020 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:17.015110 16773 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:17.018198 16957 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:19:17.020116 16957 pending_rounds.cc:85] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 5
I20260709 13:19:17.020401 16957 pending_rounds.cc:107] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:19:17.020656 16957 raft_consensus.cc:2889] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:16.979661 18573 raft_consensus.cc:697] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:16.972241 18979 consensus_queue.cc:1059] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:19:17.022158 16705 catalog_manager.cc:5697] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.024858 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:17.026105 19020 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:17.027420 19027 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:17.028692 19026 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:17.030375 16705 catalog_manager.cc:5697] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.033520 16951 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:17.023742 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:17.020637 18993 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:17.034390 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:17.035125 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 53673.2us
I20260709 13:19:17.017280 19030 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:17.024421 19011 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:19:17.041165 18985 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:17.042155 16807 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:17.047519 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:17.042059 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:17.048130 16878 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:17.048882 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:17.037405 16705 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 2 to 3, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.049418 16957 raft_consensus.cc:1240] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:17.020061 18901 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:19:17.053282 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:17.050683 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:17.053643 16882 raft_consensus.cc:1240] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:17.052711 16885 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:17.036419 18993 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.055033 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:17.053915 16808 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:17.130199 16880 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:17.076205 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:17.130518 16809 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:17.079766 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:17.053714 18985 raft_consensus.cc:697] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:17.086548 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.138355 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:17.075533 16877 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:17.079052 18573 consensus_queue.cc:237] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:17.076586 16878 raft_consensus.cc:2393] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:17.149760 16775 leader_election.cc:336] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.666s (SENT)
I20260709 13:19:17.054774 16876 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:17.150173 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:17.042629 19020 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:17.152555 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:17.153415 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:17.037724 19012 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:17.054076 16883 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:17.130167 16848 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:17.077912 19030 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:17.060541 16705 catalog_manager.cc:5697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.137313 18993 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:17.036530 19003 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:19:17.164479 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:17.164868 16705 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.166088 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:17.166630 16809 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 2: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:17.150512 16882 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:17.158018 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:17.144639 17520 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:17.161084 16848 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:17.166422 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:17.167332 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:17.172696 16876 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:17.173055 16877 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:17.173158 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:17.167570 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:17.171214 16878 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:17.174823 16882 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:17.155211 18987 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:17.176749 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:17.155882 19011 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:17.210075 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:17.165947 18600 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:17.210906 16885 raft_consensus.cc:2393] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:17.212007 16878 raft_consensus.cc:1240] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:17.210901 16806 raft_consensus.cc:1240] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:17.218027 16882 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:17.215579 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.234758 17492 connection.cc:256] RPC call timeout handler was delayed by -2.4965264180000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25920000000000004s for a response
I20260709 13:19:17.172817 18992 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:19:17.215006 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 54001.3us
W20260709 13:19:17.220480 19039 log.cc:927] Time spent T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:19:17.221385 19040 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:19:17.224309 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:17.210561 18987 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:17.227771 19010 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:17.229969 18985 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:17.230298 16878 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:19:17.235567 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.214465 16705 catalog_manager.cc:5697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 2 to 3, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.246105 16802 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
W20260709 13:19:17.282591 17492 connection.cc:256] RPC call timeout handler was delayed by -2.3756649849999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260709 13:19:17.282982 17492 connection.cc:256] RPC call timeout handler was delayed by -2.0642649849999088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:19:17.249053 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.283257 17492 connection.cc:256] RPC call timeout handler was delayed by -1.8653649849998146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
W20260709 13:19:17.259013 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 105033us
W20260709 13:19:17.283569 17492 connection.cc:256] RPC call timeout handler was delayed by -1.6844718939998984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 13:19:17.177541 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:17.284798 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.285526 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:17.170764 18990 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:17.276433 16885 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:17.227386 16883 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
W20260709 13:19:17.292783 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.284044 17492 connection.cc:256] RPC call timeout handler was delayed by -1.4324718939997183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 13:19:17.286119 16806 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
W20260709 13:19:17.265799 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 116199us
I20260709 13:19:17.293502 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:17.290438 16705 catalog_manager.cc:5697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:17.293422 17492 connection.cc:256] RPC call timeout handler was delayed by -1.3199649849998423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2674s for a response
W20260709 13:19:17.294356 17492 connection.cc:256] RPC call timeout handler was delayed by -1.1921718939997845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 13:19:17.294799 17492 connection.cc:256] RPC call timeout handler was delayed by -1.1660793149999336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
W20260709 13:19:17.295179 17492 connection.cc:256] RPC call timeout handler was delayed by -1.0967793149998215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 13:19:17.295526 17492 connection.cc:256] RPC call timeout handler was delayed by -1.0958718939998562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23090000000000002s for a response
W20260709 13:19:17.295919 17492 connection.cc:256] RPC call timeout handler was delayed by -1.0832718939998358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2323s for a response
I20260709 13:19:17.311002 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:17.313807 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.341130 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 46169.9us
I20260709 13:19:17.343127 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:17.343927 16885 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:17.344682 16876 raft_consensus.cc:2393] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:17.346879 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.284446 19027 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.350953 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:17.285948 18987 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:17.281190 19030 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:17.353406 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:17.351554 16957 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
W20260709 13:19:17.354413 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.360005 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:17.388652 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.340845 18979 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:17.391990 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:17.394897 16876 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 2.
I20260709 13:19:17.397181 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:17.399714 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:17.402441 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:17.403028 16954 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:17.406952 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:17.347968 19034 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:19:17.409716 16876 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:17.411170 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:17.413797 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:17.414398 16957 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:19:17.416272 16819 tablet_copy_service.cc:342] P 96eaa6dafb3e4bbe914e54dc12507912: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-89c4a22bddc9425886aa0574ae085451 received from {username='slave'} at 127.0.0.1:42344
I20260709 13:19:17.415798 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:17.416908 16819 tablet_copy_service.cc:434] P 96eaa6dafb3e4bbe914e54dc12507912: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-89c4a22bddc9425886aa0574ae085451 on tablet 89c4a22bddc9425886aa0574ae085451 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:17.400038 18885 raft_consensus.cc:3055] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:17.417451 18885 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:17.417523 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 77076.6us
W20260709 13:19:17.418830 19046 log.cc:927] Time spent T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.212s	user 0.000s	sys 0.005s
I20260709 13:19:17.420071 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:17.422034 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:17.423208 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:17.405963 18979 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:17.423949 17521 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:17.424058 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:17.424746 17520 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:17.424805 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:17.425628 16956 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:17.425215 18979 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:17.353102 19027 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:17.410106 19032 consensus_queue.cc:1059] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
W20260709 13:19:17.749343 16848 leader_election.cc:336] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.645s (SENT)
I20260709 13:19:17.427249 16878 raft_consensus.cc:1240] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:19:17.749755 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:17.750535 17524 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
W20260709 13:19:17.751091 16775 leader_election.cc:336] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.715s (SENT)
I20260709 13:19:17.440340 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:17.611688 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.752357 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:17.752676 16876 raft_consensus.cc:2368] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
W20260709 13:19:17.753060 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.405764 18999 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:17.592133 16956 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:17.531759 16950 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:17.531402 16958 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:19:17.455283 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.550552 16808 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:17.429859 16880 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:17.748097 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:17.578758 16804 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:17.523106 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:17.445228 16924 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:17.407804 19033 consensus_queue.cc:1059] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.430s
W20260709 13:19:17.942834 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.857702 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.214991 16954 consensus_meta.cc:287] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.000s
W20260709 13:19:17.440238 16694 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4b60b701acc7473e87e3e529a2a34689 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:19:18.215234 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 769994us
W20260709 13:19:17.563406 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.222007 16694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 811209us
W20260709 13:19:18.222410 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:17.892551 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.446135 19031 consensus_queue.cc:1059] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.777s
I20260709 13:19:17.662938 18600 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.223354 18984 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.223702 19035 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:18.223855 18984 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:17.812484 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:18.225351 19053 raft_consensus.cc:3055] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:17.698757 16957 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:18.225951 18984 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:18.226524 18984 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:17.739169 17519 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.008s	sys 0.020s
I20260709 13:19:18.225766 19053 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:18.199829 19027 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:18.227259 18984 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.228004 19053 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.225773 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:18.229543 18984 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:17.425463 17518 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.231122 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:17.753084 17527 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:18.235741 17525 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:17.443832 19051 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:18.236631 19051 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.236886 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:18.237102 19051 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:17.884708 18999 raft_consensus.cc:697] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:18.237833 17527 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 2: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:18.232571 19033 raft_consensus.cc:3055] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:18.238438 19033 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:18.238826 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:18.241768 17519 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.022s	sys 0.039s
I20260709 13:19:18.242395 17527 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:19:17.852761 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.243131 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.239326 19033 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:18.243927 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.515048 16803 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:18.215276 16879 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:18.199280 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:17.883309 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:18.245512 17521 raft_consensus.cc:2376] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4. Re-sending same reply.
I20260709 13:19:18.245764 18979 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:18.246630 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:17.883347 18993 consensus_meta.cc:287] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.003s
W20260709 13:19:18.214337 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 161524us
I20260709 13:19:18.247910 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 253) took 1109 ms. Trace:
I20260709 13:19:18.223848 18600 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.002496 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:18.248278 16878 rpcz_store.cc:276] 0709 13:19:17.138591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.289460 (+150869us) service_pool.cc:224] Handling call
0709 13:19:17.427005 (+137545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.750786 (+323781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.247700 (+496914us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54001284d0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:18.247842 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315429760}
I20260709 13:19:18.250054 18600 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:18.250289 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:18.250967 16958 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.221402 16954 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:17.751946 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:18.238547 18999 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:17.996198 16881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.006s	sys 0.029s
W20260709 13:19:17.819325 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.445951 19028 consensus_queue.cc:1059] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.777s
I20260709 13:19:17.811995 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:18.252666 19057 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:18.256443 19057 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:18.256850 19057 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.257150 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.257596 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:17.608920 18987 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.258595 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.244153 19033 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.259436 18987 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:17.956324 19037 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.260003 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.260569 16879 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:17.772634 16848 leader_election.cc:336] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.670s (SENT)
I20260709 13:19:18.251829 18990 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:18.263893 16848 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:17.560449 19012 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:18.256179 19048 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:19:18.271020 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 498390us
I20260709 13:19:18.260165 19037 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.247429 17521 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:18.247720 18993 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.244381 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:18.265529 16954 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:18.266655 16922 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:18.257706 16880 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.242533 17519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 659) took 1232 ms. Trace:
W20260709 13:19:18.272073 16848 leader_election.cc:336] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.550s (SENT)
W20260709 13:19:18.272812 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 520551us
I20260709 13:19:18.245764 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:18.253188 16881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.010s	sys 0.041s
I20260709 13:19:18.281576 16958 raft_consensus.cc:2410] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:18.276337 16879 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:18.250193 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:18.273808 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.277307 17525 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:18.282462 17527 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:18.286864 16878 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:18.252439 18600 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.252920 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:18.285991 16951 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:18.288126 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:18.287405 16775 leader_election.cc:336] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.764s (SENT)
I20260709 13:19:18.288992 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:18.292807 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.293771 16878 raft_consensus.cc:2393] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:18.252928 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:18.296072 16809 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:18.272722 18990 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:18.294574 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:18.295867 16802 raft_consensus.cc:2368] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:18.292547 16880 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:18.298960 17518 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:18.280329 17519 rpcz_store.cc:276] 0709 13:19:17.009968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.013422 (+  3454us) service_pool.cc:224] Handling call
0709 13:19:17.013749 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:17.013971 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:17.154183 (+140212us) log.cc:844] Serialized 14 byte log entry
0709 13:19:18.242175 (+1087992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:18.242230 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:18.242294 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.242359 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.242480 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":213840,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":54514,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":21083,"thread_start_us":1200866,"threads_started":2}
I20260709 13:19:18.301296 19037 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:18.277005 18984 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:18.281051 19027 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.307412 16878 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:19:18.283078 19048 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:18.283385 19020 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:18.312280 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 79884.1us
I20260709 13:19:18.312775 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:18.287938 19028 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:18.316277 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:18.340786 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.341446 16878 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:18.342518 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:18.343240 16953 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:18.306897 18990 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.307228 17523 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:18.313483 19020 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:18.347513 18984 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:18.350030 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:18.296962 18600 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.348487 19028 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:18.352058 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:18.354246 19028 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:18.354508 19056 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:18.354988 19056 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.355340 19056 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.355858 19030 consensus_queue.cc:1059] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:18.357336 19012 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.361508 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:18.353328 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:18.353690 19054 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:18.312784 19027 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.376214 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:18.389257 17492 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:18.348783 18987 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.318114 19048 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.401636 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:18.414976 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 127594us
W20260709 13:19:18.415637 16775 leader_election.cc:336] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.824s (SENT)
I20260709 13:19:18.416036 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:18.419235 16956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 173) took 1004 ms. Trace:
I20260709 13:19:18.419823 16956 rpcz_store.cc:276] 0709 13:19:17.415238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.415561 (+   323us) service_pool.cc:224] Handling call
0709 13:19:18.419019 (+1003458us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b5400396cd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:18.419161 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19166464}
I20260709 13:19:18.421398 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:18.401643 19060 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:18.430557 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:18.431950 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:18.414554 19030 consensus_queue.cc:1243] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer 96eaa6dafb3e4bbe914e54dc12507912 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:18.355191 19028 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.408497 18987 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.403060 19051 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.429898 18984 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:18.460609 16922 leader_election.cc:336] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.761s (SENT)
I20260709 13:19:18.462029 16922 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:18.468307 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:18.468645 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 53034.1us
I20260709 13:19:18.452621 19030 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:18.453341 18993 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:18.450891 19065 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:18.488973 16958 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:18.490286 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:18.478736 18985 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:18.492056 18985 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.494040 19026 raft_consensus.cc:3055] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:18.494350 18985 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:18.494654 19026 raft_consensus.cc:740] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:18.495954 19070 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:18.496469 19070 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.476897 19033 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:18.478087 19054 raft_consensus.cc:697] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:18.481184 19030 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.509889 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1223) took 1470 ms. Trace:
I20260709 13:19:18.500727 16955 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 13:19:18.511099 16803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 1240) took 1471 ms (client timeout 1952 ms). Trace:
W20260709 13:19:18.524096 16850 connection.cc:256] RPC call timeout handler was delayed by -2.463533722999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
I20260709 13:19:18.525924 19037 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:18.525830 18993 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:18.527567 18885 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:18.529500 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.530055 16801 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:18.530431 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:18.532157 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:18.502101 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 69592.3us
I20260709 13:19:18.548043 16802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 243) took 1261 ms. Trace:
W20260709 13:19:18.555457 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 77966.8us
I20260709 13:19:18.500155 19065 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:18.551132 19030 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:18.557106 16850 connection.cc:256] RPC call timeout handler was delayed by -2.4050337230000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 13:19:18.564066 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:18.563843 16802 rpcz_store.cc:276] 0709 13:19:17.286866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.359708 (+ 72842us) service_pool.cc:224] Handling call
0709 13:19:18.547816 (+1188108us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54003e8ad4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:18.547966 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079066880}
I20260709 13:19:18.552362 16881 rpcz_store.cc:276] 0709 13:19:17.039857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.039995 (+   138us) service_pool.cc:224] Handling call
0709 13:19:17.041757 (+  1762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.153305 (+111548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.153334 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:17.170807 (+ 17473us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.281812 (+1111005us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:18.281867 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.509410 (+227543us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400135e54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:18.509472 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.509526 (+    54us) raft_consensus.cc:1685] finished
0709 13:19:18.509543 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.509818 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":4540,"spinlock_wait_cycles":255692032,"thread_start_us":1018721,"threads_started":1,"wal-append.queue_time_us":1021536}
W20260709 13:19:18.599081 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:18.611644 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 45388.4us
W20260709 13:19:18.615244 16850 connection.cc:256] RPC call timeout handler was delayed by -2.3645337230000223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 13:19:18.615657 16850 connection.cc:256] RPC call timeout handler was delayed by -2.3438337229999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260709 13:19:18.566900 16808 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:19:18.616053 16850 connection.cc:256] RPC call timeout handler was delayed by -2.3330337229999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 13:19:18.616498 16850 connection.cc:256] RPC call timeout handler was delayed by -2.2016337229999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 13:19:18.616843 16850 connection.cc:256] RPC call timeout handler was delayed by -2.1953337229999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 13:19:18.617166 16850 connection.cc:256] RPC call timeout handler was delayed by -2.014433722999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260709 13:19:18.617502 16850 connection.cc:256] RPC call timeout handler was delayed by -1.9559337230000438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 13:19:18.617825 16850 connection.cc:256] RPC call timeout handler was delayed by -1.87943372299992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 13:19:18.618142 16850 connection.cc:256] RPC call timeout handler was delayed by -1.8398337230000834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22730000000000003s for a response
W20260709 13:19:18.618474 16850 connection.cc:256] RPC call timeout handler was delayed by -1.8398337230000834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22730000000000003s for a response
I20260709 13:19:18.615782 16924 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:18.628096 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.628816 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.630023 16878 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:18.558245 18990 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:18.563217 18885 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:18.641697 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.645540 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.645747 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:18.646250 16879 raft_consensus.cc:2376] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4. Re-sending same reply.
I20260709 13:19:18.566707 17522 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.648202 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.650410 16879 raft_consensus.cc:2410] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:19:18.648603 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.644908 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.653004 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.653630 16879 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:18.649433 18979 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:18.655233 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:18.656282 16810 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:18.566862 19033 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:18.659423 16807 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:18.611469 18600 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:18.660386 16881 raft_consensus.cc:1240] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:18.655187 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:18.663690 16802 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.665017 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.665966 16878 raft_consensus.cc:2393] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:18.661271 16953 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:18.620576 18984 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.666833 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.668257 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.669507 16876 raft_consensus.cc:2376] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5. Re-sending same reply.
W20260709 13:19:18.669776 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 164501us
I20260709 13:19:18.562525 19037 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:18.673091 16922 leader_election.cc:336] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.821s (SENT)
I20260709 13:19:18.673625 16922 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:18.673889 16878 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:18.670809 16879 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:18.630775 19081 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.557667 19026 consensus_queue.cc:260] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.661747 19066 consensus_queue.cc:1059] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:19:18.675740 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.676407 19065 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.676642 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.680605 16879 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:18.679653 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:18.556941 16803 rpcz_store.cc:269] 0709 13:19:17.039508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.042793 (+  3285us) service_pool.cc:224] Handling call
0709 13:19:18.510834 (+1468041us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54001883d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:18.511026 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501477248}
I20260709 13:19:18.717233 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.718060 16880 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:18.718978 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.655212 18979 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:18.687813 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 73700.4us
I20260709 13:19:18.650130 19048 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:18.683733 16878 raft_consensus.cc:2368] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5.
I20260709 13:19:18.663793 19027 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:18.670619 18600 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:18.651024 19032 consensus_queue.cc:1059] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:19:18.709741 19034 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:18.706139 19070 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:18.641335 19069 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.709666 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.743491 16876 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:18.743575 16877 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:18.678850 19083 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:18.711622 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.745123 16881 raft_consensus.cc:2410] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:19:18.744863 19083 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.689143 19081 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:18.749475 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.712533 16802 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:18.712900 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.667739 19033 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.709282 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.752041 16879 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:18.753814 16883 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:18.721060 16885 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:18.653419 19035 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:19:18.706482 19073 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:18.725337 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.725054 18987 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:18.705137 19080 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:18.726884 16775 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:18.730700 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.649798 19014 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:19:18.761831 16882 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:18.734668 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.710400 19051 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:18.724601 19067 log.cc:927] Time spent T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:19:18.712647 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.763525 16880 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:18.748273 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.764813 16878 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:18.696455 19075 consensus_queue.cc:1059] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:19:18.725880 18979 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:18.751147 16848 leader_election.cc:336] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.955s (SENT)
I20260709 13:19:18.748611 19070 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:18.674022 18984 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:18.769627 16775 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.528s (SENT) [suppressed 48 similar messages]
W20260709 13:19:18.761193 16922 leader_election.cc:336] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 2.119s (SENT)
W20260709 13:19:18.765247 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 201210us
I20260709 13:19:18.766144 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.774129 16885 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:18.766908 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.769374 16848 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:18.774912 16884 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.651551 19054 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.751704 19083 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:18.777155 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:18.780210 16883 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:18.781939 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.747910 18600 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:18.784438 16775 leader_election.cc:336] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.951s (SENT)
I20260709 13:19:18.786015 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:18.788049 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:18.790414 16878 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:18.791986 16880 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:19:18.792349 16880 pending_rounds.cc:85] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 4
I20260709 13:19:18.792577 16880 pending_rounds.cc:107] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 13:19:18.792817 16880 raft_consensus.cc:2917] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 13:19:18.793156 16880 raft_consensus.cc:2889] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:18.769105 19071 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:18.771291 18987 raft_consensus.cc:3055] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:18.801470 18600 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:18.803162 16775 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.003s (SENT)
I20260709 13:19:18.803625 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:18.804518 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.804688 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.805308 16885 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.805569 16881 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:18.796171 18573 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:19:18.838297 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 50322.9us
W20260709 13:19:18.839072 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.839177 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:18.770349 18989 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:18.749755 19069 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.783803 19080 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:18.804915 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.850793 16884 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:18.795754 19027 raft_consensus.cc:2764] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:18.857053 18990 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:19:18.857717 19057 consensus_meta.cc:287] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.600s	user 0.004s	sys 0.005s
I20260709 13:19:18.829823 18573 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:18.861591 19056 consensus_meta.cc:287] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.003s
I20260709 13:19:18.861810 18979 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:18.862327 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.796480 18987 raft_consensus.cc:740] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:18.894544 18987 consensus_queue.cc:260] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.776451 19070 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.895411 18573 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.896821 18573 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.897207 19070 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:18.830262 18600 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.898347 18600 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.898687 19056 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.867127 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.900120 16882 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:18.900964 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.901481 19056 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:18.902065 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.887145 16885 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:18.903236 16880 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.903738 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.872778 16879 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:18.860394 19053 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:18.873840 19084 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:18.887076 19054 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:18.874228 19064 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:18.939144 19054 raft_consensus.cc:697] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:18.940107 19033 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:18.885937 19088 consensus_queue.cc:1059] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:19:18.942622 19088 raft_consensus.cc:3055] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:18.942958 19088 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:18.943794 19088 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:18.945029 19088 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:18.948335 19080 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:18.949647 19069 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:18.874435 19037 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:18.874737 19087 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.875859 19095 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:19:18.880497 19081 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:18.883276 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:18.970299 16883 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:18.883641 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:18.885872 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.885637 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:18.887574 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:18.886556 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 83410.5us
I20260709 13:19:18.971120 16880 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:18.890762 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:18.886947 16950 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:19:18.971825 16775 leader_election.cc:336] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.098s (SENT)
W20260709 13:19:18.958549 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.892894 18979 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:18.972290 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:18.953238 16848 leader_election.cc:336] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.780s (SENT)
I20260709 13:19:18.971132 16884 raft_consensus.cc:2393] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:18.971940 16953 raft_consensus.cc:2393] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:18.974396 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:18.971347 16878 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:18.882248 19073 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:19.003659 19073 raft_consensus.cc:697] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:19:18.984356 16848 leader_election.cc:336] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 2.229s (SENT)
I20260709 13:19:19.013247 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:19.014084 16883 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:19.015389 19071 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:19.016481 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 44688.6us
W20260709 13:19:19.018364 16775 leader_election.cc:336] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.174s (SENT)
I20260709 13:19:19.018707 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:18.953908 18987 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:18.969477 19087 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.002170 17522 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:18.940161 19054 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.029320 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:19.036856 16879 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
W20260709 13:19:19.029886 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.030004 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:19.038111 16883 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 2: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:19.041555 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:19.042224 16876 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:19.043669 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:19.043764 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.045339 16883 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:19.045480 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:19.047590 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:19.048378 16802 raft_consensus.cc:2410] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:19.005841 19073 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.028313 19071 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.051865 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:19.054513 16810 raft_consensus.cc:2393] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:18.886415 19057 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.057745 19087 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.058768 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:19.055886 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:19.059589 16808 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:19.059908 16807 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:19.060410 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:19.060941 16808 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:19.062862 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:19.064182 19020 consensus_meta.cc:287] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.000s
I20260709 13:19:19.064551 19020 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:19.055994 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:19.056980 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:19.058835 19057 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.053524 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:19.063408 16809 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:19.066915 16881 raft_consensus.cc:2393] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:19.073889 16810 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:19.082094 16876 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:19.090369 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:19.055841 18600 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.054364 19081 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:19.084302 19060 consensus_meta.cc:287] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.000s
I20260709 13:19:19.096855 16809 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:19.098075 16807 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:19.131142 16808 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
W20260709 13:19:19.140816 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 51602.6us
I20260709 13:19:19.113754 16802 pending_rounds.cc:85] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 2
I20260709 13:19:19.079895 19065 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:19.119372 16957 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:19.089681 16803 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:19.101560 16810 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:19:19.113335 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.160480 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.161798 19060 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:19.179481 19060 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:19.162547 18981 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.180277 18981 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:19.162274 16802 pending_rounds.cc:107] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:19.182480 16802 raft_consensus.cc:2889] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:19.183183 16775 leader_election.cc:336] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.502s (SENT)
I20260709 13:19:19.183596 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:19.167395 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 328279us
W20260709 13:19:19.160713 19100 log.cc:927] Time spent T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:19:19.184583 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.173723 16954 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:19.186666 16803 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
W20260709 13:19:19.187114 16922 consensus_peers.cc:597] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efa1a19816094c78802287ff39e74b62. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:19.188879 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.189116 16775 leader_election.cc:336] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.510s (SENT)
W20260709 13:19:19.190860 16775 leader_election.cc:336] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.582s (SENT)
I20260709 13:19:19.191346 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.123557 18984 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.193518 16879 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:19.188184 16848 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:19.196390 16848 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:19.196781 16850 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.197274 16848 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:19.171392 19030 consensus_meta.cc:287] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.552s	user 0.006s	sys 0.001s
I20260709 13:19:19.200013 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:19.200555 16775 leader_election.cc:336] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.985s (SENT)
I20260709 13:19:19.200870 16803 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:19.200913 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.202162 16810 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:19.204025 18985 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:19.205097 16775 leader_election.cc:336] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.246s (SENT)
W20260709 13:19:19.206643 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.207257 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:19.208446 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.168208 19065 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:19.212172 16775 leader_election.cc:336] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.453s (SENT)
I20260709 13:19:19.219018 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:19.211524 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:19.222010 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.223143 16773 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:19.211522 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.194918 19088 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:19:19.213099 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:19.214517 19076 log.cc:927] Time spent T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.556s	user 0.001s	sys 0.001s
I20260709 13:19:19.205111 19087 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:19.227281 16806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:19:19.215972 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:19.233671 17523 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:19.234778 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:19.235296 16810 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:19.216434 19084 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:19.205054 18984 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:19.216812 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:19.247928 19087 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:19.250617 19026 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:19.194191 19064 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:19.194798 19060 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:19.252497 19085 log.cc:927] Time spent T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.542s	user 0.002s	sys 0.000s
I20260709 13:19:19.238451 19071 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:19.258787 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:19.259320 16884 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.259485 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:19.259968 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:19.205230 19030 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.202004 18600 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:19.260766 18600 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.198179 19080 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:19.261124 18600 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:19.261935 19030 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:19.262951 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:19.263532 17519 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:19.233691 17524 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:19:19.265278 19074 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.634s	user 0.001s	sys 0.002s
I20260709 13:19:19.265403 19065 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:19.266114 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:19.260056 16877 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:19.266856 16876 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:19.227996 16806 raft_consensus.cc:606] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.267424 16806 raft_consensus.cc:614] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:19.205448 19081 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:19.245806 16956 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:19.270107 16880 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:19.274592 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:19.218357 18542 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:19.266798 16952 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:19.279152 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:19.284094 16808 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:19.284327 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:19.284901 17524 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:19.271641 16884 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
W20260709 13:19:19.277312 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.280222 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:19.286396 16877 raft_consensus.cc:2410] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:19:19.286300 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 47477.1us
I20260709 13:19:19.275115 16880 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:19.281508 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:19.282841 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:19.289556 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:19.290442 16806 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:19.292733 16881 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:19.293068 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 81621.8us
I20260709 13:19:19.293740 16850 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.274827 19081 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.238952 19088 consensus_queue.cc:1243] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:19.298672 16773 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:19.300484 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.300552 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:19.301936 16885 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:19.285295 19071 raft_consensus.cc:697] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:19.302539 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.304898 19068 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.300019 19087 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:19.305393 19068 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:19.298074 19081 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.310078 16850 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:19.285144 18993 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:19:19.312383 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.335071 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.336853 16808 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:19.339035 16808 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:19.307830 19061 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:19.339735 19061 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.340126 19061 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:19.307245 19084 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:19.302960 19091 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.359880 16807 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:19.306659 16955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 170) took 1911 ms. Trace:
I20260709 13:19:19.308256 19087 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:19:19.366760 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 53201.6us
I20260709 13:19:19.314210 19060 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:19.371917 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.372215 16884 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:19:19.374619 16884 raft_consensus.cc:606] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.375082 16884 raft_consensus.cc:614] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:19.366917 19075 raft_consensus.cc:3055] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:19.377363 19087 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:19.354669 16805 raft_consensus.cc:1275] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:19.354763 19070 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:19.366858 17522 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:19.381388 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.370880 18989 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:19:19.374069 19060 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.370222 19091 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.380559 19088 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:19:19.379417 19075 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:19:19.375869 18999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.003s	sys 0.011s
W20260709 13:19:19.426329 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 91354.9us
I20260709 13:19:19.417299 16809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:19:19.428268 16810 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:19.428351 16809 raft_consensus.cc:606] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.401845 16956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1693) took 1016 ms. Trace:
W20260709 13:19:19.415164 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.429123 16956 rpcz_store.cc:276] 0709 13:19:18.385318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.421074 (+ 35756us) service_pool.cc:224] Handling call
0709 13:19:19.401699 (+980625us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54001edf54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:19.401795 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866030848}
I20260709 13:19:19.385528 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:19.379132 19066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.006s	sys 0.014s
W20260709 13:19:19.446674 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.467960 16850 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.471848 16850 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:19.470046 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 55662.6us
W20260709 13:19:19.393121 19113 log.cc:927] Time spent T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:19.479563 16850 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:19.410610 19079 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.705s	user 0.003s	sys 0.000s
W20260709 13:19:19.399407 18999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.003s	sys 0.011s
I20260709 13:19:19.384871 19107 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:19.407601 18981 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:19.392542 19060 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:19.504227 19112 log.cc:927] Time spent T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:19:19.505714 19118 log.cc:927] Time spent T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:19:19.507153 19072 log.cc:927] Time spent T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.845s	user 0.003s	sys 0.005s
W20260709 13:19:19.479656 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 94154.7us
I20260709 13:19:19.508440 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 244) took 1240 ms. Trace:
I20260709 13:19:19.508756 19070 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:19.508821 16804 rpcz_store.cc:276] 0709 13:19:18.267623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.267775 (+   152us) service_pool.cc:224] Handling call
0709 13:19:18.270887 (+  3112us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.406438 (+135551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:18.406479 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:18.416762 (+ 10283us) log.cc:844] Serialized 26 byte log entry
0709 13:19:18.558355 (+141593us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:18.558392 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:18.558458 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:19.410041 (+851583us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:19.508147 (+ 98106us) raft_consensus.cc:1685] finished
0709 13:19:19.508168 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:19.508362 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73110,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":2899,"spinlock_wait_cycles":130382080,"thread_start_us":241905,"threads_started":2,"wal-append.queue_time_us":215831}
I20260709 13:19:19.367163 16955 rpcz_store.cc:276] 0709 13:19:17.395427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.396261 (+   834us) service_pool.cc:224] Handling call
0709 13:19:17.560953 (+164692us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:18.558097 (+997144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.294523 (+736426us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54003098d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:19.303648 (+  9125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116195712}
I20260709 13:19:19.484427 18542 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.399590 19075 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.511052 18542 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:19.489729 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.511653 19075 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:19.512593 19088 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:19.513365 17522 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:19.513797 16924 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:19.386324 18989 consensus_queue.cc:1243] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer 599f9a88b6cd4e818a1c59a0b4522480 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:19.394434 19030 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.475726 18984 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:19.515717 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:19.480813 19084 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.516817 18979 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.517243 19028 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:19.396982 19020 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:19.410742 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:19.413717 19080 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.518896 19080 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.519552 19028 raft_consensus.cc:697] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:19.484725 19054 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:19.413237 19061 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.520533 19028 consensus_queue.cc:237] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:19.521047 19080 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.521648 16808 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:19.407265 19091 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.373231 19065 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:19:19.522142 19061 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.411727 18990 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:19:19.476511 19014 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:19:19.523277 18542 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.479036 17520 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:19.394553 19068 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:19.515450 18573 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:19:19.503526 19087 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:19.470868 19066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.007s	sys 0.015s
I20260709 13:19:19.515761 18999 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:19.528262 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:19.529862 16804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:19:19.530596 16804 raft_consensus.cc:606] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Received request to transfer leadership to TS ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:19.531080 16804 raft_consensus.cc:614] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:19.517272 18979 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:19.482448 18600 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.538302 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:19.543720 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 256259us
I20260709 13:19:19.540402 17526 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:19.546500 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:19.394626 19071 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.536916 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:19.566704 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:19.572062 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:19.572611 17526 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:19.568508 16880 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:19.566721 16882 raft_consensus.cc:2393] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:19.572611 16883 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:19.575491 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:19.576486 16809 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:19:19.579339 16806 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:19.579561 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:19.581019 19077 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.008s	sys 0.012s
W20260709 13:19:19.581377 19077 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.008s	sys 0.014s
I20260709 13:19:19.579553 17519 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:19.584805 16809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:19:19.585552 16809 raft_consensus.cc:606] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:19.585947 16809 raft_consensus.cc:614] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:19.590631 18979 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:19.592312 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:19.594180 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:19.603227 17492 leader_election.cc:400] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:19.603730 17492 leader_election.cc:403] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:19:19.605358 17492 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:19.608191 19026 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:19.609004 19054 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:19.609541 19054 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.609875 19054 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:19.609776 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:19.611112 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:19.612351 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 51013.4us
I20260709 13:19:19.596871 17526 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:19.616686 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:19.627328 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:19.613474 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:19.573559 19061 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:19.631989 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:19.632606 16956 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:19.634930 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:19.635619 19026 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:19.637323 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:19.638070 16956 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:19.637324 19081 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.640868 17519 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:19.641773 18600 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.641987 19081 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.632973 19061 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:19.645064 19061 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:19.645673 16773 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:19.645936 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:19.646467 19086 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:19.646883 17519 raft_consensus.cc:2410] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:19.646961 19086 raft_consensus.cc:697] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:19.647874 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:19.647974 19086 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.648746 17519 raft_consensus.cc:2410] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:19:19.649761 17519 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:19.559518 19014 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:19:19.565231 18981 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:19:19.654462 16848 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:19.662174 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:19.656791 17526 raft_consensus.cc:2410] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:19:19.654170 18990 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.660526 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 664) took 1131 ms. Trace:
I20260709 13:19:19.572289 19057 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:19:19.674470 16848 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:19.676713 16922 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:19.666575 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:19.679554 16950 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:19.680286 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:19.681794 16922 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:19.685364 19080 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:19.684242 18600 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:19.687184 18600 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:19.687664 18600 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.680560 18990 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:19.689869 18990 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:19.696173 19060 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.696758 18600 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.698997 17527 pending_rounds.cc:85] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 5
I20260709 13:19:19.699292 17527 pending_rounds.cc:107] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:19:19.699520 17527 raft_consensus.cc:2889] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.702383 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:19.702898 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:19.703647 16804 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.655238 19026 raft_consensus.cc:697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:19.702112 18985 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:19.726079 18985 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.726572 18985 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:19.726243 19026 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.726101 19080 consensus_queue.cc:1059] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:19.726940 18600 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.727588 19080 raft_consensus.cc:3055] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:19.663853 17520 rpcz_store.cc:276] 0709 13:19:18.529481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:18.531031 (+  1550us) service_pool.cc:224] Handling call
0709 13:19:18.531428 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:19.524128 (+992700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.660313 (+136185us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54002805d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:19.660470 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030522624}
I20260709 13:19:19.728154 19080 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:19.728950 19080 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.730054 19080 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:19.732353 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:19.732770 19060 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:19.725587 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:19.707628 16922 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:19.665217 19081 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:19.749210 16959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 165) took 2458 ms (client timeout 1664 ms). Trace:
W20260709 13:19:19.749704 16959 rpcz_store.cc:269] 0709 13:19:17.286866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.287037 (+   171us) service_pool.cc:224] Handling call
0709 13:19:17.406814 (+119777us) spinlock_profiling.cc:243] Waited 905 us on lock 0x7b5800004298. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:19.745271 (+2338457us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54002e36d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:19.745446 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4850882176}
I20260709 13:19:19.684433 19068 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:19.752151 16804 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
W20260709 13:19:19.716674 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.701064 18999 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:19.748739 19081 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.746845 19031 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:19:19.824173 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 150333us
I20260709 13:19:19.826618 17526 pending_rounds.cc:85] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 4
I20260709 13:19:19.827298 17526 pending_rounds.cc:107] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:19:19.827589 17526 raft_consensus.cc:2889] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.685602 18979 consensus_queue.cc:1059] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:19:19.828411 18999 raft_consensus.cc:697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:19.758322 19068 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.824424 19081 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:19.832888 19124 raft_consensus.cc:993] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
W20260709 13:19:19.754487 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 274968us
I20260709 13:19:19.823539 18984 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:19:19.840289 19068 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:19.868605 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:19.882763 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:19.902884 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.887809 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:19.925175 19071 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.886490 19060 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:19.942972 19071 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:19.939834 19131 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:19:19.868566 18993 raft_consensus.cc:1081] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Signalling peer ca1b60a074dc47cd8e68cc57a33a94a3 to start an election
I20260709 13:19:19.940914 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:19.886646 19048 raft_consensus.cc:3055] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:19.949842 19061 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:19.950770 19048 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:19.952319 19054 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.953351 19048 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:19.955513 19048 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:19.964205 19060 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:19.965224 19060 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:19.967027 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:19.972797 19121 log.cc:927] Time spent T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
I20260709 13:19:19.871731 18984 consensus_queue.cc:1243] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer 599f9a88b6cd4e818a1c59a0b4522480 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:19:19.995106 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 59681us
I20260709 13:19:19.999553 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:19.962780 19071 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:20.007584 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 295994us
I20260709 13:19:20.012885 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:20.002015 19087 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:20.003973 19073 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:20.020733 16775 leader_election.cc:336] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.636s (SENT)
I20260709 13:19:20.007294 18600 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:20.022223 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:20.019322 19077 consensus_queue.cc:1059] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:19:20.032878 19054 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:20.028981 19087 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:20.033016 19077 raft_consensus.cc:3055] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:20.034505 19077 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:20.034446 19087 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.035778 19077 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.037446 19077 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:19.875520 18999 consensus_queue.cc:237] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.046033 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:19.998519 18985 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.008030 19119 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:19:20.080041 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.082901 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:20.052685 19114 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.086376 16922 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:20.019829 19075 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:20.084861 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:20.103992 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:20.089143 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:20.104660 16952 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:20.091204 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:20.091042 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:20.093544 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:20.095501 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:20.105648 16959 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:20.116916 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:20.117394 17492 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:20.118564 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:20.121490 16956 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:20.053195 19061 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:20.128103 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:20.123376 16803 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:20.123267 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:20.053167 19020 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.129418 16806 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:20.130502 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 109802us
I20260709 13:19:20.136018 16952 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:20.138569 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:20.139283 16959 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:20.141644 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:20.104938 19075 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.118149 19070 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.030987 19073 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.093268 18600 raft_consensus.cc:697] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:20.123721 16951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
 from {username='slave'} at 127.0.0.1:34330
I20260709 13:19:20.122282 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:20.128265 19054 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:20.094305 19026 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:19:20.152801 17527 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:20.127540 19012 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:20.122527 19148 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:20.144378 19107 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:19:20.162855 16951 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:20.127660 18885 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:19:20.117547 19132 consensus_queue.cc:1059] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:19:20.105899 19114 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.226709 16951 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:20.182693 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.229913 16879 raft_consensus.cc:2393] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:20.170298 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.231335 16883 raft_consensus.cc:2368] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:20.233714 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.234562 16879 raft_consensus.cc:2368] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:20.205945 16806 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:20.235451 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.236856 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.239228 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.240932 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.241865 16879 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:20.165957 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 71818.5us
I20260709 13:19:20.186508 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.183637 16880 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:20.242707 16882 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 5: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:20.154886 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:20.243665 16952 raft_consensus.cc:2368] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3.
I20260709 13:19:20.236224 16883 raft_consensus.cc:2376] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3. Re-sending same reply.
I20260709 13:19:20.245957 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.246254 16877 raft_consensus.cc:2393] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:20.248288 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.258992 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.152935 19075 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:20.260025 16880 raft_consensus.cc:2393] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:20.167176 17521 pending_rounds.cc:85] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 4
I20260709 13:19:20.153326 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:20.188285 19133 log.cc:927] Time spent T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:19:20.261696 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.269481 17492 leader_election.cc:400] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3.
I20260709 13:19:20.140604 19020 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.271531 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:20.264744 19132 raft_consensus.cc:3055] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:20.266194 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:20.229076 19079 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:19:20.132742 19143 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:20.266327 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.273641 17492 leader_election.cc:403] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:19:20.264165 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.289659 16924 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:20.270828 16883 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:19:20.272707 16957 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:20.289831 16882 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:20.282706 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.175172 19087 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.247094 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.289819 16885 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:20.294412 16879 raft_consensus.cc:2376] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5. Re-sending same reply.
I20260709 13:19:20.269685 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.295444 16880 raft_consensus.cc:2393] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:20.296813 16885 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:20.290913 16881 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:20.268401 17521 pending_rounds.cc:107] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:19:20.298252 17521 raft_consensus.cc:2889] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:20.302670 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.305208 16885 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:20.305451 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:20.308478 16951 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.262900 19054 raft_consensus.cc:697] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:20.152292 19122 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 13:19:20.210427 19081 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.315696 16924 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:20.183211 19070 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.317927 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:20.317616 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:20.286336 19132 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:20.319793 19127 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:19:20.339274 19135 log.cc:927] Time spent T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.432s	user 0.000s	sys 0.007s
I20260709 13:19:20.322031 18885 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:19:20.310209 18979 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:20.315552 17518 raft_consensus.cc:2393] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 3: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:20.324050 19154 ts_tablet_manager.cc:933] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:20.307736 19119 raft_consensus.cc:697] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:20.324914 19150 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3.
I20260709 13:19:20.325394 19081 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:20.327477 16882 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:20.358179 16884 raft_consensus.cc:2368] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:20.328354 19157 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:19:20.329667 19068 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.336803 19066 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:20.331718 19146 log.cc:927] Time spent T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:19:20.318001 18600 consensus_queue.cc:237] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.347155 18979 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:20.333353 16876 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 5: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:20.334283 19155 log.cc:927] Time spent T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:19:20.335294 19142 log.cc:927] Time spent T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.393s	user 0.001s	sys 0.013s
I20260709 13:19:20.336079 19028 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:20.336548 19123 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.395s	user 0.000s	sys 0.007s
I20260709 13:19:20.313403 19087 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:20.336973 19014 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:19:20.337913 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.338137 19020 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:20.338411 19060 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:20.310194 19073 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:20.351037 16959 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:20.374989 19068 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:20.371541 16808 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:20.339624 19132 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:20.364883 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:20.388760 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:20.412704 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 95143.4us
I20260709 13:19:20.336777 19114 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:20.417440 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.363169 18985 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:20.372551 18979 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:20.369999 19156 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:20.364638 19066 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:20.331116 16951 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:20.433640 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:20.464663 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:20.431429 18987 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:20.433919 16877 raft_consensus.cc:2376] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5. Re-sending same reply.
I20260709 13:19:20.392689 18993 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:19:20.468549 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 79883.5us
I20260709 13:19:20.427254 18999 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.369874 19048 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 13:19:20.479022 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 45473.8us
I20260709 13:19:20.412899 19124 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:19:20.435843 19060 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:20.417908 19028 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:20.484026 19128 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.541s	user 0.004s	sys 0.004s
I20260709 13:19:20.433912 19119 consensus_queue.cc:237] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.481855 19020 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:20.488407 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1251) took 1219 ms. Trace:
W20260709 13:19:20.490064 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 125248us
I20260709 13:19:20.524008 16878 rpcz_store.cc:276] 0709 13:19:19.269359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.269469 (+   110us) service_pool.cc:224] Handling call
0709 13:19:19.282112 (+ 12643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.282335 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.282350 (+    15us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.287522 (+  5172us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.536298 (+248776us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:19.536350 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.536439 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.335883 (+799444us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:20.482470 (+146587us) raft_consensus.cc:1685] finished
0709 13:19:20.482490 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.488334 (+  5844us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2140,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10847,"spinlock_wait_cycles":38876544,"thread_start_us":229858,"threads_started":1,"wal-append.queue_time_us":634801}
I20260709 13:19:20.527921 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:20.430464 18984 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:19:20.491645 19161 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:20.497138 18979 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.478528 19091 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:20.499543 17492 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:20.503294 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:20.504750 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:20.545822 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.546149 16803 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:20.478701 19066 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.506224 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.551465 16882 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:20.509500 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.508174 19168 consensus_queue.cc:1059] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:19:20.519927 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:20.417022 19054 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.501242 19132 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:20.528585 16810 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:20.530514 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.559625 16885 raft_consensus.cc:2376] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5. Re-sending same reply.
I20260709 13:19:20.477234 19154 tablet_copy_client.cc:323] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.3:33725
I20260709 13:19:20.530452 19020 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:20.538493 16924 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:20.545850 16775 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:20.553522 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 54054.6us
I20260709 13:19:20.556644 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.566319 16880 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:20.557694 16804 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:20.546319 18989 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:20.561774 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.535660 19035 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:20.531023 19161 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.543987 19091 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.593868 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.565084 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.544515 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:20.566653 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:20.572995 19130 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.636s	user 0.004s	sys 0.004s
I20260709 13:19:20.573338 19165 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:19:20.573946 19153 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.335s	user 0.000s	sys 0.002s
W20260709 13:19:20.574761 19170 log.cc:927] Time spent T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:20.576035 16955 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:20.576543 18987 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:20.577979 19147 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.389s	user 0.002s	sys 0.000s
I20260709 13:19:20.479655 19156 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:20.664728 19126 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.723s	user 0.008s	sys 0.003s
W20260709 13:19:20.580296 19158 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:19:20.581826 19148 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:20.587332 19070 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:20.588385 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:20.594955 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 56560.1us
I20260709 13:19:20.602044 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:20.667709 16878 raft_consensus.cc:2376] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5. Re-sending same reply.
I20260709 13:19:20.668103 16804 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:20.594694 16880 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:20.669021 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.594738 16885 raft_consensus.cc:2376] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5. Re-sending same reply.
I20260709 13:19:20.564421 19107 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:19:20.614648 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 48061.5us
I20260709 13:19:20.632472 19088 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:20.618121 16953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 179) took 1409 ms. Trace:
I20260709 13:19:20.602442 19091 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:20.657712 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 43724.5us
I20260709 13:19:20.594358 19161 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.590916 19086 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:20.669735 16880 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:20.677028 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:20.568441 19020 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.678444 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.674575 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:20.679643 16953 rpcz_store.cc:276] 0709 13:19:19.208482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.236388 (+ 27906us) service_pool.cc:224] Handling call
0709 13:19:19.274530 (+ 38142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.412515 (+137985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.412548 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.413048 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.851235 (+438187us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:19.851278 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.851343 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.359021 (+507678us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:20.588331 (+229310us) raft_consensus.cc:1685] finished
0709 13:19:20.588352 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.618046 (+ 29694us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137603,"raft.queue_time_us":138694,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":49720,"spinlock_wait_cycles":34587392,"thread_start_us":437818,"threads_started":1,"wal-append.queue_time_us":529834}
I20260709 13:19:20.686254 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.689862 16956 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:19:20.693807 16956 pending_rounds.cc:85] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 4
I20260709 13:19:20.693876 16880 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:20.694111 16956 pending_rounds.cc:107] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:19:20.691851 16924 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:20.601788 19167 consensus_queue.cc:1059] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:19:20.694494 16956 raft_consensus.cc:2889] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:20.702071 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:20.701715 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.700706 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.705437 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:20.707738 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.710430 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:20.714524 16880 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 2: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:20.713521 16878 raft_consensus.cc:2376] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4. Re-sending same reply.
I20260709 13:19:20.716799 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 293) took 1205 ms. Trace:
I20260709 13:19:20.679443 19088 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.720877 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:20.721242 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 44266.7us
I20260709 13:19:20.721460 16880 raft_consensus.cc:2376] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4. Re-sending same reply.
I20260709 13:19:20.722033 17492 leader_election.cc:400] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:20.722311 17492 leader_election.cc:403] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:19:20.722270 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.717118 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.604513 19035 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.718104 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.717944 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:20.723088 16885 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:20.723631 16804 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:20.682229 19087 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:20.717166 17524 rpcz_store.cc:276] 0709 13:19:19.511521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.511636 (+   115us) service_pool.cc:224] Handling call
0709 13:19:19.511998 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:19.512360 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.512394 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:19.512802 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:19:19.702205 (+189403us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:19.702242 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:19.702302 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.554352 (+852050us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:20.709760 (+155408us) raft_consensus.cc:1685] finished
0709 13:19:20.709792 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.716731 (+  6939us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1949,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":88,"spinlock_wait_cycles":61877504,"thread_start_us":189042,"threads_started":1,"wal-append.queue_time_us":354052}
I20260709 13:19:20.724001 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:20.717870 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:20.725250 16878 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:20.724536 16885 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:20.700414 18987 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:20.690613 19107 raft_consensus.cc:697] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:20.618310 19060 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.728691 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:20.733423 19172 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:20.677194 19148 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.741663 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:20.778750 16806 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:20.742856 18979 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:20.745164 19012 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:20.745764 16951 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:20.694406 19150 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:19:20.749195 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.783020 16883 raft_consensus.cc:2410] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:20.752954 19127 raft_consensus.cc:3055] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:20.758581 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:20.785842 16880 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
W20260709 13:19:20.773655 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 51717.9us
I20260709 13:19:20.787012 17492 leader_election.cc:400] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:20.774860 16885 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:20.776873 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:20.784071 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:20.787930 16806 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.787806 16804 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:20.788758 16804 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:20.721179 19156 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:20.725804 19088 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:20.731117 19167 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5.
I20260709 13:19:20.796787 16883 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:20.793038 16880 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:20.794799 16885 raft_consensus.cc:1275] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:20.721421 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:20.754055 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:20.731407 18987 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.769003 17519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 303) took 1202 ms. Trace:
I20260709 13:19:20.785634 19127 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:20.777892 19048 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:20.776729 19087 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:20.817701 19087 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.814895 19065 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:19:20.808341 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:20.815855 19124 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:20.823774 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:20.824414 19124 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.826618 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:20.827904 19065 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:20.811892 19107 consensus_queue.cc:237] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.828665 19065 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:20.805691 16804 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.831429 16804 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:20.833498 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:20.803913 16878 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:20.792112 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:20.836365 16805 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:20.819916 19048 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.824826 19122 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:20.837260 19048 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:20.838141 19020 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.839200 18990 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:20.840220 19129 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.903s	user 0.005s	sys 0.002s
I20260709 13:19:20.840772 19020 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:20.815117 19086 raft_consensus.cc:697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:20.809027 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:20.844810 16803 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:20.845832 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:20.847687 16804 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:20.849157 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:20.852797 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:20.853772 16804 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:20.854584 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:20.855491 16804 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:20.857928 16803 raft_consensus.cc:2393] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:20.814621 18987 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:20.807938 16806 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:20.790131 19012 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.786533 19075 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.846663 19087 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:20.878749 16804 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:20.861694 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 169915us
I20260709 13:19:20.880125 16806 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:20.891813 16804 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:20.891189 16924 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:20.897099 16955 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:20.898607 19048 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.873795 19066 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.901566 19066 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:20.902411 19175 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.324s	user 0.002s	sys 0.000s
I20260709 13:19:20.864328 19086 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:20.902346 16951 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:20.847726 18990 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:20.851464 19122 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:19:20.913677 17520 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:20.912849 19157 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:19:20.938735 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:20.950328 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:20.952589 16804 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:20.892109 19150 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:21.046226 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 96003.4us
I20260709 13:19:20.911237 19066 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:19:21.037811 19183 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:19:21.047330 19035 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.030968 19150 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:21.044899 19156 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.013942 18979 consensus_queue.cc:1059] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:19:21.029582 19114 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:19:21.016649 19065 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:19:21.055909 19087 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.086186 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:21.061648 19191 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:21.102373 16808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 257) took 1037 ms. Trace:
I20260709 13:19:21.102954 16808 rpcz_store.cc:276] 0709 13:19:20.065384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.065509 (+   125us) service_pool.cc:224] Handling call
0709 13:19:20.065873 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.432267 (+366394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.102071 (+669804us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54002a9254. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:21.102294 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702549376}
I20260709 13:19:21.104250 19012 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.080967 19150 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:21.109953 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:21.068961 19066 raft_consensus.cc:697] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:21.121176 18989 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.134637 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:20.906771 19127 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.138902 16850 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:21.089591 19197 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:21.085955 19156 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:21.160039 19196 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:19:21.164404 16883 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:21.165863 19192 log.cc:927] Time spent T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:20.814466 17519 rpcz_store.cc:276] 0709 13:19:19.566318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:19.650493 (+ 84175us) service_pool.cc:224] Handling call
0709 13:19:19.650795 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:19.705328 (+ 54533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:19.724969 (+ 19641us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:19.834285 (+109316us) log.cc:844] Serialized 52 byte log entry
0709 13:19:20.019554 (+185269us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:20.028045 (+  8491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.046002 (+ 17957us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:20.577296 (+531294us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:20.717030 (+139734us) raft_consensus.cc:1685] finished
0709 13:19:20.717049 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:20.754254 (+ 37205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10362,"raft.queue_time_us":16802,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":7036,"spinlock_wait_cycles":52482432,"thread_start_us":174723,"threads_started":1,"wal-append.queue_time_us":297415}
I20260709 13:19:21.138196 18989 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.170646 18989 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.172267 18990 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:21.173128 19066 consensus_queue.cc:237] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.173622 18987 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.138298 19119 raft_consensus.cc:2764] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:21.138438 19070 raft_consensus.cc:2764] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:19:21.141882 19191 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:21.139480 19168 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:21.106415 19087 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.190564 16884 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:21.152952 19048 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.153824 19054 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.203454 19107 consensus_queue.cc:1059] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:21.208585 19190 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:21.143548 19088 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:21.209823 17492 leader_election.cc:336] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.887s (SENT)
I20260709 13:19:21.213012 16807 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:19:21.226459 16884 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:21.188062 19075 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:21.216646 19161 consensus_meta.cc:287] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 13:19:21.147926 19197 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.256395 19197 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:21.256968 19197 consensus_queue.cc:1059] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:21.259739 19088 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.259927 18987 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.261487 19087 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.261744 19157 raft_consensus.cc:3055] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:21.262240 19157 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:21.247323 19091 consensus_meta.cc:287] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.006s
W20260709 13:19:21.247452 19132 consensus_meta.cc:287] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.003s
W20260709 13:19:21.265095 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 126293us
I20260709 13:19:21.265856 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:21.267762 16850 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:21.251308 19070 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:21.274207 16959 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:19:21.262255 19087 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.213838 19168 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.227468 19054 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.268162 19119 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:21.297580 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:21.300221 19203 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:21.300619 19203 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.300953 19203 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:21.307818 19132 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:21.252058 19161 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.268631 19091 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.337047 16809 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:19:21.337903 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 81019.7us
I20260709 13:19:21.292857 19087 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.337447 16850 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:21.330791 19204 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:21.341761 16807 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:21.327546 19060 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:21.344837 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:21.327206 18987 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:19:21.311424 19203 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.350318 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:21.348248 19184 log.cc:927] Time spent T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.209s	user 0.003s	sys 0.000s
I20260709 13:19:21.339179 19070 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:21.340404 19132 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.293107 19157 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.364117 19161 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.325531 19191 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.368712 19168 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.345856 19156 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:21.363435 19208 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:21.377120 19208 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.348305 19205 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.382189 19205 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.383873 19087 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.347973 19060 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.385941 19073 raft_consensus.cc:3055] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:21.386361 19060 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:21.386464 19073 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:21.376097 19054 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:21.364113 19157 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:21.380834 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:21.388240 16807 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:21.389379 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:21.390262 16881 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:21.391047 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:21.391304 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:21.359026 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:21.391532 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44626 (request call id 573) took 1330 ms. Trace:
I20260709 13:19:21.395560 19203 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.397066 19150 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.351938 19075 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:21.369656 19193 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.361745 19215 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:21.380163 19070 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.380436 19119 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:21.400537 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 50282.3us
I20260709 13:19:21.410135 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:21.412034 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:21.410943 17527 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:21.384361 19205 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.414826 19203 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:21.413025 19189 consensus_queue.cc:1059] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:19:21.415469 19203 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:21.400127 19073 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.415197 19193 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.415908 19203 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:21.416373 19073 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:21.416579 19091 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:21.417595 19193 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.402427 19054 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:21.418292 18987 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:21.418807 18987 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:21.419693 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:21.419615 18987 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.422119 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:21.397464 19014 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:21.418366 19054 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.379462 19208 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:21.369660 19132 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.422513 16881 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
W20260709 13:19:21.527217 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.525302 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.577746 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.578677 16882 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:21.423784 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:21.580533 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:21.432256 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:21.583221 16878 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:21.458905 19166 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.917s	user 0.002s	sys 0.000s
W20260709 13:19:21.611825 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.455021 19206 log.cc:927] Time spent T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:19:21.529035 18987 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:21.504770 19065 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.422268 19070 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.473085 19124 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:21.580771 19054 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:21.635564 19132 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.627916 16848 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:21.398252 17520 rpcz_store.cc:276] 0709 13:19:20.061258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.084549 (+ 23291us) service_pool.cc:224] Handling call
0709 13:19:21.391348 (+1306799us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54005b4fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:21.391476 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854465792}
I20260709 13:19:21.689077 16878 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:21.661586 19070 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:21.581902 19014 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.672734 19150 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.695686 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 291) took 1407 ms. Trace:
I20260709 13:19:21.696586 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:21.696101 16879 rpcz_store.cc:276] 0709 13:19:20.295436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.299778 (+  4342us) service_pool.cc:224] Handling call
0709 13:19:20.300112 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:20.320284 (+ 20172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:20.320319 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:20.320779 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:19:20.391992 (+ 71213us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:20.392047 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:20.392151 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.458301 (+1066150us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:21.695379 (+237078us) raft_consensus.cc:1685] finished
0709 13:19:21.695405 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.695602 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19138,"raft.queue_time_us":37763,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":54128000,"thread_start_us":70837,"threads_started":1,"wal-append.queue_time_us":158661}
I20260709 13:19:21.697317 16878 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:21.698388 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:21.700057 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:21.688642 19207 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.704121 19207 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.705933 19207 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.707165 16879 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 5: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:21.657498 19203 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.710386 19026 raft_consensus.cc:3055] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:21.710815 19026 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:21.711658 19026 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:21.712457 19212 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.349s	user 0.002s	sys 0.000s
I20260709 13:19:21.712864 19026 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:21.713064 19014 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.713577 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1274) took 1021 ms. Trace:
I20260709 13:19:21.713946 16876 rpcz_store.cc:276] 0709 13:19:20.692600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.202434 (+509834us) service_pool.cc:224] Handling call
0709 13:19:21.202748 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.223878 (+ 21130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.223923 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.224480 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.314237 (+ 89757us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:21.314292 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.314379 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.712031 (+397652us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:21.713311 (+  1280us) raft_consensus.cc:1685] finished
0709 13:19:21.713331 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.713518 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13308,"raft.queue_time_us":59579,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"spinlock_wait_cycles":14632832,"thread_start_us":89370,"threads_started":1,"wal-append.queue_time_us":139022}
I20260709 13:19:21.715497 17522 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:21.715775 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:21.720584 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44626 (request call id 571) took 1663 ms. Trace:
I20260709 13:19:21.720985 17525 rpcz_store.cc:276] 0709 13:19:20.057292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.089641 (+ 32349us) service_pool.cc:224] Handling call
0709 13:19:21.720389 (+1630748us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540057e754. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:21.720527 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342333696}
I20260709 13:19:21.721665 19203 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.693943 19066 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:21.722602 19066 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.724606 19066 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.728515 16878 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:21.731654 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:21.736763 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 1565) took 1144 ms. Trace:
I20260709 13:19:21.737017 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:21.692334 19070 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.737676 16879 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:21.742834 19014 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.743053 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:21.743341 19014 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.743991 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:21.744150 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:21.744721 16956 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 5: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:21.745333 19014 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.746327 16969 tablet_copy_service.cc:140] P ca1b60a074dc47cd8e68cc57a33a94a3: Received BeginTabletCopySession request for tablet efa1a19816094c78802287ff39e74b62 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:48222)
I20260709 13:19:21.746871 16969 tablet_copy_service.cc:161] P ca1b60a074dc47cd8e68cc57a33a94a3: Beginning new tablet copy session on tablet efa1a19816094c78802287ff39e74b62 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:48222: session id = 599f9a88b6cd4e818a1c59a0b4522480-efa1a19816094c78802287ff39e74b62
I20260709 13:19:21.742139 19165 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:19:21.748010 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:21.749109 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:21.728991 19054 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:21.739048 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.741461 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 541013us
I20260709 13:19:21.742112 19028 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.750429 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:21.367890 19080 consensus_queue.cc:1175] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "96eaa6dafb3e4bbe914e54dc12507912" responder_term: 6 status { last_received { term: 5 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:19:21.792054 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.793198 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:21.746894 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:21.752682 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.751523 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:21.659212 19065 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.794601 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:21.751012 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:21.794603 16808 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:21.795526 16878 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:21.796819 16957 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:21.753530 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:21.796985 16807 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:21.798166 16924 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:21.798513 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:21.802407 19086 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.012s	sys 0.037s
W20260709 13:19:21.802765 19086 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.013s	sys 0.038s
I20260709 13:19:21.803428 19054 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:21.796233 19064 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:21.806682 19065 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:21.747650 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:21.808161 18979 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:21.808692 18979 raft_consensus.cc:697] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:21.808729 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:21.809638 19064 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:21.810232 19064 raft_consensus.cc:697] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:21.809748 18979 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.811461 19020 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:21.811101 19064 consensus_queue.cc:237] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.812016 19020 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.814034 19020 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:21.816255 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.817917 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:21.818279 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:21.819916 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:21.820184 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:21.821772 16878 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:21.822753 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:21.824410 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:21.794904 19207 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.821938 19114 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.825721 19207 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:21.826683 16956 raft_consensus.cc:1240] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:21.826385 19114 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.828652 19207 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.828958 19114 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:21.831954 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:21.832368 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:21.832787 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:21.833025 16950 raft_consensus.cc:2393] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:21.838572 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:21.840924 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:21.841060 16807 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:21.838260 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:21.843792 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:21.844082 16775 leader_election.cc:336] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.528s (SENT)
I20260709 13:19:21.845041 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:21.758162 19070 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:21.847482 16956 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:21.848335 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:21.848981 16878 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:21.844502 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:21.850057 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:21.850808 16807 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:21.851519 16775 leader_election.cc:336] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.541s (SENT)
W20260709 13:19:21.852692 16775 leader_election.cc:336] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.606s (SENT)
I20260709 13:19:21.853425 16775 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:21.799592 19161 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.855993 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:21.857820 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:21.858372 16775 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.785s (SENT)
I20260709 13:19:21.858573 16953 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:21.858965 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:21.860980 16950 raft_consensus.cc:2410] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:21.864372 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:21.872936 19224 log.cc:927] Time spent T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:21.874835 17518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 693) took 1270 ms. Trace:
I20260709 13:19:21.876516 16807 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:21.875351 17518 rpcz_store.cc:276] 0709 13:19:20.604024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.609459 (+  5435us) service_pool.cc:224] Handling call
0709 13:19:21.465547 (+856088us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b5800011198. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:21.465814 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.466232 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.466292 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.466835 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.621638 (+154803us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:21.626062 (+  4424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.634386 (+  8324us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.874439 (+240053us) raft_consensus.cc:1685] finished
0709 13:19:21.874474 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.874755 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1938,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":59687808,"thread_start_us":117745,"threads_started":1,"wal-append.queue_time_us":240442}
I20260709 13:19:21.835961 19186 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:19:21.881348 19186 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:21.881762 19186 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:21.863883 19086 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:21.857167 18990 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:21.863533 19187 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:21.846920 19167 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:21.885860 19167 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.854475 19053 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:21.903833 19167 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:21.904564 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:21.905208 16882 raft_consensus.cc:2376] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4. Re-sending same reply.
I20260709 13:19:21.907163 16773 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:21.909112 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:21.910337 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:21.910925 16805 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:21.865839 19161 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.912673 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 286) took 1672 ms. Trace:
I20260709 13:19:21.913211 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:21.913712 19161 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:21.914386 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:21.917035 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:21.917932 16802 raft_consensus.cc:2410] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:19:21.882808 19186 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.913020 16877 rpcz_store.cc:276] 0709 13:19:20.240004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.248024 (+  8020us) service_pool.cc:224] Handling call
0709 13:19:21.912526 (+1664502us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54001469d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:21.912623 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425484544}
I20260709 13:19:21.915436 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:21.923875 16810 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:21.925029 16808 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:21.898589 16878 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:21.927407 16877 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:21.861727 16775 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:21.929440 16877 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:19:21.929809 19053 raft_consensus.cc:697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:21.936167 18993 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:21.938967 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:21.944600 16877 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:19:21.952741 16878 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:21.963630 17518 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:21.968536 19211 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.573s	user 0.002s	sys 0.000s
I20260709 13:19:21.968863 17525 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:21.970156 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1273) took 1358 ms. Trace:
I20260709 13:19:21.970588 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:21.970543 16883 rpcz_store.cc:276] 0709 13:19:20.611883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.165173 (+553290us) service_pool.cc:224] Handling call
0709 13:19:21.165443 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.216687 (+ 51244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.216730 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.217653 (+   923us) log.cc:844] Serialized 26 byte log entry
0709 13:19:21.288881 (+ 71228us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:21.288932 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.289016 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:21.967873 (+678857us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:21.969825 (+  1952us) raft_consensus.cc:1685] finished
0709 13:19:21.969851 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.970098 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96350,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":6429056,"thread_start_us":121759,"threads_started":2,"wal-append.queue_time_us":162065}
I20260709 13:19:21.973066 19189 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:21.973654 19189 raft_consensus.cc:697] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:21.974552 19189 consensus_queue.cc:237] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.975422 19053 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:21.977012 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:21.950403 19186 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:21.986088 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 124612us
I20260709 13:19:21.986975 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:21.988687 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:21.989944 18989 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.990434 18989 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:21.984695 19132 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:21.954963 18993 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:19:21.993615 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:21.994059 16878 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:21.993197 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 159822us
I20260709 13:19:21.995216 16878 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:21.996346 16878 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:21.987689 19187 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:21.999078 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.001319 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:22.002619 16878 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:22.004114 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:22.008750 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:21.992980 19132 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.010859 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:22.011716 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.012974 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:22.040864 16878 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:22.006724 18984 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:21.998764 18885 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:22.008041 19066 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:22.008854 19148 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:22.051735 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.056496 19187 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:22.056941 19187 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:22.057376 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.058202 18542 raft_consensus.cc:2764] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:19:22.006929 18990 consensus_queue.cc:1059] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:19:22.054875 19207 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:22.059652 18990 raft_consensus.cc:3055] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:22.060099 18990 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:22.055542 19165 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.057788 19187 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.055119 16884 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:19:22.045934 18984 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:22.062794 18984 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:22.059434 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.060922 18990 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:22.066242 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.071867 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.038889 19064 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:22.041412 19132 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.051739 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.074998 18542 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:22.076152 19165 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:22.077080 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.049971 18885 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.072216 19114 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:22.098531 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.050930 19091 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:22.086675 18981 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:22.046996 19203 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:22.106372 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.108283 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.119779 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.119860 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.108362 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.099423 19086 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:22.097523 18542 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:22.125594 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:22.098927 19148 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:22.125231 19086 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:22.044389 19061 consensus_queue.cc:1059] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:19:22.125542 18542 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.137660 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.121291 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.098186 18990 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:22.071198 19070 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.073942 19066 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:22.109328 19091 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:22.109329 19064 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.148442 16810 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:22.102552 18885 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:22.150043 16810 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:22.149981 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.123270 19114 raft_consensus.cc:697] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:22.174517 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 121774us
I20260709 13:19:22.140237 19086 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:22.193017 16876 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:22.199394 19014 consensus_queue.cc:1059] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:22.199690 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:22.203567 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:22.147826 19091 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:22.135888 19203 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:22.170953 19191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.019s	sys 0.007s
I20260709 13:19:22.156294 18993 raft_consensus.cc:3055] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:22.123129 18981 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.140061 19148 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:22.207003 19204 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.008s	sys 0.024s
W20260709 13:19:22.209944 19191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.019s	sys 0.007s
I20260709 13:19:22.206056 19065 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:22.210565 18993 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:22.210639 19053 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:22.159544 19064 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:22.219177 19204 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.008s	sys 0.025s
I20260709 13:19:22.218928 19014 raft_consensus.cc:3055] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:22.242455 16810 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:19:22.232581 19167 raft_consensus.cc:670] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:22.230068 19053 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.251969 19053 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:22.252188 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:22.252414 18981 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:22.256943 19064 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:22.257115 19127 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:22.257615 18993 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.258929 18993 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:22.241359 19204 raft_consensus.cc:697] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:22.260396 19204 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.261696 16803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1281) took 1697 ms. Trace:
I20260709 13:19:22.262081 16803 rpcz_store.cc:276] 0709 13:19:20.563948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.858568 (+294620us) service_pool.cc:224] Handling call
0709 13:19:20.862139 (+  3571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.045764 (+183625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.045795 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.045832 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:21.045863 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.261476 (+1215613us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54000d8ed4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:22.261521 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.261643 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421848960}
I20260709 13:19:22.228565 19066 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.265007 19148 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:22.266772 18989 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:22.243943 19014 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:22.268719 16775 leader_election.cc:336] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.554s (SENT)
I20260709 13:19:22.269223 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.263516 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.270426 16803 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
W20260709 13:19:22.273648 17492 leader_election.cc:336] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.674s (SENT)
I20260709 13:19:22.274850 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:22.276090 19203 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:22.277809 16882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 301) took 1007 ms. Trace:
W20260709 13:19:22.288169 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.278204 16882 rpcz_store.cc:276] 0709 13:19:21.270553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.947238 (+676685us) service_pool.cc:224] Handling call
0709 13:19:21.948312 (+  1074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.948738 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.948776 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.949299 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.148139 (+198840us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:22.148178 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.148245 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.277617 (+129372us) raft_consensus.cc:1685] finished
0709 13:19:22.277637 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.277756 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5507,"raft.queue_time_us":1272,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":1845,"thread_start_us":164908,"threads_started":1,"wal-append.queue_time_us":263265}
I20260709 13:19:22.240648 19191 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:22.252795 16805 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.250204 19189 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:22.230517 19065 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.305641 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:22.306391 17525 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:22.308743 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:22.310927 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:22.311501 17527 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:22.312282 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:22.312706 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:22.287890 18989 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:22.314754 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:22.315028 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:22.316552 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:22.318166 19237 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:22.318712 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:22.360046 16804 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:22.321151 19065 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:22.321714 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:22.313781 19189 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.335696 16802 raft_consensus.cc:2410] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:22.337854 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1268) took 1782 ms. Trace:
I20260709 13:19:22.289134 19238 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:22.342298 19232 log.cc:927] Time spent T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:22.374696 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:22.302399 19203 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:22.313511 19035 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:22.354015 17519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 694) took 1146 ms. Trace:
I20260709 13:19:22.354471 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1271) took 1827 ms. Trace:
W20260709 13:19:22.355372 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.355774 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.338759 19091 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.367198 19191 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:22.365474 19216 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.389089 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.389479 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:22.390161 16956 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:22.371014 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:22.369392 16885 rpcz_store.cc:276] 0709 13:19:20.555731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.799949 (+244218us) service_pool.cc:224] Handling call
0709 13:19:21.914270 (+1114321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.914605 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.914631 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.915057 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.101719 (+186662us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:22.218506 (+116787us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.218695 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.218768 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.276956 (+ 58188us) raft_consensus.cc:1685] finished
0709 13:19:22.276975 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.337646 (+ 60671us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001469d0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:22.337785 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2206,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":6209,"spinlock_wait_cycles":2561798016,"thread_start_us":268169,"threads_started":2,"wal-append.queue_time_us":291105}
I20260709 13:19:22.342777 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:22.375458 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1282) took 1025 ms. Trace:
I20260709 13:19:22.404548 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:22.245901 19114 consensus_queue.cc:237] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.352175 18985 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.295383 18984 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.361794 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.375574 17523 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:22.383121 16954 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:22.412535 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:22.382357 16809 rpcz_store.cc:276] 0709 13:19:20.526876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.527008 (+   132us) service_pool.cc:224] Handling call
0709 13:19:20.527425 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.337485 (+810060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.354176 (+1016691us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b540011c1d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:22.354401 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861398912}
I20260709 13:19:22.387703 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:22.413803 16958 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.415445 16848 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:22.391542 17525 raft_consensus.cc:2410] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:19:22.416124 16809 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:22.405294 16951 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:22.407351 16885 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:22.419032 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:22.419775 16954 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:22.380374 19070 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:22.366185 19186 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:19:22.404908 16877 rpcz_store.cc:276] 0709 13:19:21.349982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.951540 (+601558us) service_pool.cc:224] Handling call
0709 13:19:21.951849 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:21.952162 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.952188 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:21.960125 (+  7937us) log.cc:844] Serialized 26 byte log entry
0709 13:19:22.132270 (+172145us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:22.132328 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.132415 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.375230 (+242815us) raft_consensus.cc:1685] finished
0709 13:19:22.375252 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.375391 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":8815,"spinlock_wait_cycles":14720,"thread_start_us":171696,"threads_started":1,"wal-append.queue_time_us":267939}
I20260709 13:19:22.365334 19237 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.404167 17520 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:19:22.424125 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.425859 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:22.381018 18885 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.424026 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.451005 16804 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:22.362596 19014 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.436740 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:22.443750 16803 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:22.412431 19188 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.380074 19238 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.384596 19035 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.382315 19203 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.417902 19167 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:22.409719 19216 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.450163 16958 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:21.737076 16806 rpcz_store.cc:276] 0709 13:19:20.591916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.907229 (+315313us) service_pool.cc:224] Handling call
0709 13:19:20.907750 (+   521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:20.909238 (+  1488us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:19:21.016629 (+107391us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.135607 (+118978us) log.cc:844] Serialized 14 byte log entry
0709 13:19:21.468259 (+332652us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b1800460240. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebfa9522 00007feeebfab7c1 00007feeebfab779 00007feeebfab709 00007feeebfab6d1 00007feeebfaa9cd 000000000038f354 000000000038f199 00007feeebf8c83a
0709 13:19:21.736258 (+267999us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b1800460240. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf23c0a 00007feef5663219 00007feeebfaba40 00007feeebfa64e4 00007feeebfa6455 00007feeef08e060 00007feeef0a0716 00007feeef0b1287 00007feeef0b1208
0709 13:19:21.736422 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.736469 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:21.736518 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:21.736584 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:21.736693 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":592097,"prepare.queue_time_us":120257,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":605134,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":5345,"spinlock_wait_cycles":28202112,"thread_start_us":115715,"threads_started":1,"wal-append.queue_time_us":154430}
I20260709 13:19:22.557948 16954 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:22.561661 16954 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:22.530108 16805 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:22.566700 19216 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:22.452353 17518 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:22.450788 19215 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.603164 19215 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.603977 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:22.605242 19215 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:22.482369 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:22.443737 19204 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:22.606434 19204 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:22.606840 19204 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:22.608908 19203 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:22.589109 19239 raft_consensus.cc:1064] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:19:22.579443 19086 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.444620 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44636 (request call id 698) took 1233 ms. Trace:
I20260709 13:19:22.491372 19070 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:22.583925 19238 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:22.532655 19237 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:22.482820 19014 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.527928 19189 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:22.487165 19191 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.588416 19035 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:22.589068 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:22.592360 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 302) took 1321 ms. Trace:
I20260709 13:19:22.652884 16881 rpcz_store.cc:276] 0709 13:19:21.270859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.391060 (+120201us) service_pool.cc:224] Handling call
0709 13:19:22.592154 (+1201094us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b54003f4654. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:22.592292 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66603904}
I20260709 13:19:22.476419 19065 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:22.656787 19065 raft_consensus.cc:697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:22.527693 18984 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:22.516276 18885 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:22.625972 16951 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:22.657895 19065 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.659082 16808 raft_consensus.cc:1240] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:22.662397 19204 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.663513 16882 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:22.665970 16882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1290) took 1084 ms. Trace:
I20260709 13:19:22.666275 16882 rpcz_store.cc:276] 0709 13:19:21.582171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.289683 (+707512us) service_pool.cc:224] Handling call
0709 13:19:22.592829 (+303146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.663852 (+ 71023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.665211 (+  1359us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b54003f4654. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:22.665810 (+   599us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54003f4650. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:22.665922 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829190272}
I20260709 13:19:22.667393 16880 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:22.626991 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 1622) took 1216 ms. Trace:
W20260709 13:19:22.635318 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 273613us
I20260709 13:19:22.645876 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:22.646509 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.670135 16922 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:22.649081 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 232274us
I20260709 13:19:22.649919 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 300) took 1379 ms. Trace:
I20260709 13:19:22.670971 16879 rpcz_store.cc:276] 0709 13:19:21.270277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.743952 (+473675us) service_pool.cc:224] Handling call
0709 13:19:22.649745 (+905793us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b5400191c54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:22.649867 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1555348864}
I20260709 13:19:22.382185 17519 rpcz_store.cc:276] 0709 13:19:21.208143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.217194 (+  9051us) service_pool.cc:224] Handling call
0709 13:19:21.263889 (+ 46695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:21.848425 (+584536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:21.859808 (+ 11383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:21.864972 (+  5164us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:21.871385 (+  6413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.353808 (+482423us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b540005df54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:22.353855 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.353961 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1302018432}
I20260709 13:19:22.622555 17523 rpcz_store.cc:276] 0709 13:19:21.209518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.227528 (+ 18010us) service_pool.cc:224] Handling call
0709 13:19:22.374569 (+1147041us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b5800011198. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71eee 0000000000375939 00007feef3fe51e0 00007feef40ae0c4 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:19:22.443075 (+ 68506us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3857664}
I20260709 13:19:22.518306 19053 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.580658 18542 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.674495 19053 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:22.676198 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1265) took 2126 ms. Trace:
I20260709 13:19:22.676550 16880 rpcz_store.cc:276] 0709 13:19:20.549791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.798141 (+248350us) service_pool.cc:224] Handling call
0709 13:19:20.798594 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.667773 (+1869179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.676005 (+  8232us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54001464d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:22.676147 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4297054464}
I20260709 13:19:22.668484 16878 rpcz_store.cc:276] 0709 13:19:21.410923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.041718 (+630795us) service_pool.cc:224] Handling call
0709 13:19:22.042130 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:22.042546 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.042585 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:22.048738 (+  6153us) log.cc:844] Serialized 52 byte log entry
0709 13:19:22.202217 (+153479us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:22.387130 (+184913us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.387446 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.626587 (+239141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.626696 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.626750 (+    54us) raft_consensus.cc:1685] finished
0709 13:19:22.626768 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.626926 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6420,"prepare.queue_time_us":368847,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":2219,"raft.queue_time_us":24276,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":45150,"thread_start_us":541412,"threads_started":3,"wal-append.queue_time_us":260810}
I20260709 13:19:22.685981 19091 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:22.690204 19239 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.671654 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.464316 19188 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.694563 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.696050 16850 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:22.698387 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:22.705478 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 268809us
I20260709 13:19:22.693260 19261 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.631467 19070 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:22.713145 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 43967.2us
I20260709 13:19:22.544487 19132 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:19:22.715523 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 45478.2us
I20260709 13:19:22.726466 16922 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:22.733222 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1294) took 1093 ms. Trace:
I20260709 13:19:22.733673 16876 rpcz_store.cc:276] 0709 13:19:21.640307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.715488 (+ 75181us) service_pool.cc:224] Handling call
0709 13:19:22.732998 (+1017510us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54000ee7d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:22.733156 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095825152}
I20260709 13:19:20.618484 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:22.736006 16708 catalog_manager.cc:5697] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 4 to 5, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 5 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:19:22.769393 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 44614.1us
I20260709 13:19:22.769505 16708 catalog_manager.cc:5697] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 3, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 3 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:22.770613 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 44891.8us
W20260709 13:19:22.770831 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 72507.7us
I20260709 13:19:22.750031 16922 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:22.771502 16773 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.771163 16708 catalog_manager.cc:5697] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 3, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:22.712507 19035 raft_consensus.cc:2764] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:19:22.776891 16922 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:22.778029 16957 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:22.772089 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:22.780514 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:22.781944 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:22.714707 19127 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:22.734898 19070 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.693562 19124 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 13:19:22.773340 19048 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:22.776659 19261 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.712045 19258 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:19:22.798978 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.777315 16708 catalog_manager.cc:5697] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 5, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 5 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.812119 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:22.787341 19215 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:22.813910 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 100816us
I20260709 13:19:22.826001 19277 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:22.826607 19277 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.828253 16959 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:22.830453 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:22.832110 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:22.832950 19277 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:22.833484 19277 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.833959 16880 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:22.833887 19277 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.835239 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:22.835858 19277 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:22.838279 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:22.842710 19262 consensus_queue.cc:1059] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:22.846861 19280 raft_consensus.cc:3055] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:22.847328 19280 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:22.846909 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1293) took 1220 ms. Trace:
I20260709 13:19:22.850569 16883 rpcz_store.cc:276] 0709 13:19:21.626438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.354242 (+727804us) service_pool.cc:224] Handling call
0709 13:19:22.354478 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.354689 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:22.622812 (+268123us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.846445 (+223633us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.846615 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.846656 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:22.846700 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.846760 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.846860 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11579,"prepare.queue_time_us":126509,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":1765,"raft.queue_time_us":46453,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":109,"thread_start_us":480116,"threads_started":3,"wal-append.queue_time_us":207672}
I20260709 13:19:22.852535 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:22.853295 16881 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:22.732595 18885 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:19:22.795627 19186 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.868253 18979 consensus_queue.cc:1059] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:22.868383 19260 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:22.868649 19204 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:22.809288 19127 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:22.869000 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 51429.3us
I20260709 13:19:22.869789 19132 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:22.864341 19237 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.783563 19068 consensus_queue.cc:1059] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:19:22.795269 19187 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:22.807914 19114 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:22.872447 19258 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.795296 19264 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.813364 19238 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:22.813292 18542 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:22.950167 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:22.910687 16881 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:22.787324 19216 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:19:22.862762 19215 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:22.866822 19189 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:22.817538 17492 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:22.873598 18987 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.919502 19228 log.cc:927] Time spent T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:19:22.920172 16807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1303) took 1027 ms. Trace:
I20260709 13:19:22.937170 19127 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:22.956832 16807 rpcz_store.cc:276] 0709 13:19:21.892493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.927037 (+ 34544us) service_pool.cc:224] Handling call
0709 13:19:22.610388 (+683351us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b58001d0498. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:22.610564 (+   176us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:22.610911 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.610938 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:22.611436 (+   498us) log.cc:844] Serialized 52 byte log entry
0709 13:19:22.783861 (+172425us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:22.862333 (+ 78472us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.870878 (+  8545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.870950 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:22.870993 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:22.919971 (+ 48978us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.920114 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10006,"prepare.queue_time_us":81426,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":19969,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":50768,"spinlock_wait_cycles":29934336,"thread_start_us":172019,"threads_started":1,"wal-append.queue_time_us":232602}
I20260709 13:19:22.960327 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 307) took 1503 ms. Trace:
W20260709 13:19:22.964814 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 147358us
I20260709 13:19:22.926486 18990 consensus_queue.cc:1059] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:19:22.964321 16884 rpcz_store.cc:276] 0709 13:19:21.456548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.062987 (+606439us) service_pool.cc:224] Handling call
0709 13:19:22.063249 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:22.063446 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:22.542838 (+479392us) log.cc:844] Serialized 14 byte log entry
0709 13:19:22.959898 (+417060us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:22.959962 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:22.960028 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:22.960126 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:22.960260 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":321784,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3899,"raft.queue_time_us":31835,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":895797,"threads_started":3,"wal-append.queue_time_us":286500}
I20260709 13:19:22.969187 19284 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:22.970829 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:22.970992 19284 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:22.971467 19284 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:22.971983 18990 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:22.944943 19187 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.972446 18990 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:22.973201 18990 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:22.973877 19187 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:22.974336 18990 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:22.975888 19268 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:22.950383 19258 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.977950 19284 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:22.980038 19284 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:22.956555 19068 consensus_queue.cc:1243] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:22.993338 19284 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:22.995079 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.001637 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:23.002475 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:23.004758 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 229129us
I20260709 13:19:22.963219 18987 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.008729 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:23.008031 17523 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:23.017699 16969 tablet_copy_source_session.cc:215] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:19:23.018785 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:22.988916 19167 consensus_queue.cc:1059] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:19:22.992002 19263 consensus_queue.cc:1059] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:19:23.020197 19207 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.027829 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 220417us
I20260709 13:19:23.028698 16953 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:23.029450 19288 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:23.030875 19288 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:23.031631 19188 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:23.029455 19207 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.034934 19091 raft_consensus.cc:3055] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:23.035382 19091 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:23.042037 19091 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.043283 19288 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:23.043326 19091 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.045248 16850 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.046064 19288 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:23.047470 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.035964 19207 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:23.036101 18987 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.036729 16969 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:48222 (request call id 191) took 1296 ms. Trace:
I20260709 13:19:23.049027 19288 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:23.038208 19216 consensus_queue.cc:1059] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:23.038787 16884 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:23.039136 18999 raft_consensus.cc:3055] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:23.039762 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.049968 19258 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.050457 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:23.050803 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:23.051632 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:23.051754 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.052475 16881 raft_consensus.cc:2410] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:19:23.053007 16884 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:23.053188 19285 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:23.053406 16881 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:23.040469 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:23.040879 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.048399 16969 rpcz_store.cc:276] 0709 13:19:21.740577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:21.746090 (+  5513us) service_pool.cc:224] Handling call
0709 13:19:22.077464 (+331374us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b5400208fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0a03f7 00007feef4036036 00007feef403fa3e 00007feeeb90327b 00007feef403f9ba 00007feef403aacc 00007feef4035c7b 00007feef402a8d1 00007feef30de4b4 00007feef30de442
0709 13:19:23.017560 (+940096us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b5400208fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeef000090 00007feeef09ef3a 00007feef40361bb 00007feef403fa3e 00007feeeb90327b 00007feef403f9ba 00007feef403aacc 00007feef4035c7b 00007feef402a8d1 00007feef30de4b4 00007feef30de442
0709 13:19:23.036640 (+ 19080us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675567232}
I20260709 13:19:23.054850 16878 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:23.037667 19263 raft_consensus.cc:3055] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:23.055457 19263 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:23.018249 19215 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.053211 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.058135 18981 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.058591 18981 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.060708 18981 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:23.060803 19207 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:23.047286 19127 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.048604 19280 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.041265 16880 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:23.066082 16708 catalog_manager.cc:5697] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 2, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.071503 16708 catalog_manager.cc:5697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 3, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 3 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.073015 16708 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 3 to 4, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 4 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:23.074294 16708 catalog_manager.cc:5697] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 2 to 3, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:23.076207 16957 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:19:23.075667 16708 catalog_manager.cc:5697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 4 to 5, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:23.077762 16708 catalog_manager.cc:5697] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 1 to 4, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 4 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:23.068529 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.071527 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.082682 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:23.083424 17526 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.049913 18999 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:23.086781 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:23.087255 18999 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.087193 19263 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.091354 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:23.032974 19284 raft_consensus.cc:3055] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:23.093318 19263 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.073805 19080 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:23.100101 19068 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.105490 16876 raft_consensus.cc:1240] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:23.106218 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:23.099850 19086 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:23.062252 18981 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:19:23.114323 16810 raft_consensus.cc:1240] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:19:23.107756 19283 log.cc:927] Time spent T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:23.108229 19216 raft_consensus.cc:3055] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:23.109026 19080 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:23.109732 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.114907 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:23.100620 19280 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.101696 19284 raft_consensus.cc:740] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:23.119514 18999 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:23.152901 19284 consensus_queue.cc:260] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.120277 16957 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:23.123759 19068 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:23.124688 16705 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58336 (request call id 234) took 12590 ms (client timeout 15000 ms). Trace:
I20260709 13:19:23.161101 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:23.161887 16809 raft_consensus.cc:2410] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:23.132133 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:23.162911 16802 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:23.116231 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:23.139791 16803 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:23.140686 16807 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:23.164042 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 47863.5us
I20260709 13:19:23.165831 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:23.166877 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.140630 16882 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:23.167533 19265 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:23.138875 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:23.088716 19070 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.242236 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:23.144778 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 76321.8us
I20260709 13:19:23.146487 16878 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:23.148840 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.119956 16922 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:23.155268 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:23.126976 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.254020 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:23.255038 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.254015 16879 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:23.137557 17526 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
W20260709 13:19:23.224773 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.226184 16807 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
W20260709 13:19:23.161454 16705 rpcz_store.cc:269] 0709 13:19:10.534220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.534404 (+   184us) service_pool.cc:224] Handling call
0709 13:19:23.124611 (+12590207us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:18.239853 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:18.240419 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:18.240447 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:19:18.240463 (+    16us) tablet.cc:662] Decoding operations
0709 13:19:18.241993 (+  1530us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:18.242072 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:18.242097 (+    25us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:19:18.243427 (+  1330us) tablet.cc:701] Row locks acquired
0709 13:19:18.243442 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:19:18.243588 (+   146us) write_op.cc:270] Start()
0709 13:19:18.252953 (+  9365us) write_op.cc:276] Timestamp: P: 1783603158243542 usec, L: 0
0709 13:19:18.252981 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:19:18.383608 (+130627us) log.cc:844] Serialized 7398 byte log entry
0709 13:19:19.263787 (+880179us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:19.879861 (+616074us) op_driver.cc:464] REPLICATION: finished
0709 13:19:19.956879 (+ 77018us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeebf8c0ac 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feef2accef0
0709 13:19:20.189899 (+233020us) write_op.cc:301] APPLY: starting
0709 13:19:20.189970 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:20.190321 (+   351us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:20.190340 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:20.319905 (+129565us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:20.320255 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:19:20.320311 (+    56us) write_op.cc:312] APPLY: finished
0709 13:19:20.320705 (+   394us) log.cc:844] Serialized 132 byte log entry
0709 13:19:20.320878 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:20.321072 (+   194us) write_op.cc:454] Released schema lock
0709 13:19:20.321146 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:20.321538 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:20.321571 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1044,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":303288,"apply.run_cpu_time_us":5125,"apply.run_wall_time_us":131605,"num_ops":19,"prepare.queue_time_us":629814,"prepare.run_cpu_time_us":25349,"prepare.run_wall_time_us":239006,"raft.queue_time_us":563123,"raft.run_cpu_time_us":38912,"raft.run_wall_time_us":288020,"replication_time_us":1576831,"spinlock_wait_cycles":317876992,"thread_start_us":883666,"threads_started":4,"wal-append.queue_time_us":169044,"wal-append.run_cpu_time_us":103941,"wal-append.run_wall_time_us":2773734}]]}
I20260709 13:19:23.236732 19189 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:23.237696 19284 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:23.238162 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:23.258387 16803 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.239782 19065 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:23.240322 16809 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:23.240777 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.241250 19277 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:23.241593 16806 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:23.242209 16810 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:23.264390 16802 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:23.244040 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.243408 16801 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:23.250113 16804 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:23.140479 19216 raft_consensus.cc:740] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:23.154700 19288 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:23.250703 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 93759.3us
I20260709 13:19:23.268889 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:23.274047 16850 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.274996 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:23.277400 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.277442 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.278187 17526 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
W20260709 13:19:23.274173 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 154285us
I20260709 13:19:23.278560 17519 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:23.279764 16803 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:23.275188 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.282512 19216 consensus_queue.cc:260] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:23.338312 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 62363.9us
I20260709 13:19:23.338347 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.339556 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.284200 16885 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:23.161484 19048 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
W20260709 13:19:23.349189 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 74084.9us
I20260709 13:19:23.348234 16848 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:23.349071 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.360671 17525 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:23.362632 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1306) took 1154 ms. Trace:
W20260709 13:19:23.343909 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 64729.5us
I20260709 13:19:23.359946 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.352226 17526 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:23.263355 19189 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:23.273003 19277 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.255255 19262 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:23.269441 19124 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:23.343325 19289 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:23.365238 16922 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:23.142100 19278 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 13:19:23.338764 19258 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:23.362998 16877 rpcz_store.cc:276] 0709 13:19:22.208739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:22.440958 (+232219us) service_pool.cc:224] Handling call
0709 13:19:22.441290 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:22.770847 (+329557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:22.770883 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:22.784668 (+ 13785us) log.cc:844] Serialized 26 byte log entry
0709 13:19:23.110685 (+326017us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b1800316720. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeeec3e4bc 00007feeebf8c48b 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec360d1
0709 13:19:23.110812 (+   127us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:23.110840 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:23.110894 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:23.350959 (+240065us) raft_consensus.cc:1685] finished
0709 13:19:23.350980 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:23.362571 (+ 11591us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33028,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6205,"spinlock_wait_cycles":25905920,"thread_start_us":384944,"threads_started":2,"wal-append.queue_time_us":147205}
I20260709 13:19:23.368059 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.338423 19167 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:23.368110 16848 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:23.342880 19265 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:23.288379 18981 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:23.350562 19066 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:23.352561 18990 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:23.412406 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 59321.9us
I20260709 13:19:23.352525 19279 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:23.366021 19264 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:23.364243 19187 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:23.420969 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 55800.4us
I20260709 13:19:23.442436 16922 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:23.422124 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 54164.6us
I20260709 13:19:23.444705 16850 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.441922 19289 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:23.446130 19289 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.446471 19289 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.446556 16924 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:23.448220 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:23.452031 19238 consensus_queue.cc:1059] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:23.452593 19014 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:23.453034 19014 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:23.452878 19265 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.453866 19279 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:23.454030 19238 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:23.372289 19237 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:23.354591 19288 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:19:23.455940 19053 raft_consensus.cc:3055] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:23.441738 18990 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.419008 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.459522 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:23.459882 16802 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:23.460124 16801 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:23.360071 19188 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:19:23.461508 16810 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:19:23.453433 19014 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.457052 16850 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:23.344847 19282 consensus_queue.cc:1175] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" responder_term: 5 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:23.373615 19277 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.422806 19065 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:23.423035 18989 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:23.429381 19191 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:23.466239 16922 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:23.384500 19262 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.490196 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:23.490754 16877 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.456341 19053 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:23.494800 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.495967 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.467156 19279 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:23.427397 19290 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.428462 19204 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:23.424408 19086 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:23.487573 18989 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:23.492241 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.492656 16885 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:23.442025 19066 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:23.504808 16879 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:23.508299 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:23.508080 19066 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.413347 19124 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.464329 19127 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:23.517014 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.480073 19161 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:23.542985 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:23.538513 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.459062 19189 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.505239 19279 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:23.547857 16880 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:23.475600 17520 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:23.504688 19203 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:23.460342 19187 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.465548 19258 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:19:23.488977 19191 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:23.514271 19091 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.517371 17518 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 13:19:23.559857 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 107981us
W20260709 13:19:23.579844 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.587019 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.590557 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:23.495385 19065 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.515829 19259 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:19:23.514829 19303 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:23.547467 19161 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:23.516734 19086 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.573793 19068 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.567728 19148 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:23.580873 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 212818us
I20260709 13:19:23.586319 19189 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.560168 19279 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:23.570782 19070 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:23.623932 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:23.582151 19191 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.589993 17518 pending_rounds.cc:85] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 6
W20260709 13:19:23.569909 19239 consensus_queue.cc:1175] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b60b701acc7473e87e3e529a2a34689" responder_term: 4 status { last_received { term: 4 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 4 index: 4 } }
W20260709 13:19:23.633582 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.583760 18985 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.617724 16805 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:23.617398 19260 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:23.638862 17518 pending_rounds.cc:107] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:19:23.643957 17518 raft_consensus.cc:2889] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:23.644066 19302 log.cc:927] Time spent T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:23.644431 18990 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.645468 19262 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.646450 16878 raft_consensus.cc:1217] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 13:19:23.646968 16878 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:19:23.618958 19264 raft_consensus.cc:697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:23.631875 19161 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.636127 19048 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.590757 19053 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.660640 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.516655 19290 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.588645 19091 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.677258 16876 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:23.678411 19091 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.679319 19091 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.679837 19091 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.680968 16876 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:19:23.681481 16876 pending_rounds.cc:85] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 3
I20260709 13:19:23.667908 19048 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.682216 19053 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:23.699533 19086 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:23.699924 19290 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.652132 18985 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.681855 16876 pending_rounds.cc:107] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:23.701268 16876 raft_consensus.cc:2889] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:23.706411 16877 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:23.708041 19154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa1a19816094c78802287ff39e74b62. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:23.697570 19296 log.cc:927] Time spent T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:19:23.717805 19091 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:23.694022 18989 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:23.690335 19124 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:23.698336 19187 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:23.697361 19048 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:23.688866 19065 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:23.697546 19289 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.750666 16881 raft_consensus.cc:2368] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7.
I20260709 13:19:23.698477 19277 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:23.805516 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 213572us
I20260709 13:19:23.809682 19277 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:23.812811 19289 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:23.820369 19312 log.cc:927] Time spent T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:19:23.820719 19080 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.822118 19080 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.755105 19187 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:23.828904 16775 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.837s (SENT) [suppressed 19 similar messages]
I20260709 13:19:23.832345 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.834641 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.836691 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:23.840274 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.734658 19264 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.836448 19091 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:23.834208 18990 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.843398 18985 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:23.840672 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:23.837994 19284 consensus_meta.cc:287] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.565s	user 0.006s	sys 0.003s
I20260709 13:19:23.835737 18989 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:23.856006 18990 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.857178 19068 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:23.857327 18985 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:23.885397 17519 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:19:23.857780 19301 log.cc:927] Time spent T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.269s	user 0.004s	sys 0.000s
I20260709 13:19:23.858788 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:23.888628 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:23.865585 19216 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:23.874464 19260 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:23.875268 19148 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:23.832324 19187 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:23.862931 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:23.894532 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.894809 16803 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:23.895457 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:23.896268 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:23.897101 19148 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:23.893002 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:23.899992 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:23.840425 19318 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:23.901113 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:23.904505 16805 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:19:23.906478 18990 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.892234 19319 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:23.908679 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:23.893345 18542 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:23.910013 18542 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:23.910341 18542 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.880823 19014 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.916887 19187 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.918193 16801 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:23.922451 18979 consensus_queue.cc:1059] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:23.922725 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.923324 17526 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:23.923607 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.924142 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.924650 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.925685 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.926201 16883 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:23.926573 17520 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:23.926913 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.927736 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.928280 16876 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:23.924674 16877 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:23.929100 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:23.929304 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.929620 16876 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.930014 16877 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:23.930064 18542 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.930694 16803 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:23.928273 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.931547 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
W20260709 13:19:23.932276 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:23.934641 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:23.916945 19014 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.847658 19191 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:23.940124 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.945288 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.945470 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.940157 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.945967 16877 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:23.946504 17527 raft_consensus.cc:2410] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:23.941074 17525 raft_consensus.cc:2410] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:23.941004 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:23.948129 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.948733 16881 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:23.941651 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.894811 19260 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:23.942775 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:23.961750 16883 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:23.953569 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:23.953847 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:23.955055 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:23.957754 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:23.958688 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:23.964190 16808 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.968679 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:23.969285 16876 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:23.969434 16953 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:23.970836 16924 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:23.973121 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:23.962471 16951 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:23.979660 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:23.982172 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:23.983853 16850 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:23.984122 19321 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:19:23.984970 19238 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:23.985606 19238 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:23.986608 19238 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.987581 19282 consensus_queue.cc:1059] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:23.988448 19282 raft_consensus.cc:3055] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:23.988755 19282 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:23.989632 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:23.990324 19207 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:23.990962 19259 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:23.993008 19035 consensus_queue.cc:1059] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:23.989531 19282 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:23.927335 19308 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.994207 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.994575 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.995827 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:23.998876 18542 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.983891 19066 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:24.002725 19161 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.006877 19237 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.011955 16950 raft_consensus.cc:2410] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:23.916920 19280 consensus_queue.cc:1059] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:19:23.970217 19132 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:24.021112 19132 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:24.023746 19132 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.023651 19066 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:24.025414 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.020877 19237 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.022564 19035 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:19:24.029801 19259 raft_consensus.cc:3055] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:24.031826 19280 consensus_queue.cc:1243] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:24.035715 19154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44648 (request call id 305) took 3963 ms. Trace:
I20260709 13:19:24.014142 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:24.040007 19259 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:24.044407 19307 consensus_queue.cc:1059] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:19:24.045008 19259 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.046228 19259 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:24.042541 19320 log.cc:927] Time spent T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:19:24.048070 19237 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:24.048491 19317 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.205s	user 0.003s	sys 0.000s
I20260709 13:19:24.017328 19279 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.016811 19308 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.026674 19282 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.018880 19188 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:19:24.050330 19279 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:24.054158 19299 log.cc:927] Time spent T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.636s	user 0.006s	sys 0.007s
I20260709 13:19:24.056012 19308 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:23.941278 16773 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:24.094069 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:24.091518 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 150089us
I20260709 13:19:24.101519 16805 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:19:24.102272 16805 pending_rounds.cc:85] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 5
I20260709 13:19:24.102640 16805 pending_rounds.cc:107] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:19:24.103019 16805 raft_consensus.cc:2889] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:24.107172 16804 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:19:24.004252 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.009936 16876 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:24.112568 16885 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:24.114764 16878 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:19:24.115228 16878 pending_rounds.cc:85] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 2
I20260709 13:19:24.115474 16878 pending_rounds.cc:107] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:24.115725 16878 raft_consensus.cc:2889] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:24.119426 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:24.120973 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:24.021646 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:24.124620 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:24.125069 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:24.129462 16955 raft_consensus.cc:2410] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:19:24.125887 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 104214us
I20260709 13:19:24.131004 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.137873 16958 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:24.138033 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:24.130249 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.140729 16959 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:24.141573 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:24.142306 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.137874 16957 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:24.143057 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 215856us
W20260709 13:19:24.144850 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.144763 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:24.146320 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:24.147089 16957 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:24.148651 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:24.151085 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:24.173789 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:24.151757 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:24.160440 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:24.182317 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 58904.9us
I20260709 13:19:24.184417 19258 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.185736 19308 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:24.164911 19188 consensus_queue.cc:1059] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:19:24.152529 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:24.168875 19053 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:24.185441 19258 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.167395 19265 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:19:24.042245 19154 rpcz_store.cc:276] 0709 13:19:20.090555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.092353 (+  1798us) service_pool.cc:224] Handling call
0709 13:19:20.356133 (+263780us) ts_tablet_manager.cc:934] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
0709 13:19:23.286071 (+2929938us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:24.029188 (+743117us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:24.029271 (+    83us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:24.034981 (+  5710us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:24.035263 (+   282us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:24.035544 (+   281us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:24.035609 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":58603,"tablet-copy.queue_time_us":169481,"thread_start_us":72639,"threads_started":2}
I20260709 13:19:24.186527 19308 raft_consensus.cc:697] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:24.198334 19154 tablet_copy_client.cc:806] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:24.166961 19167 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:19:24.198760 19308 consensus_queue.cc:237] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.166420 19035 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:19:24.203824 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:24.165474 19203 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:19:24.206236 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:24.161726 19091 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.207442 19319 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.207666 19091 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.208436 19319 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:24.208945 19319 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.209393 19319 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.210583 19091 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.153371 18542 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:24.195310 19053 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.165802 19148 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.199785 19258 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.192606 19279 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:24.162086 19124 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:24.194804 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:24.211436 16952 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:24.148329 16953 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
W20260709 13:19:24.219271 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 75426.5us
I20260709 13:19:24.211815 18542 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.154867 18987 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:24.165438 18990 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:24.168517 19191 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:24.167371 19187 consensus_queue.cc:1059] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:19:24.161300 19086 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:24.172044 19262 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.155617 18985 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.229733 19124 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.230988 18985 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.232928 19124 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:24.226150 18987 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.233757 18985 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.234154 18987 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.167158 19161 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:24.236577 19143 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:24.238620 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 86306.5us
I20260709 13:19:24.239807 19265 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:24.241235 16808 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:24.220480 19053 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.226029 18990 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.229204 19187 raft_consensus.cc:3055] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:24.165918 19014 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:24.243273 16956 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:24.224714 18542 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.245699 19035 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:19:24.249325 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 87395.9us
I20260709 13:19:24.250970 18990 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.251564 19014 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:24.253453 17520 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.253729 19258 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.248778 19187 raft_consensus.cc:740] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:24.256515 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.240051 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:24.261206 19265 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.262158 19265 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:24.262995 19154 tablet_copy_client.cc:670] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:24.264206 19167 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:24.266665 18542 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:24.266990 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 72378.5us
I20260709 13:19:24.271843 18542 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:24.267127 16775 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:24.266834 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:24.274494 19132 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.276852 19132 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:24.277851 19167 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:24.282060 17492 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:24.283476 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:24.285291 19187 consensus_queue.cc:260] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.285880 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:24.287092 18993 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:24.287484 18993 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.287858 18993 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.288064 19332 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:24.269073 19014 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:24.269068 19260 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.296170 19143 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:24.299642 16850 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:24.301581 19282 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:24.302397 19282 raft_consensus.cc:697] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:24.252372 19035 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:24.303627 19282 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.304944 19035 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.306622 19035 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:24.310213 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:24.313079 19148 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.313954 19261 raft_consensus.cc:3055] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:24.314380 19261 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:24.316908 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.295532 19260 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:24.325886 16775 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:24.331887 19167 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.289129 19332 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.296823 19143 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.289618 19187 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.335563 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:24.340494 18542 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:24.313159 19189 raft_consensus.cc:3055] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:24.344357 19091 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.344866 19307 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.346163 17520 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:24.358949 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:24.347451 19189 raft_consensus.cc:740] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:24.363471 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 75817.9us
W20260709 13:19:24.364135 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.341519 19258 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:24.378084 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 96301.8us
I20260709 13:19:24.379844 17522 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.380054 19260 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:24.364627 18987 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.384545 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.385270 16955 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:24.341682 19053 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.386379 18987 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:24.388070 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:24.388142 19053 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:24.389848 17492 leader_election.cc:400] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7.
I20260709 13:19:24.391233 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:24.391000 18990 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.392252 16956 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:24.393332 18985 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:24.393790 18985 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:24.393935 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.394194 18985 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.394688 16879 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.394779 16958 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:24.384814 16957 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:24.383946 16951 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:24.398720 19189 consensus_queue.cc:260] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.401800 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:24.401865 19279 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.402586 16878 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:24.402717 19279 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.405361 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:24.315551 19261 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.406306 16878 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:24.407369 19261 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.390973 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:24.420270 16954 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:19:24.358676 19319 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:24.425099 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.425420 16850 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:24.427038 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:24.424825 19091 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.426810 19189 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:24.435949 19307 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.436570 16878 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:24.437328 16885 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.438222 19307 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.443737 19265 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.414387 19258 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.446172 19258 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:24.446251 19091 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.449119 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.450810 16951 raft_consensus.cc:1240] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:24.453087 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.453930 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:24.454452 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.457203 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.424892 19259 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:24.460247 19259 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.463413 19259 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:24.471776 18990 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:24.481922 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 91035.5us
I20260709 13:19:24.472872 19279 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.473380 16881 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:19:24.492153 19282 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:24.492784 19282 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:24.492332 19339 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.112s	user 0.003s	sys 0.000s
I20260709 13:19:24.494504 16885 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:24.493182 19282 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:24.480748 18993 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.512591 17522 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:24.513834 16773 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:24.515143 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:24.490058 19308 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:24.498490 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 44655.9us
I20260709 13:19:24.516637 19332 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:24.517316 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:24.518613 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:24.519382 19265 consensus_queue.cc:1059] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:24.519822 19307 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:24.519973 19216 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:24.520337 19307 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.520486 19216 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.520818 19307 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.520963 19216 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.521164 19300 raft_consensus.cc:3055] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:24.521549 19300 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:24.522481 19300 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.524222 19308 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:24.524942 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:24.525224 19308 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:24.525655 19308 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:19:24.500530 19341 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:24.506754 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.507980 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:24.508740 18985 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.509124 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:24.516418 19054 raft_consensus.cc:2764] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:19:24.518227 18993 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:24.523492 19300 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:24.547969 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:24.527333 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:24.555759 17520 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:24.557511 19308 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.559805 16877 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:24.560537 16808 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:24.561566 19282 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.517331 19332 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:24.564188 19332 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.535879 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:24.573565 16879 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:24.577507 19237 consensus_queue.cc:1059] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:24.579514 19091 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:24.573335 16883 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:24.593124 16808 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:19:24.545501 19279 consensus_queue.cc:1059] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 13:19:24.601544 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 74298us
I20260709 13:19:24.603195 17521 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:24.618556 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 68449.7us
I20260709 13:19:24.605515 19258 raft_consensus.cc:3055] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:24.622762 19280 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.623628 19280 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.624364 19143 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.625746 19280 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.626543 19143 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:24.628197 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:24.629056 19143 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:24.629526 19143 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.629997 19143 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.630579 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:24.631449 19091 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.631784 16880 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:24.632215 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:24.635522 19086 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.635861 18993 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.636168 19086 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.636591 18993 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.637369 16808 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:19:24.637715 16808 pending_rounds.cc:85] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 2
I20260709 13:19:24.637945 16808 pending_rounds.cc:107] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:19:24.638159 16808 raft_consensus.cc:2889] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:24.638288 19086 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.638410 18993 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.606747 19282 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:24.609184 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:24.622838 19262 raft_consensus.cc:3055] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:24.606447 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:24.616209 19279 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:24.655972 19319 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.656013 19279 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.643235 19258 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:24.658859 19279 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:24.659250 19258 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.660383 19258 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.662173 16809 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:24.662954 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:24.663347 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:24.663715 16806 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:24.663956 16802 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.664499 16884 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:24.664959 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:24.649605 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 63743.1us
W20260709 13:19:24.651846 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:24.675171 19348 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:19:24.676098 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:24.646245 18990 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.679061 18990 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.681245 18990 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.671478 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:24.688972 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:24.695895 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:24.693159 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.648082 19262 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:24.700481 18985 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.700702 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.701218 16810 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:24.702867 19308 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.693626 19261 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:19:24.704083 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.705188 16805 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:24.706568 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.707031 16883 raft_consensus.cc:2410] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:19:24.707993 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 59568.1us
I20260709 13:19:24.708707 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:24.711195 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:24.711858 19332 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.712154 16809 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:19:24.712428 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:24.713802 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:24.711941 18985 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.697465 19035 consensus_queue.cc:1059] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:19:24.722301 16708 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51366 (request call id 185) took 8339 ms. Trace:
I20260709 13:19:24.723421 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.724416 16810 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:24.724867 16955 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:24.725277 19054 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:24.725967 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.726293 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:24.726608 16956 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:24.726999 16803 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:24.729451 16954 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:24.737728 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:24.722784 16708 rpcz_store.cc:276] 0709 13:19:16.383096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.383461 (+   365us) service_pool.cc:224] Handling call
0709 13:19:24.722022 (+8338561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:23.682459 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:23.683180 (+   721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:23.683228 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:19:23.683254 (+    26us) tablet.cc:662] Decoding operations
0709 13:19:23.717449 (+ 34195us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:23.717527 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:23.717554 (+    27us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:19:23.718340 (+   786us) tablet.cc:701] Row locks acquired
0709 13:19:23.718359 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:19:23.718511 (+   152us) write_op.cc:270] Start()
0709 13:19:23.718614 (+   103us) write_op.cc:276] Timestamp: P: 1783603163718468 usec, L: 0
0709 13:19:23.718633 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:19:23.719252 (+   619us) log.cc:844] Serialized 3981 byte log entry
0709 13:19:24.063260 (+344008us) op_driver.cc:464] REPLICATION: finished
0709 13:19:24.343873 (+280613us) write_op.cc:301] APPLY: starting
0709 13:19:24.343994 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:24.344364 (+   370us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:24.344523 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:24.345774 (+  1251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:24.346087 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:19:24.346138 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:24.346571 (+   433us) log.cc:844] Serialized 77 byte log entry
0709 13:19:24.346812 (+   241us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:24.347039 (+   227us) write_op.cc:454] Released schema lock
0709 13:19:24.347104 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:24.347639 (+   535us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:24.347666 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":487139,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":280253,"apply.run_cpu_time_us":3797,"apply.run_wall_time_us":3797,"num_ops":10,"prepare.queue_time_us":513994,"prepare.run_cpu_time_us":26029,"prepare.run_wall_time_us":142973,"raft.queue_time_us":75585,"raft.run_cpu_time_us":5248,"raft.run_wall_time_us":169179,"replication_time_us":343679,"thread_start_us":686931,"threads_started":4,"wal-append.queue_time_us":134294}]]}
I20260709 13:19:24.738979 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:24.712469 19086 consensus_queue.cc:1059] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:19:24.742987 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.741667 16803 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:24.744680 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.743853 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.749200 16879 raft_consensus.cc:2368] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7.
I20260709 13:19:24.753297 16810 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:24.756491 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.752167 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:24.760317 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:24.761013 16950 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:24.755462 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:24.766652 19143 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.768633 16922 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:24.769831 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:24.733639 19167 consensus_queue.cc:1059] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:19:24.751791 19091 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:24.772114 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:24.787935 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:24.800755 18987 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:24.785020 16880 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:24.785022 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:24.801015 19035 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:24.800768 19207 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:24.806124 19143 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.812182 19262 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.790398 16882 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:19:24.833556 17491 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.15.90.62:35161, user_credentials={real_user=slave}} blocked reactor thread for 52386.3us
I20260709 13:19:24.835763 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:24.836367 16803 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.843281 19189 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:24.843638 16803 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
W20260709 13:19:24.829197 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 60731.6us
I20260709 13:19:24.845674 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:24.848254 16707 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58326 (request call id 272) took 10936 ms. Trace:
I20260709 13:19:24.848702 16954 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:24.829523 16802 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:24.850263 16806 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:24.843724 19189 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:24.852896 19189 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.853832 16956 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:24.854307 19189 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.854688 19303 raft_consensus.cc:3055] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:24.855159 19303 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:24.856225 19303 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.861125 19262 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.864462 19238 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:24.864986 19238 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:24.865742 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:24.874946 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:24.848615 16707 rpcz_store.cc:276] 0709 13:19:13.912580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.912871 (+   291us) service_pool.cc:224] Handling call
0709 13:19:24.848058 (+10935187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":255816,"reported_tablets":13}
I20260709 13:19:24.875082 18990 raft_consensus.cc:3055] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:24.877396 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.878052 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:24.878966 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.877368 18990 raft_consensus.cc:740] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:24.880722 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.880676 18990 consensus_queue.cc:260] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.881331 16879 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.881923 18990 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:24.884004 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.884341 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:24.884544 16884 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.884052 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:24.885665 16876 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:24.887612 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:24.885766 16877 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:24.875661 16882 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:24.865798 19238 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:24.901150 16951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:24.901880 16951 raft_consensus.cc:606] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:24.902226 16951 raft_consensus.cc:614] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:24.908457 16802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:19:24.899869 16877 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:24.909008 16802 raft_consensus.cc:606] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:24.912345 16951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:24.912987 16951 raft_consensus.cc:606] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:24.919466 16951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:24.829088 19307 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.922178 19307 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.771552 19216 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.925380 19216 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:24.932920 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 52583.3us
I20260709 13:19:24.934573 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:24.937258 19308 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:24.937721 19308 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.938156 19308 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:24.943856 19237 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:24.946297 19237 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:24.950263 16956 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:19:24.958959 19091 raft_consensus.cc:993] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:19:24.959522 19143 raft_consensus.cc:1081] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:19:24.961484 17522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44636
I20260709 13:19:24.962275 17522 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:24.962714 17522 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:24.749909 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:24.964623 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 214760us
I20260709 13:19:24.964924 19091 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:24.965483 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:24.965637 19091 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:24.968240 19091 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:24.968374 16884 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:24.974306 17526 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
W20260709 13:19:24.994334 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.007272 19054 raft_consensus.cc:697] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:19:25.009295 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 286534us
I20260709 13:19:25.012794 19361 consensus_queue.cc:1059] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:25.013759 19148 raft_consensus.cc:3055] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:25.014138 19148 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:19:25.014426 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 215218us
I20260709 13:19:25.015005 19148 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.016696 19053 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:25.018342 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:25.018622 19054 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:25.022526 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 57142.9us
I20260709 13:19:25.023404 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:24.973438 16879 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
W20260709 13:19:25.032083 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.032334 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:25.035966 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:25.036475 17523 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:25.037326 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:25.038712 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:25.040096 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:25.028493 18990 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:25.042407 18990 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:25.042884 18990 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:25.047362 16956 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:25.054165 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:25.055555 16951 raft_consensus.cc:606] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:25.060503 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:25.048668 19148 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:25.024457 19143 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:25.073791 16954 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:25.077551 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:25.082536 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:25.077622 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.061868 19207 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:25.099505 16922 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:25.064512 18993 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:25.108482 16804 raft_consensus.cc:1240] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:25.109476 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 49035.6us
W20260709 13:19:25.113051 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.114326 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:25.079243 18985 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:25.116695 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:25.116739 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:25.118240 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:25.104926 19207 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:25.094961 19262 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:25.122146 16848 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.125218 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:25.138278 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.111424 18993 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:25.079336 18987 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:19:25.119208 19187 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.139685 19319 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.151790 19319 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.153712 19319 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.154224 19356 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.154994 19216 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:25.158951 19238 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:25.159524 19238 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:25.160346 19238 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.161351 16806 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:25.161687 18990 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.162770 16807 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
W20260709 13:19:25.145355 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 69789.7us
I20260709 13:19:25.120765 19091 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:25.115620 19086 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.146294 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:25.119644 19332 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:25.136134 19207 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:25.125279 19303 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:25.124547 19143 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:25.144244 19259 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:25.149047 19035 raft_consensus.cc:2955] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:25.122092 18985 raft_consensus.cc:697] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:25.161314 17521 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
W20260709 13:19:25.145316 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 45920.9us
I20260709 13:19:25.144940 18993 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.147558 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.125438 19352 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.101716 19260 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:19:25.129320 19307 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:25.165015 19091 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:25.193745 16848 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.174844 19143 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.208425 17527 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:19:25.208751 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 61276.8us
I20260709 13:19:25.208889 18985 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.209587 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:25.210464 19372 log.cc:927] Time spent T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:19:25.211025 19353 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:25.164752 19262 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.180586 19332 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:25.189949 19216 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.200131 19091 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.230357 17520 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:25.226706 19308 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.241425 16807 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:25.243762 16704 catalog_manager.cc:5697] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.246205 19237 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.246874 19237 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:25.247419 19356 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:25.247339 19237 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.247911 19356 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.248327 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:25.249375 19237 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.249879 19356 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.249634 19332 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.250144 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:25.250474 16956 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:25.250876 16885 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:25.189845 19352 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.251982 16879 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:25.252887 19351 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:25.253116 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 75807.5us
I20260709 13:19:25.253291 19352 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.253891 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.254242 16807 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:25.255200 19351 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:25.258704 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:25.211629 19353 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.245653 16704 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 3 to 4, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 4 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:25.179982 19086 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.260723 16807 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:25.261564 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.258826 18990 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:25.262928 16878 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:25.259985 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:25.270164 16806 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:25.273401 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:25.275833 16704 catalog_manager.cc:5697] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.205233 19307 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.280082 18542 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:25.247836 19258 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:25.227834 19187 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:19:25.287611 19237 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.290129 19356 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:25.226516 17522 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.278344 19216 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 13:19:25.358534 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 177715us
I20260709 13:19:25.353466 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:25.369982 17519 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:25.372704 19307 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.381332 19353 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:25.382310 19207 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.382949 17522 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.361181 19258 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.385056 16954 raft_consensus.cc:2368] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7.
I20260709 13:19:25.362928 19356 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:19:25.392441 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.393535 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.365532 19308 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.361585 19237 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.412130 19366 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:25.418118 19359 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.291s	user 0.002s	sys 0.000s
I20260709 13:19:25.420459 19086 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.430616 19366 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:25.431161 19366 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.432803 16704 catalog_manager.cc:5697] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:25.415341 19148 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:25.437188 17492 leader_election.cc:400] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7.
I20260709 13:19:25.437572 17492 leader_election.cc:403] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:19:25.443473 19361 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7.
I20260709 13:19:25.450573 19262 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:25.435220 16704 catalog_manager.cc:5697] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 2 to 4, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 4 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.453682 16704 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:25.456696 19237 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.457985 18993 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.459451 19148 consensus_queue.cc:1059] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:25.461545 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:25.462617 17520 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:25.467597 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:25.467983 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:25.535203 19237 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.540118 19237 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.542192 19237 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.536310 16884 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:25.469228 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:25.469182 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:25.544009 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:25.545102 17523 raft_consensus.cc:2393] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:25.428159 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:25.474799 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:25.489033 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 253641us
I20260709 13:19:25.546016 16954 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
W20260709 13:19:25.545971 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 117931us
I20260709 13:19:25.548894 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:25.550082 16957 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:25.552729 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:25.551620 16882 raft_consensus.cc:2955] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:25.558359 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:25.552345 19237 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:25.574819 19154 tablet_copy_client.cc:538] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:19:25.592875 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 331338us
I20260709 13:19:25.609341 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.610649 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:25.590530 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:25.593367 19381 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:19:25.613296 19388 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:25.616520 16922 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:25.624274 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.626557 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:25.572957 19014 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:25.630752 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.556198 19265 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:19:25.631561 18542 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:25.642087 16775 leader_election.cc:400] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7.
I20260709 13:19:25.642522 16775 leader_election.cc:403] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:19:25.642650 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:25.643465 16808 raft_consensus.cc:3055] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:25.643844 16808 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:25.572846 19383 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:25.577749 19207 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:25.593647 19332 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.593609 19132 consensus_queue.cc:1059] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:19:25.647022 17527 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:25.571842 19054 consensus_queue.cc:1059] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:19:25.573319 19148 consensus_queue.cc:1059] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:19:25.657758 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:25.641175 18987 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:25.646961 19086 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.646168 19265 consensus_queue.cc:1243] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:25.651618 16704 catalog_manager.cc:5697] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 4 to 5, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 5 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.587904 18981 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:25.591234 19238 consensus_queue.cc:1059] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:19:25.614615 19143 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.630132 19237 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:25.650628 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:25.659600 19376 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:25.659409 19014 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.652032 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.591739 19356 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.660920 19258 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.691179 16775 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:25.692816 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.661041 19383 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.673820 19207 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:25.695217 16704 catalog_manager.cc:5697] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:25.707098 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 90671.8us
I20260709 13:19:25.725498 16922 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:25.735522 19375 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:25.736207 19375 raft_consensus.cc:697] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:25.737130 19375 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.738023 19053 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:25.660938 19332 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.753144 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:25.687721 17523 raft_consensus.cc:2955] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:25.750898 18993 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.763281 19381 raft_consensus.cc:3055] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:25.763739 19381 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:25.764016 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:25.764639 19381 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.765985 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:25.766774 16809 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:25.767866 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:25.768465 16803 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:25.768978 16807 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:25.770200 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:25.771078 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:25.771592 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:25.772487 16804 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:25.701372 19237 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.774863 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:25.775718 16802 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:25.703382 19380 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:25.776901 19380 raft_consensus.cc:697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:25.777822 19380 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.675839 18981 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.780596 19014 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:25.781358 18981 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:25.781927 19054 raft_consensus.cc:3055] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:25.782313 19054 raft_consensus.cc:740] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:25.783052 16808 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.783107 19054 consensus_queue.cc:260] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:25.784153 16808 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.784477 19054 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:25.785392 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:25.753422 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:25.771759 16805 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
W20260709 13:19:25.735513 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 97784.3us
I20260709 13:19:25.699813 18985 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:25.722877 19086 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:25.700887 19143 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.803226 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:25.801409 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:25.806996 16810 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:25.733968 16704 catalog_manager.cc:5697] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:25.820292 16806 raft_consensus.cc:2393] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:25.751096 19207 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:25.801196 19400 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:19:25.741200 19091 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:25.751906 19395 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:19:25.821193 16951 pending_rounds.cc:85] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 5
W20260709 13:19:25.840888 16922 consensus_peers.cc:597] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.983904 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 161758us
I20260709 13:19:25.881783 16808 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:25.982074 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:25.986483 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:25.982662 16951 pending_rounds.cc:107] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:19:25.989212 16951 raft_consensus.cc:2889] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:25.839843 16704 catalog_manager.cc:5697] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
W20260709 13:19:25.857846 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.990521 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:25.991340 17525 raft_consensus.cc:2393] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:25.984179 19381 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:25.994791 16704 catalog_manager.cc:5697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 3 to 4, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 4 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:25.951125 19383 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:25.821455 19014 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:25.952417 19332 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:25.820324 18985 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:25.994889 19356 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:25.992624 19403 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:26.005333 19189 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:19:26.007615 19376 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7.
I20260709 13:19:26.028558 19259 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:25.983610 17520 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:19:26.019166 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:26.055709 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:25.820931 18981 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.181s
I20260709 13:19:25.888137 19366 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.002375 19405 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:26.025622 19091 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.007761 19237 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:26.017663 19353 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:26.056934 19259 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.060362 19132 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:26.052254 19403 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:26.048689 19356 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:26.085492 19411 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:19:26.079089 19406 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:26.075961 19132 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:26.075649 19353 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.102941 18985 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:26.107641 19407 log.cc:927] Time spent T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:26.065017 19207 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.107548 19132 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:26.111063 19350 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.565s	user 0.000s	sys 0.002s
I20260709 13:19:26.112233 19406 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.099408 19403 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:26.127115 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 75133.3us
I20260709 13:19:26.114364 19353 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.071873 19237 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.137168 19356 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.142076 19406 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:26.152529 19154 tablet_bootstrap.cc:492] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:19:26.153712 19360 raft_consensus.cc:3055] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:26.154106 19360 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:26.154959 19360 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.168785 16883 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:19:26.148608 19353 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:26.169528 16877 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:26.172060 19361 raft_consensus.cc:3055] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:26.172479 19361 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:26.173270 19361 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.174299 19361 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:26.176102 19360 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:26.176241 19366 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:26.169170 16883 pending_rounds.cc:85] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 3
I20260709 13:19:26.180013 16883 pending_rounds.cc:107] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:19:26.180275 16883 raft_consensus.cc:2889] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:26.180749 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:26.166026 19132 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:26.188387 16879 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 13:19:26.190502 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:26.191229 16810 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:26.192296 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:26.193408 16848 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:26.193584 19259 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:26.237205 18542 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:26.369628 18542 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.369999 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:26.370345 16884 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:26.193449 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:26.371080 16881 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:26.263312 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:26.372117 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 191385us
I20260709 13:19:26.193938 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:26.373176 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:26.373819 16806 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
I20260709 13:19:26.372380 16876 raft_consensus.cc:2393] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:26.306967 19413 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:19:26.179853 19258 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:26.312235 19417 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
W20260709 13:19:26.325852 19412 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:19:26.193692 19307 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:26.383903 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.325908 18987 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:26.232986 19091 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:26.233454 19332 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:26.186033 19308 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.195s
I20260709 13:19:26.184890 19353 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:26.394542 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 338278us
I20260709 13:19:26.408332 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:26.394462 19307 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.417035 16806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:19:26.417593 16806 raft_consensus.cc:606] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:26.417917 16806 raft_consensus.cc:614] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:26.420019 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 226663us
I20260709 13:19:26.386047 19258 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.396850 19425 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:26.460279 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:26.466315 16806 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:26.395076 19091 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.394882 18987 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.459810 19425 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.472164 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:26.419351 19237 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.474346 16802 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:26.399272 19332 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:26.476442 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 68180us
I20260709 13:19:26.477591 16804 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:19:26.480796 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.481191 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:26.466070 19395 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.483558 16807 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:26.485455 16806 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:19:26.488626 19431 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:26.490600 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:26.428006 19307 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.470506 19430 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:26.493559 16804 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:26.491580 19395 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.498152 19395 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.489187 19431 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.501332 16807 raft_consensus.cc:1240] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:26.502818 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 81921.1us
I20260709 13:19:26.503872 16848 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:26.492151 19237 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.491816 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:26.492671 19308 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:26.511327 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:26.512251 16804 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:26.514364 19425 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:26.515731 18987 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:26.510656 19237 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.518823 19237 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:26.523864 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:26.525650 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:26.502452 19353 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.533068 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:26.503180 19431 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:26.536901 16807 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:26.537565 19425 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:26.551234 19425 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:26.551630 19425 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:26.552109 19405 raft_consensus.cc:697] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:26.553004 19405 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:26.537848 19423 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:19:26.538219 19237 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:26.545910 18542 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.509243 19430 raft_consensus.cc:697] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:26.557874 19364 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:26.557593 19430 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.558380 19364 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.560405 19360 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.560904 19360 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.510165 19308 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:26.550611 19091 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.563323 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.574693 16958 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:26.564291 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.566409 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:26.569350 16881 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:26.576508 16953 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:19:26.577001 16953 pending_rounds.cc:85] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 3
I20260709 13:19:26.577229 16953 pending_rounds.cc:107] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:26.577427 16953 raft_consensus.cc:2889] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:26.523903 19433 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:26.578866 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:26.579128 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.579139 16957 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:26.580482 16956 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:26.582856 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:26.596017 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.596599 16958 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:26.571987 19308 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:26.606729 19437 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:26.606328 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 115810us
I20260709 13:19:26.560436 19364 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.613083 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:26.580637 19433 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:26.605216 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.615448 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:26.617262 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:26.612157 19091 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.622220 19259 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.625483 19434 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:26.625975 19436 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:26.626343 19307 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.618640 19237 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:26.626837 19258 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:26.628562 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.622550 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:26.615291 19437 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.637589 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:26.909271 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:26.881731 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:26.910111 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:26.699286 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:26.655182 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:26.911345 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:26.701117 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:26.661398 18542 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:26.914521 18542 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.616979 19433 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:26.656142 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:26.655121 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:26.911458 16884 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:26.920743 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:26.921264 16884 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:26.923707 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:26.924469 16883 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:26.931267 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34330 (request call id 1778) took 1271 ms. Trace:
W20260709 13:19:26.934525 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:26.934891 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:26.931716 16954 rpcz_store.cc:276] 0709 13:19:25.645432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:25.648245 (+  2813us) service_pool.cc:224] Handling call
0709 13:19:25.658452 (+ 10207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:25.789114 (+130662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:25.789159 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:25.789213 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:25.789259 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.916336 (+1127077us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002085d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:26.916382 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:26.916487 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299924352}
I20260709 13:19:26.811579 19404 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:26.936277 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:26.941300 16879 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:26.721247 19265 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.945793 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.638356 19054 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.742085 19143 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:26.953840 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:26.954838 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:26.944841 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:26.945393 16884 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:26.910359 19237 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:26.690662 19361 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:26.946365 16955 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:26.700670 19353 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.908605 19360 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:26.959214 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:26.963022 16879 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
W20260709 13:19:26.946930 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 443136us
W20260709 13:19:26.931854 19132 consensus_meta.cc:287] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.736s	user 0.000s	sys 0.011s
I20260709 13:19:26.948096 16880 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:26.835965 19419 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:26.917104 19356 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.950016 16883 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:26.915733 19436 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:26.922780 19258 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.959988 18542 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.964459 16848 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:26.656378 19425 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.965193 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:26.655566 19259 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.985801 19259 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:26.986119 19425 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.987861 19425 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.988476 19425 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.658818 19431 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.991954 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.992583 16954 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:26.993165 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.959293 19307 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:26.994702 19187 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:26.959522 19237 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.013072 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:26.964107 19353 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.014685 18542 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.043905 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:27.045861 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.638281 19091 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:27.015172 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 50040us
I20260709 13:19:26.969213 19430 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:26.659981 19434 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:27.016183 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 51827.9us
I20260709 13:19:26.965461 19395 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:27.014389 19307 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:27.001518 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.028005 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.991035 19425 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:26.975533 16805 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:26.966830 19376 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:26.977087 19388 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.029543 16884 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:26.978309 19436 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:27.038041 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.959666 19143 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.957530 19054 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:26.953364 19265 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.082613 19437 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:26.978523 19360 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:26.959865 19380 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:27.015786 19303 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:27.046445 16956 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:27.046756 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.947734 19404 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.047027 18542 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.046056 16801 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:27.048465 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:26.995592 19258 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:26.991570 19356 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:27.087741 19444 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:19:26.993760 19419 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.056303 16959 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:27.057277 16954 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:27.059237 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.062356 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:27.034374 19187 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.069721 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.070888 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:27.056589 19307 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:27.055202 19395 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:27.073559 19441 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
I20260709 13:19:27.073659 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:27.074174 19400 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.075757 19438 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:27.080178 19319 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:27.081143 19054 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:27.080192 17520 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:27.056449 19455 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.091640 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:27.085546 19360 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.067801 19425 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:27.099869 16803 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:27.053002 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.083734 19364 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:27.089762 19448 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:27.084509 19265 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:27.085634 19428 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:27.089253 19434 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.111826 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:27.185350 16801 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:27.182119 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:27.186403 19454 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:27.186654 19439 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.186961 19454 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.187112 19439 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.100737 19303 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.157063 16802 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:27.089129 19451 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:27.163143 16876 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:27.112905 18542 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.084594 19376 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.103786 19437 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:27.072642 19388 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.159593 19395 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:27.173413 19438 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:27.197435 19434 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:27.254715 19434 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.256984 19434 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:27.257364 19454 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:27.257987 19427 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.787s	user 0.004s	sys 0.000s
I20260709 13:19:27.196524 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 755) took 1148 ms. Trace:
W20260709 13:19:27.188444 19461 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:19:27.258529 17521 rpcz_store.cc:276] 0709 13:19:26.048509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.055614 (+  7105us) service_pool.cc:224] Handling call
0709 13:19:26.060077 (+  4463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:26.551392 (+491315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:26.551424 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:26.561253 (+  9829us) log.cc:844] Serialized 26 byte log entry
0709 13:19:26.794434 (+233181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:26.806049 (+ 11615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:26.835420 (+ 29371us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:27.196307 (+360887us) raft_consensus.cc:1685] finished
0709 13:19:27.196324 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.196446 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":490895,"raft.queue_time_us":491439,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":182503,"threads_started":1,"wal-append.queue_time_us":397776}
W20260709 13:19:27.196798 19445 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:19:27.261696 19376 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:27.198330 19424 log.cc:927] Time spent T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.806s	user 0.005s	sys 0.000s
W20260709 13:19:27.189321 19452 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:19:27.183583 19054 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.184935 19428 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.254057 19303 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.192938 19404 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.195844 19431 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.188614 19440 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:27.197059 19258 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.192540 19353 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:27.173673 19400 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:27.280791 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 228273us
I20260709 13:19:27.185564 19364 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.285517 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1377) took 1086 ms. Trace:
I20260709 13:19:27.177959 19455 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.264117 19438 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:27.273561 19388 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.277546 19428 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.213594 19451 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.280687 19091 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.291010 16885 rpcz_store.cc:276] 0709 13:19:26.191313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.232441 (+ 41128us) service_pool.cc:224] Handling call
0709 13:19:26.380767 (+148326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:26.381022 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:26.480899 (+ 99877us) log.cc:844] Serialized 14 byte log entry
0709 13:19:27.276752 (+795853us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.276815 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:27.276900 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.277816 (+   916us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.277960 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6000,"prepare.queue_time_us":121609,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":39,"raft.queue_time_us":73103,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":11813,"thread_start_us":875234,"threads_started":3,"wal-append.queue_time_us":510535}
I20260709 13:19:27.282255 19404 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:27.217521 19437 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.285012 19430 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:27.282806 19467 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:27.285597 19303 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:27.281863 19440 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.317687 16809 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:27.285451 16848 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:27.282804 19054 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.318346 19361 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:19:27.351017 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 65659us
I20260709 13:19:27.349623 19467 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.362190 19467 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.352304 19431 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:27.364043 19431 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:27.366801 19308 consensus_meta.cc:287] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.748s	user 0.006s	sys 0.003s
I20260709 13:19:27.369660 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:27.370323 17521 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:27.371523 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:27.373225 19440 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.374946 19307 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.375800 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:27.376804 17525 raft_consensus.cc:2410] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:19:27.376827 19431 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.377427 19431 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.377735 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:27.378933 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:27.379413 19431 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.380002 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:27.380676 17521 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:27.350174 19303 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.382684 19237 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.344139 19418 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.388846 16882 raft_consensus.cc:2393] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:27.390841 16848 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
W20260709 13:19:27.357311 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.395149 16848 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:27.395967 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.367223 19308 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.359079 19361 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:27.402633 17519 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:19:27.401875 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:27.354827 19455 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:27.415757 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.335554 19404 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.445647 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.424017 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.386809 19053 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.447314 16950 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.385823 19187 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.448588 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:27.449252 16880 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:27.392791 19353 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:27.450531 19353 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:27.448470 19053 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.451388 16877 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:27.390470 19439 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.457453 16881 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:27.389997 19265 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:19:27.464833 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.467310 16884 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:19:27.467772 16884 pending_rounds.cc:85] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 3
I20260709 13:19:27.468030 16884 pending_rounds.cc:107] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:27.468315 16884 raft_consensus.cc:2889] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:27.393571 19303 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.443320 19360 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.393287 19381 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:27.456566 19353 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.402081 19258 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:27.396246 19356 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.401081 19418 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.517184 17523 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:27.504318 19258 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:27.509739 19403 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.532790 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:27.538291 19473 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:27.538686 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:27.539418 19473 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:27.540036 19473 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:27.519170 19365 raft_consensus.cc:3055] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:27.495625 19381 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.544348 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:27.470165 19430 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.548069 18542 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:27.551985 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.553346 16953 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:27.530511 19258 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.555634 19376 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.545315 19365 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:27.556550 19376 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.557391 19365 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.559370 19365 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:27.564239 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:27.565279 19418 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.548601 19468 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:27.566385 19468 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:27.569444 19468 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.574183 19404 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.579243 19308 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:27.582326 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.543556 19400 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:27.584699 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.587615 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.541787 19403 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.113514 16953 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:27.617126 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.653048 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:27.953881 16950 consensus_meta.cc:287] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.002s
I20260709 13:19:28.115459 16950 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:19:27.639732 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.116827 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:27.637182 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:27.831014 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.117111 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1394) took 1022 ms. Trace:
I20260709 13:19:28.118144 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 1686) took 1375 ms. Trace:
I20260709 13:19:27.730924 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.119493 16809 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
W20260709 13:19:27.644498 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.637542 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:27.891664 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:27.638243 16808 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 13:19:27.582695 19465 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:19:28.118639 16876 rpcz_store.cc:276] 0709 13:19:26.742895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.936939 (+194044us) service_pool.cc:224] Handling call
0709 13:19:26.951282 (+ 14343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.207691 (+256409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.641224 (+433533us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54002f7454. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:28.118086 (+476862us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486302464}
I20260709 13:19:28.118346 16804 rpcz_store.cc:276] 0709 13:19:27.094290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.189237 (+ 94947us) service_pool.cc:224] Handling call
0709 13:19:27.206223 (+ 16986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.206416 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.206451 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.206503 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:27.206539 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:27.206602 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:27.645265 (+438663us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b5400188dd0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:28.117059 (+471794us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38306048}
I20260709 13:19:28.128645 16956 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 6: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:27.592166 19053 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:27.650271 19436 consensus_meta.cc:287] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.574s	user 0.003s	sys 0.007s
I20260709 13:19:28.129918 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 338) took 1168 ms. Trace:
I20260709 13:19:27.632396 19364 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.893992 18993 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:27.645958 19054 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.127518 19308 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.156152 19308 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.157094 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.157810 16809 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:28.158164 19308 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.158700 19308 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:27.647513 19381 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.149459 19332 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:27.589860 16951 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:28.139225 16803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 1615) took 1076 ms. Trace:
W20260709 13:19:27.624504 19476 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:28.160462 16803 rpcz_store.cc:276] 0709 13:19:27.052322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.052533 (+   211us) service_pool.cc:224] Handling call
0709 13:19:27.052865 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.174705 (+121840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.128194 (+953489us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b54003688d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:28.128345 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105196928}
W20260709 13:19:28.108600 19361 consensus_meta.cc:287] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.000s
W20260709 13:19:28.132947 16882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 1676) took 1485 ms (client timeout 1746 ms). Trace:
I20260709 13:19:28.161440 19361 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:28.161543 16882 rpcz_store.cc:269] 0709 13:19:26.630811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.630941 (+   130us) service_pool.cc:224] Handling call
0709 13:19:27.636183 (+1005242us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540041a5d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:28.116631 (+480448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072121728}
I20260709 13:19:28.148209 16881 rpcz_store.cc:276] 0709 13:19:26.959004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.978536 (+ 19532us) service_pool.cc:224] Handling call
0709 13:19:28.127651 (+1149115us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54003f5054. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:28.127767 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":959863040}
I20260709 13:19:28.163545 19361 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:27.647850 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.166425 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:27.958767 19438 consensus_meta.cc:287] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.643s	user 0.004s	sys 0.005s
I20260709 13:19:28.168063 19438 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.169150 16805 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:28.170827 19154 tablet_bootstrap.cc:492] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:19:28.171886 19154 tablet_bootstrap.cc:492] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:19:28.172257 19437 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.172665 19154 ts_tablet_manager.cc:1403] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 2.042s	user 0.021s	sys 0.054s
I20260709 13:19:28.080639 19400 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:28.151320 16959 raft_consensus.cc:2410] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:19:28.173278 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1392) took 1086 ms. Trace:
I20260709 13:19:27.584267 19365 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:27.585585 19433 consensus_meta.cc:287] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.647s	user 0.006s	sys 0.004s
I20260709 13:19:27.636725 19460 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.152725 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:27.734202 19395 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:27.653858 19451 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.181756 19365 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.155956 18993 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.152853 19436 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.159373 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:27.731359 19463 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:27.628005 19307 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:27.721026 19405 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:28.166726 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.150678 19447 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 1.117s	user 0.003s	sys 0.013s
I20260709 13:19:28.152228 19403 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:28.150447 18987 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:28.159137 19308 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.152132 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.201661 16802 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
W20260709 13:19:28.134263 19258 consensus_meta.cc:287] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.549s	user 0.014s	sys 0.001s
I20260709 13:19:28.180006 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:27.642867 19086 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.739260 19132 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.738284 19375 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.880489 19404 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.178514 16808 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:28.173764 16801 rpcz_store.cc:276] 0709 13:19:27.087006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.188720 (+101714us) service_pool.cc:224] Handling call
0709 13:19:27.188936 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.262353 (+ 73417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:27.262388 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:27.262428 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:27.262463 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.172995 (+910532us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b5400099cd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:28.173056 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:28.173214 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168433920}
I20260709 13:19:28.181278 19437 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:19:28.156061 19054 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.185379 18993 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.186740 19436 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.213390 19308 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:28.200169 19428 consensus_meta.cc:287] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.875s	user 0.006s	sys 0.005s
I20260709 13:19:28.182539 19332 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:28.200560 19353 consensus_meta.cc:287] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.690s	user 0.005s	sys 0.003s
I20260709 13:19:28.185173 19365 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:28.233244 19086 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.241951 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:28.200930 19361 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:28.214259 19258 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.181877 19433 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.214708 19364 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:28.243496 19053 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.182819 19400 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.245123 19428 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.243312 19403 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:28.199985 19405 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.193939 19460 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:28.258067 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.236505 19132 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.260533 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.238624 19404 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.199884 19463 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.238387 19375 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.267381 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:28.280097 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:28.281078 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.281030 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:28.263517 19436 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.283360 19438 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.283152 19436 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.284973 16850 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:28.243993 19054 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.256984 18993 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.286123 16807 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:28.246461 19332 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.253726 19361 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.285305 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.248510 19353 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.296752 19353 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.297323 19353 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:28.257393 19053 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:28.286521 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 168001us
I20260709 13:19:28.290071 19458 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:28.292908 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.289619 16924 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:28.283849 19429 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:28.279904 19307 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.256760 19364 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.292739 16955 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:28.301537 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.311278 16924 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:28.302783 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.291800 19086 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.292146 19437 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:28.264213 19403 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.315062 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.316074 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.312415 16956 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:28.320518 16954 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:28.317836 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.306031 19458 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.307644 19429 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.330768 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.317265 19365 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:28.334537 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:28.331552 16956 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:28.342154 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:28.298347 18993 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:28.316875 19381 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:19:28.331025 19458 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:28.331470 19429 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.359599 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.362903 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.364430 16956 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:28.348591 19437 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.367758 19437 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.368142 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 757) took 1809 ms. Trace:
I20260709 13:19:28.368530 17520 rpcz_store.cc:276] 0709 13:19:26.559194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.576378 (+ 17184us) service_pool.cc:224] Handling call
0709 13:19:26.943173 (+366795us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800011198. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:26.943349 (+   176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:27.171625 (+228276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:28.367898 (+1196273us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540057e754. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:28.368074 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316351616}
I20260709 13:19:28.369853 19437 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.371383 19143 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.378166 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:28.332707 19395 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.396665 16954 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:28.405637 16958 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:28.314163 19307 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.407534 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.417701 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:28.421310 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:28.421730 19143 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:28.422143 17527 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:19:28.422186 17525 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
I20260709 13:19:28.422701 17527 pending_rounds.cc:85] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 5
I20260709 13:19:28.423018 17527 pending_rounds.cc:107] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:19:28.423280 17527 raft_consensus.cc:2889] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.424330 16773 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:28.425616 19143 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:28.429214 16956 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:19:28.430879 19404 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:28.431546 16957 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:19:28.431960 16957 pending_rounds.cc:85] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 3
I20260709 13:19:28.432188 16957 pending_rounds.cc:107] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:28.432211 19258 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.432483 16957 raft_consensus.cc:2889] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:28.356786 19487 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:19:28.384425 19488 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:28.434741 19237 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.434808 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:28.436388 17519 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
W20260709 13:19:28.438905 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 180506us
I20260709 13:19:28.444384 16773 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:28.447499 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 156597us
W20260709 13:19:28.448321 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 215813us
W20260709 13:19:28.447997 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 136805us
I20260709 13:19:28.451252 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.451485 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.444418 19258 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.472582 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:28.472745 16878 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:28.473222 16801 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:28.472843 19258 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.447505 19405 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.484308 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.485494 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.485582 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.485690 16804 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:28.452297 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.485488 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:28.488036 19497 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:28.488395 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.488519 19497 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:28.488976 19497 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.489499 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.490095 16880 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:28.491357 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.491958 16880 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:28.492093 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:28.492983 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.494357 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.495131 16880 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 2.
I20260709 13:19:28.496099 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.496232 19496 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:28.496924 16880 raft_consensus.cc:2393] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:28.496826 19496 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.497522 19496 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:28.462567 16773 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:28.498347 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.486346 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.441581 19490 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:28.499096 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.448832 19187 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:28.504739 19187 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:28.505172 19187 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:28.505270 19364 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.504837 19490 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.506889 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.507356 19490 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:28.507493 16879 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:28.448971 19428 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.508278 16885 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:28.513300 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.514232 16802 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:28.508396 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.515352 16808 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:28.511984 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.516412 16803 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:28.501044 16884 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:28.516933 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:28.501513 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:28.518106 16810 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.488534 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:28.524960 19498 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:28.525594 19498 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.498271 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.526028 19498 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:28.526296 16880 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:28.531865 19388 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.532760 19388 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:28.533835 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 45392.9us
I20260709 13:19:28.536397 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:28.544173 18987 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:28.510035 19319 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:28.473793 19488 consensus_queue.cc:1059] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:19:28.554630 19319 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.555558 16881 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:28.498611 19485 consensus_queue.cc:1059] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:19:28.464218 19375 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:28.560350 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.480221 19438 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:28.498871 19436 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.451990 19433 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.558537 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.561210 16808 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:28.480994 19460 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.563966 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.565006 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.560164 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.571874 16804 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:28.571976 16883 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:28.539003 19388 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:28.567811 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 66386.9us
I20260709 13:19:28.557410 19319 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.578680 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:28.580622 19433 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:28.580752 16809 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:28.581830 19258 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.583043 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:28.584093 19425 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:28.585937 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:28.586779 16806 raft_consensus.cc:2368] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:28.587608 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:28.588091 16850 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:28.589160 19258 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:28.591250 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:28.555797 19054 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.510962 19237 consensus_queue.cc:1059] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:19:28.592267 19258 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:28.592746 19237 raft_consensus.cc:3055] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:28.592845 19258 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.593231 19237 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:28.593482 19258 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:28.594162 19237 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.567423 19361 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.576623 19495 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:28.596733 18993 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.597548 19400 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:28.597681 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.598451 16803 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:28.599895 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:28.601449 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:28.464417 19091 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:19:28.503515 19487 consensus_queue.cc:1059] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:19:28.595388 19237 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.584820 19154 raft_consensus.cc:359] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.607448 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.558704 19463 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:28.561923 19332 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.608500 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:28.652634 16955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 1798) took 1069 ms. Trace:
I20260709 13:19:28.723850 16804 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.648077 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:28.725322 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:28.718992 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:28.616854 16810 raft_consensus.cc:2410] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:28.729386 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:28.714795 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:28.660840 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.743947 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:28.705647 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 122695us
I20260709 13:19:28.628970 16806 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:28.610528 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.724331 16955 rpcz_store.cc:276] 0709 13:19:27.583344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.584150 (+   806us) service_pool.cc:224] Handling call
0709 13:19:28.652457 (+1068307us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540032bed4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:28.652554 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409037568}
I20260709 13:19:28.654331 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:28.747848 16882 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:28.751325 17520 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:28.753213 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:28.753449 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 204625us
I20260709 13:19:28.753921 17520 raft_consensus.cc:2410] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:28.754112 16924 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:28.746757 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:28.746667 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.704231 19319 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.758258 19507 raft_consensus.cc:3055] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:28.758718 19507 raft_consensus.cc:740] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:28.758845 19187 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.721251 19388 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:28.763260 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:28.765278 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 313266us
I20260709 13:19:28.766978 17492 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:28.608330 19495 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:28.707801 19403 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:28.688122 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.576938 19440 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.647586 19419 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:28.765519 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:28.651101 19376 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.570885 19438 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.778720 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:28.611510 19433 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:28.783089 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:28.743126 18993 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.731986 19428 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.721285 19486 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.785238 16956 raft_consensus.cc:2410] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:28.652408 19053 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:28.777881 17492 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:28.750732 19436 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.636391 18987 raft_consensus.cc:697] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:28.792014 19187 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.793120 19307 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.750972 19463 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:28.647187 19497 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.799567 19433 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.776022 19395 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:28.784487 19361 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:28.781913 19487 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:28.784933 19460 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:28.839784 16809 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:28.655654 19429 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.789752 19495 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:19:28.862536 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 84748.6us
I20260709 13:19:28.608582 19451 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.179s
W20260709 13:19:28.866024 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 102925us
I20260709 13:19:28.782743 19054 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:19:28.775233 19504 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:19:28.759718 19507 consensus_queue.cc:260] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.788753 19388 consensus_queue.cc:1059] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:19:28.803462 19506 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:28.935931 19501 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:19:28.912290 19419 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:28.929610 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:28.928545 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:28.937212 16878 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:28.789857 19440 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.860955 19154 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:19:28.893082 19433 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:28.893188 19395 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:28.922020 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:28.804049 18993 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.803287 19428 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:28.923588 19361 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.927202 19460 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:28.816644 19486 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:29.001371 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 233928us
I20260709 13:19:28.959869 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:28.956856 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:29.002736 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 45944.9us
I20260709 13:19:28.964309 19187 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:28.949605 19506 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.903402 19463 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.969506 19507 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:28.858819 19436 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:28.956156 19419 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:28.930428 19437 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:28.968825 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.025681 16876 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:28.964534 19404 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:29.005268 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 112726us
I20260709 13:19:29.005903 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:29.032521 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:29.033957 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.036762 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.006704 19511 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:28.726405 19259 raft_consensus.cc:2955] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:19:28.990995 19505 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:29.009672 19187 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.096684 19463 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:28.995985 19395 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.097759 19400 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:29.019210 17492 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:29.098279 19400 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.098663 19364 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:29.098795 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 79651.4us
I20260709 13:19:29.015794 19500 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:19:29.099192 19364 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:29.099645 19364 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:29.020149 16801 consensus_meta.cc:287] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.005s
I20260709 13:19:29.100878 16801 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:29.002275 19361 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.001487 19460 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:29.115916 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:29.122869 16804 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:29.124485 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:29.028926 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 244817us
I20260709 13:19:29.009701 19509 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:29.038869 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.128840 16802 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:29.039959 19429 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.039789 19495 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.040548 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.041647 19488 raft_consensus.cc:3055] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:29.042652 19458 consensus_meta.cc:287] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.614s	user 0.004s	sys 0.005s
I20260709 13:19:29.024767 19419 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.043802 19332 raft_consensus.cc:3055] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:29.045953 19437 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:29.047411 19496 consensus_meta.cc:287] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.001s
I20260709 13:19:29.047631 18993 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.130923 19509 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.004987 18987 consensus_queue.cc:237] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.049077 19486 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.050385 19497 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:29.051589 19381 raft_consensus.cc:3055] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:29.030901 19054 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:29.051805 19428 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.052312 19504 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:29.155031 19504 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.053134 19440 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:29.053311 16806 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:29.053980 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.054911 16808 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:19:29.055904 16805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 1618) took 1993 ms (client timeout 1725 ms). Trace:
W20260709 13:19:29.066185 19498 consensus_meta.cc:287] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.001s
I20260709 13:19:29.020926 19154 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:29.069308 19258 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.075968 16950 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
W20260709 13:19:29.077706 16951 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 220) took 1680 ms (client timeout 1698 ms). Trace:
I20260709 13:19:29.080636 19132 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:29.081940 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.082955 16883 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:29.083127 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.083585 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.083992 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:29.165326 16951 rpcz_store.cc:269] 0709 13:19:27.396983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.397127 (+   144us) service_pool.cc:224] Handling call
0709 13:19:29.077456 (+1680329us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540030a7d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:29.077618 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330050304}
I20260709 13:19:29.168522 16880 raft_consensus.cc:2410] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:19:29.084776 19503 log.cc:927] Time spent T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.379s	user 0.004s	sys 0.008s
I20260709 13:19:29.148466 19381 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:29.085740 19459 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:29.174212 19459 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.174644 19459 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.139024 19458 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:29.085948 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 53482.8us
I20260709 13:19:29.177192 19458 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.177479 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.179862 19428 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:29.089589 19433 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.142220 19496 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.013571 19506 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:29.159129 16805 rpcz_store.cc:269] 0709 13:19:27.062281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.073399 (+ 11118us) service_pool.cc:224] Handling call
0709 13:19:29.055721 (+1982322us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000d7fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:29.055823 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301012736}
I20260709 13:19:29.127833 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.165951 19498 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.196007 16957 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
W20260709 13:19:29.133162 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.197574 19498 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:29.134649 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:29.199229 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:29.200610 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:29.135336 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:29.202061 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:29.202332 19437 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:29.133347 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.124688 19500 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:29.204109 19500 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.204561 19500 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.137827 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.159286 19054 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.140359 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.208782 16809 raft_consensus.cc:2410] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:19:29.209547 19054 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.140588 19319 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:29.141333 16810 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:29.034761 19404 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.211573 19404 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.208003 16802 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:29.107406 19511 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:29.142995 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:29.048470 16924 connection.cc:256] RPC call timeout handler was delayed by -1.6613839460001145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:19:29.144299 17526 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 3.
W20260709 13:19:29.146293 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.132836 19488 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:29.147249 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.145179 19509 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.139544 19332 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:29.155434 19504 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:29.084870 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.096868 19187 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:29.179486 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.182235 16885 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:29.186540 19433 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.187299 19436 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:29.216511 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.217181 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:29.251529 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 72121.6us
I20260709 13:19:29.251829 16809 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:29.252322 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.241631 16876 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 2.
I20260709 13:19:29.255554 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.255945 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.257011 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:29.255592 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.257716 16952 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:29.258134 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.259027 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:29.259564 16957 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:29.259318 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.187078 19381 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.189795 19496 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.217821 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:29.235558 16924 connection.cc:256] RPC call timeout handler was delayed by -1.5542839459999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 13:19:29.265216 16924 connection.cc:256] RPC call timeout handler was delayed by -1.314643038999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:19:29.265674 16924 connection.cc:256] RPC call timeout handler was delayed by -1.0013954759999706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
I20260709 13:19:29.229846 16773 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:29.268460 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:29.269160 17526 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.269285 16924 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:29.270972 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.272069 16956 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:19:29.274039 19086 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:29.274657 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:29.267307 18993 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:29.338696 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.339603 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:29.341349 16955 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.340044 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.341974 16951 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:29.342386 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.342518 19086 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.343108 16806 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:29.342856 19332 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.344070 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:29.344172 19332 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:29.344583 16806 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.345642 19086 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:29.350628 19509 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.219587 19364 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.352788 18981 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:19:29.353389 18981 consensus_queue.cc:1243] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer 4b60b701acc7473e87e3e529a2a34689 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:29.354300 19364 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:29.340881 19438 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:29.342931 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.355309 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:29.358614 16810 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.356933 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.360356 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.357718 19500 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:29.362780 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 93568.9us
I20260709 13:19:29.357975 19375 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:29.363513 16924 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:29.364271 17526 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:29.364828 16957 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
W20260709 13:19:29.319175 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.287777 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.340899 17527 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:29.367627 16806 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:29.375025 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:29.373790 16810 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:29.377060 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:29.377584 16810 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.383316 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:29.384224 17526 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:29.385283 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:29.388401 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.216869 19258 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.397570 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.398576 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.399708 16880 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:29.242630 19498 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:29.401912 19054 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:29.402238 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.402777 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.341416 19381 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.410457 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:29.411283 17527 raft_consensus.cc:2410] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:19:29.412155 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.274372 19486 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:29.420107 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:29.232945 19511 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.422519 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.422654 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:29.423094 16876 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:29.423884 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.423884 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:29.406092 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.425064 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.405519 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.425597 16881 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:29.425971 16806 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:29.413305 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.248047 19429 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.145s
I20260709 13:19:29.418148 17519 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:19:29.390034 19520 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:19:29.397167 17521 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:29.452710 16850 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:29.453877 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.455085 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.456198 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:29.361550 19485 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:19:29.360248 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.424499 16877 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:29.369170 19365 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:29.215652 19395 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.428690 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.429567 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:29.418658 16810 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:29.432240 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:29.433560 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:29.421141 19498 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.429996 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:29.218261 19404 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.470522 16885 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:29.418552 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.447984 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.404963 18981 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:29.408998 19437 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.396557 18993 raft_consensus.cc:697] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:29.411725 19237 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:29.416960 19364 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:29.459460 19433 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:29.421895 19258 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:29.426662 19479 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:29.467849 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:29.267530 19319 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.140s
I20260709 13:19:29.486410 17526 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:29.471134 16956 raft_consensus.cc:2368] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:29.461055 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.411505 19400 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.494477 16806 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:29.501237 17525 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:29.526314 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:29.536655 16801 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:29.529945 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:29.525442 19361 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.436209 19490 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:19:29.527951 19486 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.462050 19436 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:29.471390 19459 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.530082 19258 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.461993 19496 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:29.465291 19440 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:29.497288 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.498261 19437 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.524724 16955 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:29.529932 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.565778 16951 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
W20260709 13:19:29.565908 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 104940us
I20260709 13:19:29.623332 16954 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:29.405414 19488 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:29.494884 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 76399.8us
I20260709 13:19:29.565644 19086 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.626214 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:29.631980 16850 leader_election.cc:400] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:29.633001 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.633049 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.576196 17520 raft_consensus.cc:2368] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:19:29.502038 17522 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:29.581775 16802 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:29.505898 19154 ts_tablet_manager.cc:1434] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 1.333s	user 0.011s	sys 0.043s
I20260709 13:19:29.500370 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.646745 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.607860 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:29.501767 19054 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.573371 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.516683 19509 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.563134 19433 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:29.518376 19500 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:29.518332 19419 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:29.628304 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 98442.9us
I20260709 13:19:29.628816 19429 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:29.629825 19488 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:29.630146 19512 consensus_queue.cc:1175] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b60b701acc7473e87e3e529a2a34689" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 3 } }
I20260709 13:19:29.578027 16801 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:29.660831 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:29.518788 19508 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:19:29.529102 19506 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.498203 19237 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.648392 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.651003 16806 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:29.615787 19436 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:29.916752 19436 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:29.529357 19479 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.618880 19496 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.631665 19440 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.630779 19513 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:29.650004 16848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 2.034s (SENT) [suppressed 5 similar messages]
W20260709 13:19:29.660774 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 52982.4us
I20260709 13:19:29.752815 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.756256 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.650529 19364 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:29.750643 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.684481 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:29.680323 19527 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:19:29.616783 19365 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:19:29.865854 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:29.650543 19425 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.931362 19438 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:29.647264 19154 ts_tablet_manager.cc:1467] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Tablet startup took 1474ms
I20260709 13:19:29.941636 19438 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.942169 19479 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:29.771975 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 125314us
I20260709 13:19:29.942837 16955 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:29.943298 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.945631 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.946575 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:29.946991 16952 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:29.947445 16850 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:29.949028 16806 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:29.957566 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:29.759472 19460 consensus_meta.cc:287] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.003s
I20260709 13:19:29.687207 19382 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:29.973302 19382 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:29.973549 19438 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.974124 19460 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.976478 19460 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:29.981945 19381 consensus_meta.cc:287] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.000s
W20260709 13:19:29.988349 19332 consensus_meta.cc:287] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.004s
I20260709 13:19:29.990056 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.991592 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:29.992125 16806 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:29.997538 16810 raft_consensus.cc:2393] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:30.000591 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:29.751641 19437 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.645768 19086 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.763938 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:29.661247 18985 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.796404 19404 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.755900 19395 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.756610 19361 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:29.748569 19522 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:29.655771 19463 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:29.620565 19486 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.685830 17524 raft_consensus.cc:2368] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:19:29.650226 19524 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:29.741407 19498 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:29.797734 19259 consensus_meta.cc:287] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.000s
I20260709 13:19:29.662238 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.029306 16801 raft_consensus.cc:2368] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:19:30.030339 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:30.031265 16708 catalog_manager.cc:5697] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 5, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:29.910059 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:29.798180 19187 consensus_meta.cc:287] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 13:19:29.797179 19459 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.803339 19258 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:30.033315 16708 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:19:29.908072 19504 consensus_meta.cc:287] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
W20260709 13:19:29.915637 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 267326us
I20260709 13:19:29.930346 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:30.037336 16708 catalog_manager.cc:5697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:30.037755 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 107520us
I20260709 13:19:30.038553 16708 catalog_manager.cc:5697] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 5, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.038734 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:29.933396 16809 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:29.933534 19511 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:29.934409 19428 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.936208 19506 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:29.937959 19237 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:29.752293 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:30.044890 19428 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.045972 19479 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:30.046352 19479 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.046646 19479 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.047070 19428 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.928083 19419 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:29.919026 19496 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.047722 16803 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:30.048688 19511 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:30.049419 16803 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:29.919451 19440 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.036293 19187 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.052778 16805 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:30.053778 19187 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.759246 19054 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:29.919459 19500 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:29.962870 19513 consensus_queue.cc:1059] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:30.057454 19513 raft_consensus.cc:3055] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:30.057796 19513 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:30.058128 19506 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:30.058532 19513 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.949430 19458 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:30.059885 19486 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.969223 19436 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.060096 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:30.061431 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:30.061746 19436 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:29.955976 19429 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:30.062570 19429 raft_consensus.cc:697] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:29.973713 19382 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:19:29.941819 19154 ts_tablet_manager.cc:1469] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Trace:
0709 13:19:20.090555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.092353 (+  1798us) service_pool.cc:224] Handling call
0709 13:19:20.356133 (+263780us) ts_tablet_manager.cc:934] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
0709 13:19:23.286071 (+2929938us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:24.029188 (+743117us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:24.029271 (+    83us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:24.034981 (+  5710us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:24.035263 (+   282us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:24.035544 (+   281us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:24.035609 (+    65us) inbound_call.cc:177] Queueing success response
0709 13:19:26.111885 (+2076276us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:19:28.173094 (+2061209us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:19:28.383988 (+210894us) tablet_replica.cc:261] Starting instrumentation
0709 13:19:28.558278 (+174290us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":58603,"raft.queue_time_us":14004,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"tablet-copy.queue_time_us":169481,"tablet-download-pool.queue_time_us":262,"tablet-download-pool.run_cpu_time_us":1379,"tablet-download-pool.run_wall_time_us":1308257,"thread_start_us":305502,"threads_started":3}
I20260709 13:19:29.526782 18993 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:29.987291 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 360) took 2601 ms. Trace:
I20260709 13:19:30.013697 19485 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.014122 19375 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:30.008440 19534 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:30.008639 19433 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:30.008638 16775 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:30.078292 19534 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:30.078265 19375 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.020085 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.023995 16806 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
W20260709 13:19:30.027832 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 377823us
I20260709 13:19:30.035151 16802 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:30.042233 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:30.040771 19504 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.053846 16805 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:30.054647 16804 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:29.955300 19505 consensus_queue.cc:1059] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:19:30.083909 19505 raft_consensus.cc:3055] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:30.084270 19505 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:30.085150 19505 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.085485 19485 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.086423 19505 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.088147 16704 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58310 (request call id 265) took 9900 ms. Trace:
W20260709 13:19:30.090651 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 48490.4us
I20260709 13:19:30.090760 19419 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:30.091354 19419 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:30.091850 19419 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.094272 19504 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:30.094945 16807 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:30.096052 16807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1397) took 1060 ms. Trace:
I20260709 13:19:30.096374 16807 rpcz_store.cc:276] 0709 13:19:29.036171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.037517 (+  1346us) service_pool.cc:224] Handling call
0709 13:19:29.038535 (+  1018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.095308 (+1056773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.095858 (+   550us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001a8e54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:30.095998 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2429067136}
I20260709 13:19:30.088621 16801 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:30.088629 16704 rpcz_store.cc:276] 0709 13:19:20.187712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.209179 (+ 21467us) service_pool.cc:224] Handling call
0709 13:19:30.088063 (+9878884us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:26.297946 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:26.308999 (+ 11053us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:26.309045 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:19:26.309064 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:26.310068 (+  1004us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:26.310123 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:26.310148 (+    25us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:19:26.311157 (+  1009us) tablet.cc:701] Row locks acquired
0709 13:19:26.311190 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:19:26.311347 (+   157us) write_op.cc:270] Start()
0709 13:19:26.311466 (+   119us) write_op.cc:276] Timestamp: P: 1783603166311289 usec, L: 0
0709 13:19:26.311485 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:19:26.393640 (+ 82155us) log.cc:844] Serialized 4321 byte log entry
0709 13:19:26.754352 (+360712us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b1800304780. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebfa93f3 00007feeebfab7c1 00007feeebfab779 00007feeebfab709 00007feeebfab6d1 00007feeebfaa9cd 000000000038f354 000000000038f199 00007feeebf8c83a
0709 13:19:27.112060 (+357708us) op_driver.cc:464] REPLICATION: finished
0709 13:19:27.484638 (+372578us) write_op.cc:301] APPLY: starting
0709 13:19:27.492265 (+  7627us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:27.536150 (+ 43885us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:27.536919 (+   769us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:27.568931 (+ 32012us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:27.569179 (+   248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:19:27.569231 (+    52us) write_op.cc:312] APPLY: finished
0709 13:19:27.569554 (+   323us) log.cc:844] Serialized 83 byte log entry
0709 13:19:27.569736 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:27.569884 (+   148us) write_op.cc:454] Released schema lock
0709 13:19:27.569933 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:27.570307 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:27.570341 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2255142,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":310417,"apply.run_cpu_time_us":3694,"apply.run_wall_time_us":101360,"num_ops":11,"prepare.queue_time_us":185455,"prepare.run_cpu_time_us":23918,"prepare.run_wall_time_us":202750,"raft.queue_time_us":304299,"raft.run_cpu_time_us":32280,"raft.run_wall_time_us":289188,"replication_time_us":774243,"spinlock_wait_cycles":13921152,"thread_start_us":502722,"threads_started":4,"wal-append.queue_time_us":129421,"wal-append.run_cpu_time_us":53125,"wal-append.run_wall_time_us":1822664}]]}
I20260709 13:19:30.091372 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:30.105913 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:30.063498 19429 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.112562 19375 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:30.114305 19054 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:30.114743 19054 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:30.115114 19054 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:30.117830 19500 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:30.118237 19500 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:30.118583 19500 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:30.042299 19437 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:30.120193 19433 raft_consensus.cc:697] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:30.120710 19086 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:30.121564 19485 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:30.070539 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 70029.3us
I20260709 13:19:30.028733 19524 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:30.122190 19524 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.122388 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.064411 19498 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.071273 19533 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:19:30.074141 19512 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:30.078969 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 70437.9us
I20260709 13:19:30.079886 19488 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:30.078896 19534 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.074549 19507 consensus_queue.cc:1059] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:19:30.074810 17521 rpcz_store.cc:276] 0709 13:19:27.385889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.388369 (+  2480us) service_pool.cc:224] Handling call
0709 13:19:28.994189 (+1605820us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b5800011198. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:29.009905 (+ 15716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:29.461649 (+451744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.986918 (+525269us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400378f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:29.987160 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817160960}
I20260709 13:19:30.083287 16804 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:30.121152 19433 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.039554 16708 catalog_manager.cc:5697] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 2 to 6, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 6 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:19:30.124815 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.129948 16884 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:30.130381 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:30.036847 18985 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.130721 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.131729 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:30.131843 19487 consensus_queue.cc:1059] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:30.132335 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:30.071009 19513 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.134650 16876 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:30.136130 16880 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
W20260709 13:19:30.141134 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.107219 19479 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.063448 19440 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.152356 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:30.145896 16883 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:30.146638 16882 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:30.155941 16803 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:30.155421 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 85127.1us
I20260709 13:19:30.147960 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:30.156729 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.133674 19488 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:30.133193 19436 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:30.142408 17518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 614) took 1002 ms. Trace:
I20260709 13:19:30.139195 19495 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.135360 19437 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:30.178613 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.144454 16708 catalog_manager.cc:5697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 6, now has a pending config: VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1), VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2), VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3), NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 6 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:19:30.157375 19535 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:30.168797 19259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48206 (request call id 5) took 13262 ms. Trace:
I20260709 13:19:30.161285 19458 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:30.172335 16882 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:30.173559 19485 raft_consensus.cc:3055] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:30.179659 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.156978 19381 consensus_queue.cc:1059] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:19:30.188661 19437 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.151211 19086 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:30.191300 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:30.191497 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:30.200760 19086 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:30.201630 18985 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:30.201625 19086 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.202675 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:30.203394 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:30.203979 16955 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:30.204110 19529 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:30.204111 19053 consensus_queue.cc:1059] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:30.204761 19529 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:30.205425 19053 raft_consensus.cc:3055] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:30.205823 19053 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:30.205644 19529 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.206666 19053 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.181816 19237 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:19:30.192883 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:30.175488 19504 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:30.200779 16952 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:30.192644 16708 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.140892 19496 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.175192 19488 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:30.210108 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:30.210866 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:30.212803 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:30.208060 19381 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:30.215305 16708 catalog_manager.cc:5697] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.187562 19535 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:30.222846 16809 raft_consensus.cc:1240] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:30.212394 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:30.217298 19237 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:30.181349 19436 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.217672 19381 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:30.233948 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 54369.6us
I20260709 13:19:30.234742 16850 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:30.215507 19458 raft_consensus.cc:697] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:30.217944 19487 consensus_queue.cc:1059] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:19:30.217795 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:30.208794 19508 consensus_queue.cc:1059] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:19:30.221067 19507 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:30.241217 19507 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:30.242022 19507 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.198141 19485 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:30.177438 17518 rpcz_store.cc:276] 0709 13:19:29.139099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:29.141382 (+  2283us) service_pool.cc:224] Handling call
0709 13:19:29.154440 (+ 13058us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:29.154798 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:29.154827 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:29.155258 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:19:29.468925 (+313667us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:29.486222 (+ 17297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:29.495409 (+  9187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:30.129036 (+633627us) raft_consensus.cc:1685] finished
0709 13:19:30.129058 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:30.141145 (+ 12087us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2283,"raft.queue_time_us":930,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5023,"thread_start_us":305810,"threads_started":1,"wal-append.queue_time_us":476223}
I20260709 13:19:30.219175 19504 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:30.225219 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.249230 16803 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:30.225822 16804 raft_consensus.cc:1240] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:30.227326 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:30.228466 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:30.230453 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:30.192077 19541 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:30.231559 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:30.232571 16708 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.215426 19375 consensus_queue.cc:1059] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:19:30.235148 16877 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:30.235812 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.215150 19053 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:30.237558 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:30.238270 16876 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:30.238747 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:30.239213 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:30.236442 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:30.240564 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:30.217881 19486 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:19:30.248149 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.229363 19237 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:30.294991 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 59211.5us
I20260709 13:19:30.301509 16808 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:30.296550 16807 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:30.289804 19507 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.230831 19535 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.299139 16955 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:30.299185 16708 catalog_manager.cc:5697] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 2 to 6, term changed from 3 to 5, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.193831 19259 rpcz_store.cc:276] 0709 13:19:16.906557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.906699 (+   142us) service_pool.cc:224] Handling call
0709 13:19:16.931430 (+ 24731us) log.cc:844] Serialized 492 byte log entry
0709 13:19:17.219846 (+288416us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b540023f3a0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef016b26 00007feeef01049a 00007feeef00f714 00007feeeefefeaa 00007feeeeff6d53 00007feeeeff6cd9 00007feeeeff6c69 00007feeeeff6c31 00007feeeeff5dfd 000000000038f354
0709 13:19:17.225981 (+  6135us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b540023f3a0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00f142 00007feeeefefeaa 00007feeeeff6d53 00007feeeeff6cd9 00007feeeeff6c69 00007feeeeff6c31 00007feeeeff5dfd 000000000038f354 000000000038f199 00007feeebfa9475
0709 13:19:17.228567 (+  2586us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b540023f3a0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00f142 00007feeeefefeaa 00007feeeeff6d53 00007feeeeff6cd9 00007feeeeff6c69 00007feeeeff6c31 00007feeeeff5dfd 000000000038f354 000000000038f199 00007feeebfa9475
0709 13:19:17.229240 (+   673us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b1800393100. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf772a6 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00bdbe 00007feeef016930 00007feeef0168d8
0709 13:19:17.230526 (+  1286us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b540023f3a0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00bdbe 00007feeef016930 00007feeef0168d8 00007feeef016858 00007feeef016813 00007feeef015a9c 00007feef4f01626 00007feef4efbdd8 00007feeef0527cb 00007feeef0552c0
0709 13:19:30.153771 (+12923245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162756,"raft.queue_time_us":15282,"raft.run_cpu_time_us":35767,"raft.run_wall_time_us":607567,"spinlock_wait_cycles":84257792,"thread_start_us":78574,"threads_started":1,"wal-append.queue_time_us":93439,"wal-append.run_cpu_time_us":10464,"wal-append.run_wall_time_us":1205935}
I20260709 13:19:30.399734 19425 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:30.399498 16708 catalog_manager.cc:5697] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 4, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 4 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:30.401115 19479 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:30.400902 16708 catalog_manager.cc:5697] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 6, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 6 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.402419 16708 catalog_manager.cc:5697] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.404873 16879 raft_consensus.cc:1240] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:30.300562 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:30.406487 16951 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:30.301677 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:30.295817 16883 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:30.301971 16952 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:30.302994 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:30.407740 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 106124us
I20260709 13:19:30.297072 19486 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.303416 19429 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:30.346671 19485 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.350719 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:30.354216 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 49765.6us
I20260709 13:19:30.348191 19458 consensus_queue.cc:237] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:30.387846 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 91478.6us
I20260709 13:19:30.243326 19258 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:30.301915 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.409107 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.450225 16879 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:30.304051 19237 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.404814 16880 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:30.320547 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:30.405957 16708 catalog_manager.cc:5697] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 3 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:30.422617 19382 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.404480 17522 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:19:30.453320 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 44296.1us
W20260709 13:19:30.454125 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 152262us
I20260709 13:19:30.461184 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:30.461336 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.242952 19500 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.419744 19425 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:30.419234 19486 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.465531 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.456485 16708 catalog_manager.cc:5697] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 6, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 6 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.447793 19498 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.419529 19375 raft_consensus.cc:3055] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:30.469424 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.464021 16848 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:30.418733 19429 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.467047 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:30.488145 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:30.497144 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.500418 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:30.502583 16956 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:30.491849 16708 catalog_manager.cc:5697] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.462337 19361 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:30.488304 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.504009 16809 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.503834 16708 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.504691 19132 consensus_queue.cc:1059] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:30.495442 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.506210 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:30.506619 16803 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:30.496511 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:30.507448 17520 raft_consensus.cc:2368] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:19:30.449601 19381 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:30.508373 19547 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:19:30.496796 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:30.509006 17519 raft_consensus.cc:2376] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6. Re-sending same reply.
I20260709 13:19:30.505509 16708 catalog_manager.cc:5697] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 4, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 4 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:30.502441 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:30.482273 19440 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:30.497777 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.482681 19404 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:30.497208 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:30.482478 19485 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.514367 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:30.515151 16708 catalog_manager.cc:5697] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 4, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 4 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.480770 19259 consensus_queue.cc:1059] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:19:30.494014 19375 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:30.503665 19429 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.530627 16881 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:19:30.531272 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.513170 19365 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:30.508553 19436 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:30.512639 19361 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:30.517738 19404 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:30.534711 16708 catalog_manager.cc:5697] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 4, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 4 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.515388 19487 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:30.546159 16708 catalog_manager.cc:5697] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:30.512305 19479 consensus_queue.cc:1059] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 13:19:30.548229 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 53296.7us
I20260709 13:19:30.549505 16708 catalog_manager.cc:5697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.554970 16922 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:30.490420 19504 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.557950 19534 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.563005 19534 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:30.538007 19437 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.548705 19496 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:30.548445 19436 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:19:30.564225 19546 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:19:30.538333 19365 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:30.564966 19365 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:30.565690 19548 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:30.564528 16708 catalog_manager.cc:5697] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 6, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 6 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:30.547364 19404 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.545151 19361 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:30.518671 19419 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.567914 16808 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:30.575439 16922 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:30.576084 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 75744.1us
I20260709 13:19:30.560519 19479 consensus_queue.cc:1243] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer 4b60b701acc7473e87e3e529a2a34689 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:19:30.595963 19544 log.cc:927] Time spent T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.375s	user 0.004s	sys 0.005s
I20260709 13:19:30.559345 19440 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:30.596935 17526 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:30.556279 19487 raft_consensus.cc:697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:30.599689 19487 consensus_queue.cc:237] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:30.512446 19497 consensus_queue.cc:1175] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b60b701acc7473e87e3e529a2a34689" responder_term: 6 status { last_received { term: 5 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:19:30.580554 19524 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.607668 16959 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:30.577740 16922 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:30.584234 16809 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:30.585242 19419 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:30.584618 16708 catalog_manager.cc:5697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 5, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 5 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:30.569156 19259 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:30.566721 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:30.582494 19054 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.572710 19496 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:30.602945 19529 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:30.611878 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 147919us
I20260709 13:19:30.638600 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:30.615432 16952 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:30.638904 16848 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.612288 19258 raft_consensus.cc:697] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:30.641896 16848 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:30.617194 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:30.611496 19425 raft_consensus.cc:697] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:30.642868 16848 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:30.647056 16848 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.648065 16882 raft_consensus.cc:1240] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:30.632449 19533 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:30.636341 19419 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:30.648499 16969 tablet_copy_service.cc:342] P ca1b60a074dc47cd8e68cc57a33a94a3: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-efa1a19816094c78802287ff39e74b62 received from {username='slave'} at 127.0.0.1:48222
I20260709 13:19:30.638329 19496 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:30.575125 19375 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.615944 18993 consensus_queue.cc:1059] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:19:30.649742 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 189416us
I20260709 13:19:30.669890 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.646888 19534 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:30.657447 16848 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:30.625967 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.651319 19382 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:30.666536 19259 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:19:30.667402 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.667268 19498 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:30.651207 19419 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.673360 16850 leader_election.cc:400] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:19:30.651747 19458 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:30.674551 19440 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:30.652828 19529 consensus_queue.cc:1059] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:19:30.674818 16848 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:30.724071 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 49498.2us
I20260709 13:19:30.649125 19479 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:19:30.672174 19534 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:30.669730 16969 tablet_copy_service.cc:434] P ca1b60a074dc47cd8e68cc57a33a94a3: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-efa1a19816094c78802287ff39e74b62 on tablet efa1a19816094c78802287ff39e74b62 with peer 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:30.646632 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 149386us
I20260709 13:19:30.738636 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:30.670521 19500 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:30.744608 19535 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:30.745752 19488 consensus_meta.cc:287] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.003s
I20260709 13:19:30.746131 19488 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.746618 19535 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:30.682438 19258 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.748234 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:30.749089 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:30.749832 19437 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:30.750218 19437 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:30.750339 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:30.688585 19458 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:30.698590 19553 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:19:30.698774 19429 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.705580 19556 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.684303 19524 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:30.711354 19559 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:30.714694 19463 consensus_meta.cc:287] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.686s	user 0.006s	sys 0.003s
I20260709 13:19:30.716027 19440 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:30.720440 19528 raft_consensus.cc:3055] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:30.761593 19053 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:30.722218 19496 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.761510 18985 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:30.732631 19404 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.762630 19513 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:30.689507 19498 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.669145 19512 consensus_queue.cc:1059] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:19:30.687347 19419 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:30.740398 19557 consensus_queue.cc:1059] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:19:30.817975 19507 consensus_meta.cc:287] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.004s
I20260709 13:19:30.689252 19361 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.741377 19425 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.742013 19054 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:30.742748 19495 consensus_meta.cc:287] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.553s	user 0.002s	sys 0.007s
I20260709 13:19:30.754078 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:30.750644 19437 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.748509 19187 raft_consensus.cc:3055] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:30.736421 19534 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:30.764140 19535 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:30.807142 19463 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:30.762190 19458 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:30.762434 19500 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:30.684958 16850 leader_election.cc:403] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:19:30.741051 19505 consensus_meta.cc:287] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.654s	user 0.011s	sys 0.000s
I20260709 13:19:30.763574 19382 consensus_queue.cc:1059] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:19:30.826383 19433 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.011s	sys 0.005s
I20260709 13:19:30.819936 18985 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:30.834789 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 110060us
I20260709 13:19:30.839447 19488 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:30.819625 19429 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:30.815852 19528 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:30.821493 19513 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:30.817061 19496 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:30.897284 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 143584us
I20260709 13:19:30.839107 19541 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:30.877754 19187 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:30.815382 19365 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.902124 16805 raft_consensus.cc:2410] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:19:30.905364 19433 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.012s	sys 0.005s
I20260709 13:19:30.897123 19535 raft_consensus.cc:697] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:30.868616 19560 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:19:30.918447 16878 raft_consensus.cc:1240] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:30.918915 19365 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:30.906935 19529 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:30.864440 19404 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:30.904722 16848 leader_election.cc:400] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
W20260709 13:19:30.859462 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 249345us
I20260709 13:19:30.880105 19495 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:30.901504 18987 raft_consensus.cc:3055] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:30.908749 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:30.901587 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 148194us
I20260709 13:19:30.905275 18985 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:30.903647 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 230396us
I20260709 13:19:30.917953 19535 consensus_queue.cc:237] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:30.931980 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.937019 19498 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:30.906478 19463 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.909507 19513 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.948194 16802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:19:30.957336 16802 raft_consensus.cc:606] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:30.950132 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.958051 16808 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:30.950201 17492 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:30.955295 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:30.966733 16808 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:30.967844 17492 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:30.967895 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:30.968729 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:30.938948 18987 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:30.973256 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:30.973744 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.973891 16882 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:30.973996 16880 raft_consensus.cc:2368] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6.
I20260709 13:19:30.974731 16801 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:30.980166 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.910351 19237 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:30.984097 16922 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:30.973557 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:30.959832 19569 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:30.989506 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:30.962090 19488 raft_consensus.cc:3055] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:30.990978 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:30.991246 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:30.990739 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:31.005765 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:30.996002 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:30.996569 18987 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:30.937938 19528 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.000844 17523 raft_consensus.cc:1240] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:30.990978 19495 consensus_queue.cc:1059] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:19:30.963809 19577 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:30.991636 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.022188 16876 raft_consensus.cc:2393] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:30.994799 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:31.022883 16802 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:30.999861 19187 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.003253 19541 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.026201 19187 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:31.016106 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:31.023313 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:31.028735 16803 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:31.029011 19533 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:31.029392 19533 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:31.030155 19533 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.031240 19533 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.027134 18985 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.033640 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:31.008519 16882 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:31.034240 17522 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:31.018672 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.035000 16880 raft_consensus.cc:2393] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 3: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:31.035169 19053 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:31.035801 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.036329 16880 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:30.965967 19429 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:30.954583 19486 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.021241 16884 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:30.990767 16848 leader_election.cc:400] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
W20260709 13:19:31.043242 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 52590.9us
I20260709 13:19:31.025228 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.046058 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:31.047981 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 245448us
I20260709 13:19:31.033735 18985 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.037294 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.052244 16882 raft_consensus.cc:2393] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:31.033675 17525 raft_consensus.cc:1240] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:31.052740 16876 raft_consensus.cc:2393] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:31.052644 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.017589 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:31.018188 19524 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:30.993470 19560 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:31.004849 19488 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:31.169060 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.207486 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.021749 19497 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:31.216759 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 183183us
I20260709 13:19:31.079236 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.021890 19577 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.009104 19569 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.224324 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:31.222571 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 218085us
I20260709 13:19:31.228024 16955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6455509d1ac14e1d961f38607a869924"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:31.228613 16955 raft_consensus.cc:606] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:31.228996 16955 raft_consensus.cc:614] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:31.125573 19361 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:31.231597 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.230082 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.126082 19485 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:31.236078 16956 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:31.240362 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.243960 16957 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:31.226908 19577 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.206753 19534 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:31.248782 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 264782us
I20260709 13:19:31.244524 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.222815 19560 raft_consensus.cc:697] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:31.064956 19429 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.207247 19419 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.268688 19488 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.251083 19485 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.230008 19505 consensus_queue.cc:1059] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:19:31.340648 19505 raft_consensus.cc:3055] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:31.340739 19485 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.341048 19505 raft_consensus.cc:740] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:31.341921 19505 consensus_queue.cc:260] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.343087 19505 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:31.343811 19580 consensus_queue.cc:1175] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4b60b701acc7473e87e3e529a2a34689" responder_term: 6 status { last_received { term: 6 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:19:31.346401 19440 consensus_meta.cc:287] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.001s
I20260709 13:19:31.346807 19440 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:31.223412 19497 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.348140 19486 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.349411 19497 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.349479 19419 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:31.350752 17526 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:31.250281 16801 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
W20260709 13:19:31.353163 19550 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:19:31.354626 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1406) took 1231 ms. Trace:
I20260709 13:19:31.354982 16885 rpcz_store.cc:276] 0709 13:19:30.123200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.123333 (+   133us) service_pool.cc:224] Handling call
0709 13:19:30.135076 (+ 11743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:30.141379 (+  6303us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:30.192682 (+ 51303us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.678340 (+485658us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.685271 (+  6931us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:30.693617 (+  8346us) log.cc:844] Serialized 26 byte log entry
0709 13:19:30.693752 (+   135us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:30.693952 (+   200us) log.cc:844] Serialized 14 byte log entry
0709 13:19:30.705601 (+ 11649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:30.705674 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:31.354445 (+648771us) raft_consensus.cc:1685] finished
0709 13:19:31.354463 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:31.354571 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38154,"prepare.queue_time_us":126920,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":2363,"raft.queue_time_us":180005,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":11971,"thread_start_us":496835,"threads_started":3,"wal-append.queue_time_us":780203}
I20260709 13:19:31.360436 19569 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.361469 16809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:19:31.254756 19583 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:31.362064 16809 raft_consensus.cc:606] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:31.362419 16809 raft_consensus.cc:614] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:31.365010 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:31.365793 17523 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:31.369521 16773 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:31.338464 19560 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.384040 19237 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.354882 16880 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:31.393291 16883 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:31.402483 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.403396 16880 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:31.391498 19569 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:31.404517 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.405752 16809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caf243a747f348a29b25b4642b64788e"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:19:31.406486 16809 raft_consensus.cc:606] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:31.409313 19497 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:31.409924 19497 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.412325 19497 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.416347 19577 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.418077 16956 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:31.269630 19578 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 13:19:31.429941 16880 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:31.439960 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 221545us
W20260709 13:19:31.432000 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.263698 19524 raft_consensus.cc:697] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:31.408885 19569 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.430804 19497 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.446893 19375 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:31.450214 19496 consensus_meta.cc:287] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.537s	user 0.003s	sys 0.004s
I20260709 13:19:31.460354 16877 raft_consensus.cc:2410] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:19:31.364940 19437 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.461768 16879 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:19:31.462556 19458 consensus_meta.cc:287] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.003s
I20260709 13:19:31.463214 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.442186 19053 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.464174 16879 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 4: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:31.464210 19053 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.465257 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.466316 19437 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.466410 19053 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:31.440726 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:31.466584 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.440320 19578 consensus_queue.cc:1243] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:31.467285 19591 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:31.448124 19381 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:31.447698 19497 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.468135 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.468792 16879 raft_consensus.cc:2393] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:31.469460 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.469746 19497 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.469959 16879 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:31.443271 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.471328 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.472235 16880 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:31.473109 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.474097 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.474642 16880 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.445026 16809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:43212
W20260709 13:19:31.436784 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 173896us
I20260709 13:19:31.475181 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:31.474579 19361 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:31.476058 19361 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.476783 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:31.478005 19361 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.463166 19458 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.445765 19569 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:31.479106 16881 raft_consensus.cc:2368] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4.
W20260709 13:19:31.479218 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.480453 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.480587 19458 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.482272 16881 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:19:31.484009 16881 raft_consensus.cc:1240] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:31.485025 19513 consensus_meta.cc:287] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.000s
I20260709 13:19:31.486871 16881 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:31.488144 16958 raft_consensus.cc:1240] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:31.462581 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:31.441526 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.489718 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:31.491621 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:31.493059 16957 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:31.495463 16955 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:31.496943 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:31.501199 16959 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:31.506711 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:31.509279 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:31.531827 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.532140 16880 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:31.532817 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:31.500478 16877 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:31.529479 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1410) took 1405 ms. Trace:
I20260709 13:19:31.536196 16880 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:31.554327 16880 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:31.542353 16878 rpcz_store.cc:276] 0709 13:19:30.124460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.124565 (+   105us) service_pool.cc:224] Handling call
0709 13:19:30.124841 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:30.929361 (+804520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.529220 (+599859us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400134a54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:31.529416 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824682240}
I20260709 13:19:31.485479 19513 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.567351 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.567699 19458 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.568174 19458 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.568655 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.568849 19513 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.556690 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.569742 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.570204 16958 raft_consensus.cc:2410] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:31.570848 16957 raft_consensus.cc:2410] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:31.561101 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:31.564015 16877 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:31.563992 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:31.535707 19463 consensus_meta.cc:287] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.571s	user 0.004s	sys 0.004s
I20260709 13:19:31.580066 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.598583 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.605860 19237 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:31.601979 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:31.607053 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 46052.3us
I20260709 13:19:31.608448 16850 leader_election.cc:400] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:31.608820 16850 leader_election.cc:403] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:19:31.609582 19496 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:31.611492 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.612162 16877 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:31.581002 16880 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.602165 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:31.613353 16880 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:31.615125 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.615979 16958 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:31.564965 19053 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:31.567444 19487 raft_consensus.cc:3055] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:31.619102 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.634819 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.601833 19463 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
W20260709 13:19:31.644603 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.621150 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.638720 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:31.598242 19590 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:31.620622 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 138821us
I20260709 13:19:31.643955 19237 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:31.656102 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 83139.6us
I20260709 13:19:31.624269 19487 raft_consensus.cc:740] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:31.658646 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.658294 19458 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:31.663720 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.655727 19533 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.654726 19590 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:31.658633 19497 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:31.657899 19463 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:31.660796 19560 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.666513 19487 consensus_queue.cc:260] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.667614 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.674611 19513 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:31.665884 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.698454 16877 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:31.677829 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1421) took 1445 ms. Trace:
W20260709 13:19:31.684863 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.700167 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.611758 19524 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.660223 19577 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:31.697422 16880 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:19:31.676877 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.701004 16878 raft_consensus.cc:2393] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:31.699074 16884 rpcz_store.cc:276] 0709 13:19:30.232710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.232810 (+   100us) service_pool.cc:224] Handling call
0709 13:19:30.233048 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.042979 (+809931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.677600 (+634621us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b5400146ed4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:31.677770 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812122880}
I20260709 13:19:31.701748 16880 pending_rounds.cc:85] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 3
I20260709 13:19:31.702031 16880 pending_rounds.cc:107] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260709 13:19:31.694118 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 55514.5us
I20260709 13:19:31.702270 16880 raft_consensus.cc:2889] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:31.739923 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.741019 16877 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:31.668175 19479 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.748705 16884 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:31.750160 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.664286 19237 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.747870 19513 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.748133 19535 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:31.754289 19535 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.754733 19237 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.755125 19513 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.756343 19535 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.753340 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.753392 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.762952 16850 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:31.763916 19601 log.cc:927] Time spent T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:19:31.763813 19458 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:31.764358 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:31.764447 19495 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:31.764616 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:31.764878 19458 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:31.765206 17525 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:31.765347 19458 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:31.763969 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.700752 19404 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:31.770844 16773 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:31.768257 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:31.773859 17522 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:31.761688 19479 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.762356 19463 consensus_queue.cc:1059] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:19:31.767688 19458 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.777091 19463 raft_consensus.cc:3055] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:31.777509 19463 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:31.777664 19458 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.778323 19463 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.766116 19487 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:31.782639 16805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 334) took 1314 ms. Trace:
I20260709 13:19:31.783479 16805 rpcz_store.cc:276] 0709 13:19:30.468047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.468247 (+   200us) service_pool.cc:224] Handling call
0709 13:19:31.782401 (+1314154us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54001a7f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:31.782568 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923697024}
W20260709 13:19:31.768505 19595 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:19:31.767869 19594 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:19:31.764921 19495 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:31.808113 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 45283.8us
I20260709 13:19:31.702611 19560 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.809366 16850 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:31.816109 16958 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:31.823483 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.823380 19577 consensus_queue.cc:1059] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:31.824059 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.824914 19574 raft_consensus.cc:3055] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:31.825256 19574 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:31.825475 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.825996 19574 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.826864 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.827112 19574 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:31.803153 19535 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:31.828691 19535 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:31.829051 19535 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.832209 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:31.802316 19513 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:31.832995 19560 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:31.833318 19513 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.835379 19513 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.796790 19404 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.808035 19495 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:31.837280 19574 consensus_queue.cc:1059] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:31.837427 19533 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:31.837723 16756 auto_rebalancer.cc:629] Failed to schedule move for tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9: Illegal state: Replica ca1b60a074dc47cd8e68cc57a33a94a3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:31.796099 19590 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.836854 19512 consensus_queue.cc:1059] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:19:31.840593 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 238531us
I20260709 13:19:31.840312 16882 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:31.812075 19053 raft_consensus.cc:697] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:31.842160 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.848218 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:31.850068 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.821125 19433 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:31.852418 16883 raft_consensus.cc:2393] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:31.839464 19463 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:31.857110 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:31.860992 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:31.861572 16802 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:31.862313 16805 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:31.865279 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:31.867712 19404 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.867836 19528 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:31.859597 19259 raft_consensus.cc:3055] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:19:31.868084 19602 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:19:31.871879 19259 raft_consensus.cc:740] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:31.872282 19506 raft_consensus.cc:3055] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:31.872634 19506 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:31.872769 19259 consensus_queue.cc:260] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.873449 19506 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:31.878824 19535 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.863819 19479 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:31.880780 19569 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.889747 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.890331 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:31.890539 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:31.895555 16876 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:31.890956 16951 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:31.893657 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:31.896767 16954 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:31.896925 16810 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:31.897548 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:31.895356 16805 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:31.892973 19433 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.900796 19433 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.902793 19433 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.889513 19512 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.908324 16809 raft_consensus.cc:606] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:31.908792 16809 raft_consensus.cc:614] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:31.909315 16808 raft_consensus.cc:2368] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
W20260709 13:19:31.904289 19575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.005s	sys 0.009s
I20260709 13:19:31.894639 19496 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:31.915477 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:31.916013 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.916388 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:31.918195 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:31.918407 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:31.919049 17522 raft_consensus.cc:2393] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:31.919164 18987 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:31.919936 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:31.916224 17520 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:31.921058 17492 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:31.924290 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:31.911140 19575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.005s	sys 0.010s
I20260709 13:19:31.925516 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:31.911031 19433 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.933976 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:31.939664 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:31.921205 19524 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:31.943384 19591 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:31.937791 19433 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.911103 19560 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:19:31.933934 19404 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:31.947232 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:31.910900 19512 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.936722 19592 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:31.903514 19053 consensus_queue.cc:237] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.946309 19361 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:31.958941 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.959030 19433 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.961879 19460 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.962287 16803 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:31.963240 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:31.962311 19460 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:31.964433 19607 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:31.964514 16806 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:31.966856 19460 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.967325 19460 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:31.967722 19460 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.968264 19512 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:31.970000 16756 auto_rebalancer.cc:629] Failed to schedule move for tablet 57dfb70986d346cdb015b37c0f58dce3: Illegal state: Replica 96eaa6dafb3e4bbe914e54dc12507912 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:31.971781 19560 consensus_queue.cc:1243] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:31.975929 19460 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.976620 19533 raft_consensus.cc:3055] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:31.924456 19496 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.976994 19533 raft_consensus.cc:740] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:31.977918 19533 consensus_queue.cc:260] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:31.979056 19533 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:31.979266 19496 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:31.980352 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:31.981045 19558 raft_consensus.cc:3055] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:31.981936 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.008705 19558 raft_consensus.cc:740] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:32.008940 16804 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:32.009337 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:32.007974 19495 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.010392 16878 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:32.009809 19558 consensus_queue.cc:260] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.010778 19562 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:32.011212 19558 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.011282 19562 raft_consensus.cc:697] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:32.012233 19562 consensus_queue.cc:237] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:31.956236 19535 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.982568 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:31.982692 19567 raft_consensus.cc:3055] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:32.014091 19567 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:32.014855 19495 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:32.014926 19567 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.016060 19567 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.020171 19437 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.020439 19500 raft_consensus.cc:3055] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:32.020928 19500 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:32.020737 19437 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.021857 19500 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.023118 19500 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.023458 19437 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:31.983376 19569 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:31.984776 19488 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.031939 19585 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.032610 19585 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.035262 19585 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:32.040504 19259 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:32.043844 19404 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:32.044910 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 97770.6us
I20260709 13:19:31.993848 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 338) took 1008 ms. Trace:
I20260709 13:19:32.045527 16801 rpcz_store.cc:276] 0709 13:19:30.985618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.985921 (+   303us) service_pool.cc:224] Handling call
0709 13:19:31.993639 (+1007718us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54001892d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:31.993775 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491208960}
I20260709 13:19:32.051570 16955 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:19:32.007544 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.053246 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.053627 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.055294 16959 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:32.057009 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.058105 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.058840 16953 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:31.991335 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 806) took 1032 ms. Trace:
I20260709 13:19:32.058077 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.059477 17526 rpcz_store.cc:276] 0709 13:19:30.958506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:30.958637 (+   131us) service_pool.cc:224] Handling call
0709 13:19:30.958891 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:31.351206 (+392315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:31.991006 (+639800us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b540055e954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:31.991254 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900755328}
I20260709 13:19:32.044956 19506 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:31.977041 19460 consensus_queue.cc:1059] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:19:32.065582 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.072531 16881 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:32.068133 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.073156 16877 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:32.068420 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:32.076495 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:32.077855 16954 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:19:32.077818 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:32.078495 16954 pending_rounds.cc:85] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 3
I20260709 13:19:32.078379 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:32.078815 16881 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:32.078935 16954 pending_rounds.cc:107] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:32.079294 16954 raft_consensus.cc:2889] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:32.079766 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:32.080658 16957 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:32.080376 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.077777 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.082028 16950 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:32.082513 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:32.091707 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.092353 16959 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:32.092541 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.094215 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.096082 16885 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:19:32.099220 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.102051 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.062930 19578 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.105104 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:32.071523 19558 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:32.109431 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:32.093755 19569 raft_consensus.cc:3055] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:32.110893 16850 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:32.095868 19567 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:32.092077 19488 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.092700 19361 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:32.092592 19592 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.095854 19524 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:32.120613 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 145181us
I20260709 13:19:32.101279 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:32.121716 16881 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:32.077404 19560 consensus_queue.cc:1059] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:19:32.124262 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.108100 19404 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.118585 19558 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.122434 19495 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.115513 19569 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:32.132066 16775 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.119298 19463 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.133771 19535 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:32.157593 19463 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.157851 19535 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:32.158048 19463 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.121773 19567 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:32.158181 19557 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.158666 19567 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.158988 19557 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.122913 19496 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:19:32.158300 19535 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:32.161623 19557 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:32.162578 19535 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.163812 19535 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.134274 19534 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:32.125844 19488 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.166723 19488 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:32.167564 19513 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:32.136186 19560 raft_consensus.cc:3055] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:32.169499 19560 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:32.140195 19495 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.170215 16951 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:32.170197 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.170672 19495 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.172582 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:32.173172 16885 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.136214 17521 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:32.111719 19578 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.184955 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.185536 16951 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:32.131753 19361 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.188994 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:32.196697 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 91688us
I20260709 13:19:32.195960 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:32.197474 16883 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.197598 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.198808 16876 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:32.198992 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:32.200248 16775 connection.cc:256] RPC call timeout handler was delayed by -1.1052777610000248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 13:19:32.201169 16775 leader_election.cc:336] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.746s (SENT)
I20260709 13:19:32.201583 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:32.204234 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.206403 19463 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.208072 16878 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:32.210834 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.211459 16953 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
W20260709 13:19:32.211980 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:32.212395 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.212266 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:32.212886 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.212671 16883 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:32.213197 16885 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:32.214583 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.221984 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:32.222424 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:32.222908 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.222997 17519 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:32.223982 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.224526 16810 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:32.223431 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.219838 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:32.224767 16954 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:32.227088 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:32.227782 16954 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.228135 17520 raft_consensus.cc:2393] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:32.228421 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.228955 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:32.229475 16953 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.203346 19404 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:32.170403 19560 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.233445 17518 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:32.213778 19505 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.233952 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:32.239560 17525 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:32.196194 19496 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:19:32.237820 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:32.241600 16957 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.242794 19495 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.244650 17521 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:32.245352 19578 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:32.235152 19404 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:32.246251 19404 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:32.247167 19560 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.238819 19558 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:32.228127 19429 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:32.248983 19463 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:32.250558 16957 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:32.216188 19361 consensus_queue.cc:1059] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:19:32.252430 16884 raft_consensus.cc:3055] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:32.252872 16884 raft_consensus.cc:740] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:32.253628 16884 consensus_queue.cc:260] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.254520 16884 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.203830 19569 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.256398 19569 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.260689 19567 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.262300 17523 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:19:32.262758 19567 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:32.263973 19361 raft_consensus.cc:3055] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:32.264367 19361 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:32.265167 19361 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.266227 19361 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:32.272722 16884 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:19:32.273144 16884 pending_rounds.cc:85] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 7
I20260709 13:19:32.273389 16884 pending_rounds.cc:107] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:19:32.273643 16884 raft_consensus.cc:2889] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:32.275319 16953 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:32.276472 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:32.289296 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.288451 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:32.290963 16953 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.295914 16954 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:32.296913 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:32.300005 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 96024.3us
I20260709 13:19:32.299325 16953 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
W20260709 13:19:32.301187 16775 leader_election.cc:336] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.854s (SENT)
I20260709 13:19:32.301720 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:32.302493 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.302551 19505 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:32.304067 16882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 1714) took 1312 ms. Trace:
I20260709 13:19:32.304478 16882 rpcz_store.cc:276] 0709 13:19:30.991185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:31.061237 (+ 70052us) service_pool.cc:224] Handling call
0709 13:19:32.303922 (+1242685us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54000eddd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:32.304013 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002194304}
I20260709 13:19:32.312690 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:32.317850 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.304167 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:32.319245 16878 raft_consensus.cc:1240] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:19:32.319958 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.320209 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:32.320011 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.320365 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.320792 16880 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:32.318591 16877 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:32.320869 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.321658 16882 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:32.323657 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:32.324469 19558 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:32.324955 19558 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:32.325791 19558 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.331115 19616 raft_consensus.cc:993] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:19:32.331621 19616 raft_consensus.cc:1081] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:19:32.334347 16879 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:32.336813 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:32.338528 19053 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.338914 19053 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.339260 19053 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.345166 19616 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:32.346961 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.348863 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:32.347440 16808 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:32.349861 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.350849 16809 raft_consensus.cc:2368] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:32.352275 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.352895 16809 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.346778 16924 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:32.331753 18987 consensus_queue.cc:1059] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:19:32.355358 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.357856 16958 raft_consensus.cc:2410] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:19:32.356760 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.357365 16951 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:32.359711 16810 raft_consensus.cc:2393] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:32.358888 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:32.356323 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.361337 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.361907 16804 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.362784 16801 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 13:19:32.292910 19578 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:19:32.379604 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.366025 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.357224 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:32.354185 19622 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.367172 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.353196 16959 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:32.372023 16804 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:32.367938 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.382807 16924 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:32.383850 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.384919 16803 raft_consensus.cc:2410] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:32.367722 16807 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:32.371793 16802 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:32.386550 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.368065 19495 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:32.366657 16809 raft_consensus.cc:2410] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:19:32.374814 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.375437 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.388885 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.389828 16809 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:32.391038 19622 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.391412 19622 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.391752 19622 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.395303 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.395833 19575 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:32.396167 16805 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 2.
W20260709 13:19:32.396490 19608 log.cc:927] Time spent T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.496s	user 0.012s	sys 0.000s
I20260709 13:19:32.397758 16805 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:32.356729 19616 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.401261 19506 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:32.402189 16801 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:32.403419 16801 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:19:32.404548 16801 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:32.405066 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:32.405349 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.406005 17524 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:32.407485 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:32.408210 17520 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:32.410064 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.412317 19506 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:32.417125 16810 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:32.401482 19616 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:32.436851 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.436868 16959 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:32.376781 19053 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.360255 19591 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:32.443398 17520 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
W20260709 13:19:32.442531 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 83700.6us
I20260709 13:19:32.439365 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.440418 16775 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.446350 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.447804 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:32.449100 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:32.452755 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.452952 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.450711 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:32.398789 19404 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.360553 19524 consensus_queue.cc:1059] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:19:32.442939 19578 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:32.456187 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:32.457864 16805 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:32.461282 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.443723 19616 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:32.463570 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 159932us
I20260709 13:19:32.467152 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:32.451229 19500 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:32.458475 19507 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:32.488547 19507 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.489059 19507 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:32.489432 19404 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:32.462491 19487 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.462361 18987 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:32.493901 19487 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:32.494442 19487 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.472937 19512 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:19:32.461206 19592 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:32.502091 19592 raft_consensus.cc:697] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:32.503140 19592 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.473728 19524 raft_consensus.cc:3055] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:32.507097 19524 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:32.487329 19635 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.493954 18987 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.508189 18987 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.473438 19604 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:32.463232 19578 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:32.517377 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 45241.6us
W20260709 13:19:32.528474 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.529861 16773 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:32.494339 19622 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:32.539125 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.536863 16924 leader_election.cc:400] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:32.540244 16924 leader_election.cc:403] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:32.544983 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 91201.6us
I20260709 13:19:32.546962 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:32.528482 19631 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.547636 17520 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:32.550432 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:32.442924 19590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.009s	sys 0.028s
I20260709 13:19:32.540222 19635 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:32.557700 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.472077 19632 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:32.556613 16805 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:32.558470 16883 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:32.534435 19535 consensus_queue.cc:1059] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:19:32.563265 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:32.564455 16879 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:19:32.555629 19590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.009s	sys 0.028s
I20260709 13:19:32.567020 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.567730 16803 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:32.568557 16809 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:32.559841 17524 raft_consensus.cc:2955] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEARNER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:19:32.580093 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:32.580672 17520 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.585932 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:32.557729 19506 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
W20260709 13:19:32.580276 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.563375 19635 raft_consensus.cc:697] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:32.600351 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.557380 19633 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:19:32.602937 16803 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:32.607406 19053 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:32.592430 17522 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:32.609365 19487 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.614375 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.615097 16805 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:32.615607 17520 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:32.615849 16803 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:32.594488 19616 raft_consensus.cc:3055] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:32.595785 19557 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.623246 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:32.603416 19590 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.604314 19575 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:32.632213 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:32.650544 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.630442 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.654080 16802 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.630069 16803 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:19:32.649893 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:32.631760 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.655484 16809 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:19:32.656002 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.656961 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:32.658406 16957 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:32.631081 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.659475 16810 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.625367 19616 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:32.627635 19590 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:32.613461 19404 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:19:32.614718 19487 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:32.687346 16924 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:32.686908 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.702443 16810 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:32.650687 17518 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.716202 16809 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:32.705839 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.657544 19604 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:32.721122 19487 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.650460 19557 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.665397 19506 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:32.704246 19590 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.738006 19622 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:32.663910 19585 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:32.703697 19259 consensus_meta.cc:287] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.000s
I20260709 13:19:32.732197 16802 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:32.663559 19053 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:19:32.715830 19496 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:32.628512 19635 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.741456 17521 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:32.703290 19575 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:19:32.722457 19578 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:32.750097 17518 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:32.758236 16809 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:32.759171 16810 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:32.778503 16950 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 3.
I20260709 13:19:32.751960 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:32.769253 19557 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:32.780660 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:32.782572 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 196723us
W20260709 13:19:32.782994 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.786073 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:32.786666 17518 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:32.787406 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.788545 16848 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.769948 19506 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:32.792117 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.792776 16804 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:32.793510 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:32.795585 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.798095 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:32.807132 16952 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:32.799054 19557 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:32.736732 19616 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.792371 19622 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:32.772848 19507 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.777978 19585 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.807905 17518 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:32.806613 19567 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.780340 19496 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:32.853763 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 64387.9us
I20260709 13:19:32.854629 19647 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:32.827520 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 366269us
I20260709 13:19:32.856251 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:32.808642 19506 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.816488 19586 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:19:32.821810 19557 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:32.858851 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.854823 16848 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:32.857223 19639 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:19:32.852286 19616 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:32.852417 19622 raft_consensus.cc:697] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:32.821573 19578 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:19:32.866020 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:32.876000 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.875697 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.864814 19635 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:32.869344 19524 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.878916 19638 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.883931 19622 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.887897 19460 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:32.888633 19567 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:32.888972 19488 raft_consensus.cc:3055] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:32.889372 19488 raft_consensus.cc:740] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:32.890152 19488 consensus_queue.cc:260] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.891145 19488 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:32.896740 19585 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:32.900256 16922 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:32.901073 19053 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:32.901495 19053 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.903301 19053 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:32.903798 19575 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:32.904255 19575 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.905409 17518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44636
I20260709 13:19:32.905957 17518 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:32.906056 19575 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:32.906325 17518 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:32.907099 19575 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:32.877265 19463 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.908071 19512 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:32.850646 18987 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:32.909484 16773 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:32.917199 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:32.917574 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.920287 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.920497 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.920778 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:32.921518 16803 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 4: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:19:32.871958 19612 log.cc:927] Time spent T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.547s	user 0.004s	sys 0.003s
I20260709 13:19:32.876741 16848 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.913941 17518 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.879280 19524 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:32.924790 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:32.956202 16809 raft_consensus.cc:3055] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:32.956605 16809 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:32.865152 19513 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:32.927561 17525 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:32.928104 17518 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:32.928520 19507 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:32.929490 19458 raft_consensus.cc:3055] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:32.936434 19590 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.938187 19631 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:32.928551 19496 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:32.940207 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 63541.5us
I20260709 13:19:32.940704 19567 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:32.942884 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:32.943288 19557 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:32.945644 19643 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.118s	user 0.001s	sys 0.001s
I20260709 13:19:32.878679 19635 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:32.986830 19647 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:32.988729 19635 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:32.988864 19647 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.954655 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.990610 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.986826 19463 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:32.991324 19460 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:32.969708 16802 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:32.993599 16951 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:32.994124 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:32.967499 16809 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:32.995543 16809 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:32.955533 19535 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:32.980374 16848 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
W20260709 13:19:32.996354 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 96168.4us
I20260709 13:19:32.998953 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:32.963863 19632 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.964289 19512 raft_consensus.cc:697] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:33.004392 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:33.004729 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:33.005128 16880 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:33.005460 16953 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:32.999464 16884 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:33.000957 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:33.001260 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:33.004397 16878 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:32.969182 19458 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:33.008682 17524 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:33.000178 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:33.009197 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.016286 16877 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:19:33.016782 16877 pending_rounds.cc:85] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 3
I20260709 13:19:33.017009 16877 pending_rounds.cc:107] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:33.017289 16877 raft_consensus.cc:2889] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:33.025050 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:33.010159 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.011960 16881 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:33.025979 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.019996 19535 raft_consensus.cc:697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:33.030006 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:33.029831 19512 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.030174 19535 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.031934 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:33.032516 16883 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:33.033191 18987 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:33.033357 19585 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:33.033795 19585 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.033882 19487 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:33.034283 19585 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.035862 19557 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:33.039438 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:33.039863 19640 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.217s	user 0.002s	sys 0.000s
I20260709 13:19:33.032573 19053 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:33.042377 16881 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:33.043059 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:33.047652 16922 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:33.007279 19567 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:33.054935 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:33.056764 19647 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.057286 19649 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:33.057346 19647 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:33.057955 19647 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.060099 19638 raft_consensus.cc:993] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:19:33.059938 19647 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.060746 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.059829 19505 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:33.061386 19649 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.063347 19635 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.065907 19633 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.066365 19633 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.066807 17523 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:33.068179 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.068275 19633 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:33.068861 17524 raft_consensus.cc:2368] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:19:33.069428 16809 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:33.070063 19649 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.070952 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:33.071308 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.072089 19635 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.072220 16958 raft_consensus.cc:2410] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:33.072314 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.072670 19635 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.073098 19635 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.074608 16950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1844) took 1011 ms. Trace:
I20260709 13:19:33.074954 16950 rpcz_store.cc:276] 0709 13:19:32.062842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.108936 (+ 46094us) service_pool.cc:224] Handling call
0709 13:19:33.074447 (+965511us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b540026c854. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:33.074531 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488238848}
I20260709 13:19:33.075425 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:33.045965 16953 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:33.080492 19659 raft_consensus.cc:1081] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:19:33.075263 19635 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.084487 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.085677 19633 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:33.086177 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:33.086829 16848 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.087109 19633 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:33.087886 19633 raft_consensus.cc:697] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:33.073107 17525 raft_consensus.cc:2393] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:33.088480 16848 leader_election.cc:400] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:19:33.089066 16848 leader_election.cc:403] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:33.088745 19633 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.091624 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.092551 19505 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:33.094727 19505 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:33.040625 19591 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:33.019623 19460 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:32.991439 19463 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.124051 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.049109 19404 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:33.142534 17520 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:19:33.140103 17524 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:33.047705 19631 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:33.141628 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 47141.7us
I20260709 13:19:33.050786 19651 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:33.055591 19641 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:33.143985 16773 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:33.049201 19578 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:19:33.088366 19647 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:33.152812 16952 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:33.033809 18987 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:19:33.054208 19557 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.147778 16953 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:33.148345 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:33.141438 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:33.160115 16809 raft_consensus.cc:2410] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:33.050625 19586 consensus_queue.cc:1059] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:19:33.105997 19567 raft_consensus.cc:697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:33.180975 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.106518 19591 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:33.149770 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:33.154814 19569 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:33.155004 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:33.155716 16802 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:19:33.170667 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.096184 19513 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:33.186939 19460 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:33.200480 19460 raft_consensus.cc:697] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:33.211743 19569 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.212373 19569 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.149415 19651 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.186049 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:33.186517 19591 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.153609 19631 raft_consensus.cc:697] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:33.235421 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 49447.2us
I20260709 13:19:33.234444 19651 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:33.244630 19463 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.245227 19463 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:33.251853 19638 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:33.252955 19650 log.cc:927] Time spent T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:19:33.255048 19631 consensus_queue.cc:237] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.140561 19458 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.183981 19647 raft_consensus.cc:697] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:33.201583 19460 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.262523 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:33.261500 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:33.181730 19557 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.243304 19506 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.272830 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:33.263190 19495 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:33.264480 19638 raft_consensus.cc:697] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:33.268105 19590 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.269657 19632 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:33.273923 19660 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.267590 19513 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:19:33.336181 19660 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.317009 19656 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:33.320222 19495 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.324121 19632 raft_consensus.cc:697] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:33.280844 19663 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:33.364666 17524 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:33.275642 19567 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.349633 19513 consensus_queue.cc:1243] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer 4b60b701acc7473e87e3e529a2a34689 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:19:33.372320 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 191414us
I20260709 13:19:33.374747 19557 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:33.374977 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.376122 19404 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:33.378525 19591 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.382376 16810 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:33.393802 16804 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:33.379323 19578 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:19:33.395242 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:33.415309 17525 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:33.416889 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.417096 19669 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.417544 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.417716 19669 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.423422 19669 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:33.415114 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 133080us
I20260709 13:19:33.427982 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:33.347450 19647 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.431143 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:33.431717 16802 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.431965 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:33.372225 19654 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:19:33.434065 19656 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:33.434463 19664 consensus_queue.cc:1059] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:33.437052 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:33.437629 16884 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:33.437754 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:33.438298 16879 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:33.434978 19656 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.440035 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:33.443745 16805 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:33.447532 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:33.448522 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.450246 16802 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:33.454881 16805 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:33.426775 19463 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:19:33.457790 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:33.458487 16876 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.396850 19665 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:19:33.398249 19622 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:19:33.457142 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:33.372857 19638 consensus_queue.cc:237] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.468503 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:33.469183 16801 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:33.470584 17525 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:33.446471 19558 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.445385 19488 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.426266 19585 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:33.480827 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:33.482592 19668 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:19:33.487381 16876 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:33.456107 19506 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:33.496865 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 68975.5us
I20260709 13:19:33.508553 16879 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
W20260709 13:19:33.504366 19661 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:19:33.511600 19495 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.493538 19488 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.491788 19558 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.521495 16953 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:33.490245 19631 consensus_queue.cc:1059] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:19:33.498817 19591 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:33.441541 19632 consensus_queue.cc:237] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.527074 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:33.527887 16954 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:33.527887 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.529546 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:33.530102 16953 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:33.531776 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:33.533192 19578 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.539710 19654 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.540207 19578 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.540303 19654 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.540836 19675 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:33.541277 19675 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:33.541608 19675 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:33.542321 19578 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:33.542431 19654 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:33.544431 19658 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:33.525454 19664 consensus_queue.cc:1243] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer 599f9a88b6cd4e818a1c59a0b4522480 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:33.525321 19512 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.529712 19507 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.529665 19591 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.608119 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:33.584118 19578 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.588373 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 54998.6us
I20260709 13:19:33.613463 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.612375 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:33.617354 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.618628 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.631232 16850 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.605484 19660 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.638890 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:33.633579 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:33.639534 16953 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:33.612076 19685 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:33.604167 19512 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.653430 16952 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:33.606855 19507 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.631649 19670 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:33.709357 16957 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:33.640798 19663 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:33.609853 19591 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.644376 19685 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:33.712308 19487 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.629248 19578 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.647174 19660 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:33.719599 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.643460 19683 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:33.644181 19669 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:19:33.717101 19631 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:33.721083 19685 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.714573 19686 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:33.732930 19488 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:33.733310 19663 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.722680 19660 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:33.723261 19684 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.741678 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 94889us
I20260709 13:19:33.743884 19567 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:33.744499 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:33.745131 16881 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:33.746191 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:33.746889 16879 raft_consensus.cc:2368] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4.
I20260709 13:19:33.747610 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:33.747972 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:33.748651 16879 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:33.747208 19684 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.760397 19053 raft_consensus.cc:3055] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:19:33.760823 19053 raft_consensus.cc:740] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:33.761560 19053 consensus_queue.cc:260] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.762063 19578 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:33.762512 19053 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:33.745843 19558 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.763545 19507 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:33.764551 19569 consensus_meta.cc:287] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:19:33.764925 19569 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.766698 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:33.766708 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:33.736553 19404 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:33.740484 19660 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.779982 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:33.724357 19487 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:33.783133 16885 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:33.786103 19578 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.775951 19567 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.787799 19578 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.789431 19567 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.789765 19578 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:33.791788 16885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caf243a747f348a29b25b4642b64788e"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44084
I20260709 13:19:33.792763 16885 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:33.792990 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:33.793455 16885 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:33.793697 16808 raft_consensus.cc:2368] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:33.794471 16850 leader_election.cc:400] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
W20260709 13:19:33.799131 19679 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:19:33.786446 19677 log.cc:927] Time spent T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:19:33.793413 19569 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.834249 16885 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.837306 16878 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:19:33.839257 19694 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:19:33.851135 19666 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.451s	user 0.004s	sys 0.000s
I20260709 13:19:33.729715 19687 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:19:33.785128 19404 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:33.865216 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 243926us
I20260709 13:19:33.866146 17524 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:19:33.866418 16850 leader_election.cc:403] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:19:33.877063 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.877566 17520 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:33.878472 19512 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:33.879148 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.879805 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:33.907955 17526 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:33.908380 19698 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:33.909283 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.880745 19487 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:33.885177 19659 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.916395 19659 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.918674 19659 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.887966 19591 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:33.892336 19675 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:33.919703 16881 raft_consensus.cc:2368] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4.
I20260709 13:19:33.920608 19675 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:33.920822 17526 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:33.843420 19684 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:33.895156 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:33.893000 19578 consensus_queue.cc:1059] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:19:33.922055 19578 raft_consensus.cc:3055] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:33.922371 19578 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:33.925453 19404 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:33.900439 19680 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.926399 19680 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.902745 16885 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.905848 17525 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
W20260709 13:19:33.905802 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 111444us
I20260709 13:19:33.910187 19631 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:33.946684 16773 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:33.914228 19695 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:33.907064 19656 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 3. Current term is 4.
I20260709 13:19:33.936143 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.900079 19586 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.956322 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:33.958851 19688 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:33.958994 19635 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:33.958734 19586 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.959426 19688 raft_consensus.cc:697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:33.959554 19053 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:33.960130 19053 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.960320 19688 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.960901 19586 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.962059 19053 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.962936 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.963534 17525 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:33.965591 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.966391 17526 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:33.966881 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:33.968302 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.944903 19658 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:33.975304 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:33.968860 17520 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:33.923388 19578 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.959445 19635 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:33.969234 19647 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:33.952600 19659 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:19:34.003428 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.003708 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:33.986276 19675 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:34.006915 19636 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.007469 16809 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:34.009020 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:33.991282 19656 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:34.011442 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.012869 16850 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:34.017371 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:34.017949 16883 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:34.020661 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:34.022249 16810 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:19:34.023572 19697 log.cc:927] Time spent T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:34.023473 19675 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:34.004879 19638 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.025022 19638 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.025777 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.026559 16808 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:34.027133 19638 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:34.007393 19636 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.027987 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.028755 16807 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:34.029449 19636 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:34.032958 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.033730 16810 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:34.034843 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.035588 16808 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:33.989252 19684 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:19:34.039891 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:34.041524 16885 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:34.042321 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:34.006156 19641 consensus_meta.cc:287] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.002s
I20260709 13:19:34.049510 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:34.047088 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:34.050890 16883 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:34.052152 19487 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:34.052695 19651 consensus_meta.cc:287] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.808s	user 0.007s	sys 0.002s
I20260709 13:19:34.052793 19487 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:33.994850 19674 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:19:34.053126 19651 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.056962 19651 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:34.057928 19680 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:33.992712 19567 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:19:34.060109 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:34.060420 16809 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:34.061182 16883 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:34.061265 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:34.064302 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.062089 17525 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:34.066998 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:33.985966 19658 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.066349 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:34.069141 17525 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:34.069581 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:34.071347 19656 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:34.072126 19684 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:34.073263 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.035408 19660 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.076006 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:34.076200 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:34.076756 16957 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.077188 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:34.078408 16954 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:34.080399 16806 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:34.080530 16952 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:19:34.081178 16885 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:34.082302 16954 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:34.084585 16957 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:34.086361 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:34.087428 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:34.050465 19647 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:19:34.087855 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:34.088035 16953 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:34.091729 16775 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:34.093233 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:34.095650 16775 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:34.062758 19641 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:34.099350 16953 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:34.059962 19487 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:34.061997 19675 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:34.103624 16775 leader_election.cc:400] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4.
I20260709 13:19:34.099010 19507 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:34.099123 19638 consensus_queue.cc:1059] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:19:34.098902 19512 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:34.086972 19636 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:34.106105 16951 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:34.161548 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.106197 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:34.162555 16953 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:34.106873 19585 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:34.107977 19685 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.108656 19569 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:34.109642 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:34.168424 16957 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:34.097353 19616 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:34.169447 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:34.114013 19693 log.cc:927] Time spent T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.322s	user 0.000s	sys 0.002s
I20260709 13:19:34.044267 19635 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.097779 19680 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:19:34.119007 19659 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.098775 19535 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:34.094661 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:34.119982 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:34.216010 16885 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:34.123287 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:34.216754 16954 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:34.131724 19505 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:34.141744 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:34.143401 19662 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.745s	user 0.003s	sys 0.000s
I20260709 13:19:34.143782 19665 raft_consensus.cc:3055] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:34.144600 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:34.145469 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:34.231604 17520 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:34.147264 19458 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.147617 19660 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:34.148162 19654 raft_consensus.cc:3055] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:34.183389 19512 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:34.149048 19658 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:34.150768 19703 log.cc:927] Time spent T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:19:34.153388 19578 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.155966 19622 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.156582 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:34.159379 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 55909.5us
I20260709 13:19:34.305285 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:34.306010 16805 raft_consensus.cc:2376] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6. Re-sending same reply.
I20260709 13:19:34.163924 16883 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:34.170346 16958 raft_consensus.cc:2410] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:34.172583 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.172922 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:34.184232 16951 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:19:34.307546 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:34.308344 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:34.309201 17524 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:34.184844 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:33.321460 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:34.197042 16809 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:19:34.197533 17527 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:34.204123 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:34.209064 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:34.316865 16953 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:34.186940 16707 catalog_manager.cc:5697] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:34.213361 16803 raft_consensus.cc:2410] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:19:34.217833 17526 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.168536 19632 raft_consensus.cc:3055] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:19:34.230710 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 136142us
I20260709 13:19:34.327777 16924 leader_election.cc:400] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:34.328128 16924 leader_election.cc:403] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:34.231504 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:34.328794 16957 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:34.169697 19507 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:34.159550 19631 consensus_queue.cc:1059] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:19:34.169839 19616 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:34.246603 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.160632 19636 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.249181 19654 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:34.291649 16954 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:34.231185 19665 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:34.249285 19635 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.294023 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:34.353945 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.212695 19659 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.288444 16922 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:34.356122 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:34.396224 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:34.396363 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 107977us
I20260709 13:19:34.318547 16707 catalog_manager.cc:5697] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:34.356081 16951 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:34.397294 16922 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:34.398361 16922 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:34.322433 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:34.399024 16848 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:34.396852 16807 raft_consensus.cc:2368] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9.
I20260709 13:19:34.402005 16809 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:19:34.343616 19650 log.cc:927] Time spent T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:19:34.343477 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:34.345690 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:34.346599 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:34.350239 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.250016 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:34.420162 16801 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:34.250559 18987 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:34.386637 17518 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:34.384536 19685 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:34.339658 17526 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:34.303884 19487 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.396664 16803 raft_consensus.cc:3055] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:34.417635 16922 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:34.440836 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 95201.1us
I20260709 13:19:34.441232 16805 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:34.441576 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:34.440807 16803 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:34.350785 19616 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:34.326754 19632 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:34.356966 19507 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.342438 16802 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:34.443503 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:34.347185 17522 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:34.347525 19558 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:34.442924 16803 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.409917 19631 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:34.455081 16803 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.408246 19659 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.450139 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:34.449456 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 102931us
I20260709 13:19:34.447258 16807 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:19:34.447968 16805 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:34.433316 18987 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.424942 19658 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:34.328544 19622 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.459915 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:34.444399 19053 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:34.444484 19641 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:34.444170 19590 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:34.452270 19651 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.456537 19506 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:34.458333 19631 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:34.456734 19664 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.456673 19649 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:34.395520 19665 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.356554 19512 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.461200 18987 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:34.483301 17519 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:34.474368 19053 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.489681 19053 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.473898 19558 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:34.472442 19641 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.479753 19590 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.447096 19487 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.482334 19506 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:34.466077 19663 consensus_queue.cc:1059] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:19:34.481434 19680 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:34.486057 19649 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.466212 19647 consensus_queue.cc:1059] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:19:34.486790 19664 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.457393 19654 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.498413 19665 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.483146 19651 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.497139 19641 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.499899 19590 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.497177 19558 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.502497 19506 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.482422 19632 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.503031 19680 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:34.514297 19664 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.520529 19636 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:34.504287 19649 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.526314 19680 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:34.515301 19683 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:34.521665 19647 consensus_queue.cc:1243] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:34.524454 19558 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.527297 19654 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.548055 19658 raft_consensus.cc:3055] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:34.539631 19683 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:34.549445 19683 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.548452 19658 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:19:34.550288 19711 log.cc:927] Time spent T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 13:19:34.557893 19683 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.557890 19658 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.560308 19658 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.556164 19641 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.568298 19641 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:34.556254 19680 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.556946 19651 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:34.570406 19680 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:34.574723 19616 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.541844 19632 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.576548 19616 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:34.563567 19659 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.409482 16707 catalog_manager.cc:5697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:34.613240 16708 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58336 (request call id 235) took 7260 ms. Trace:
I20260709 13:19:34.624372 16773 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:34.626500 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:34.627662 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 305133us
I20260709 13:19:34.631158 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:34.633363 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:34.642979 16801 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:19:34.648499 16808 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:34.477381 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:34.653326 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 175854us
I20260709 13:19:34.654640 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:34.657963 16803 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
W20260709 13:19:34.673416 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.675570 16880 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:34.677143 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:34.678229 16881 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:34.685487 16884 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:34.706897 16807 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
W20260709 13:19:34.708961 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 267301us
I20260709 13:19:34.711331 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:34.714121 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:34.709002 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 291308us
I20260709 13:19:34.718492 17518 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:34.727506 17522 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:34.729183 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:34.730195 17526 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:34.732231 16955 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:34.739377 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:34.752161 19404 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:34.753278 19404 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.758496 19487 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:34.760254 19496 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.760723 19496 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.761063 19496 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:34.762749 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.765062 19505 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.765930 19505 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:34.795647 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 74552.7us
W20260709 13:19:34.811529 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 94802.7us
I20260709 13:19:34.512184 19631 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.821348 19726 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:19:34.828455 19631 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.822960 19733 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:34.829638 19733 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.832695 19733 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:34.828455 19505 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:34.821995 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 83475.3us
W20260709 13:19:34.840533 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:34.844103 19578 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:34.846202 19578 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.846685 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:34.846851 19578 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.847940 19585 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:19:34.847527 16956 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:34.854974 19686 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:34.855640 19659 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:34.852975 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:34.856928 16882 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:34.838562 19053 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.859473 19053 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:34.864223 19685 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:34.864642 19506 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.866811 19506 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:34.864269 17526 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:34.869112 19726 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.869385 19638 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:34.869871 19726 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.871634 19658 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:34.872306 19658 raft_consensus.cc:697] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:34.872387 19726 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:34.873706 19658 consensus_queue.cc:237] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.875644 19616 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:34.876319 19616 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.876770 19616 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:34.856132 19641 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.899734 16806 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:34.912390 19651 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.913105 19651 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.913597 19651 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.916190 19683 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:34.916553 16848 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:34.918066 16848 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:34.919420 19680 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.919957 19680 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.920365 19680 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.920251 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:34.921329 16807 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.928995 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.881752 19641 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.613920 16708 rpcz_store.cc:276] 0709 13:19:27.352964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:27.353129 (+   165us) service_pool.cc:224] Handling call
0709 13:19:34.612920 (+7259791us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:30.928727 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:30.937046 (+  8319us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:30.937079 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:19:30.937094 (+    15us) tablet.cc:662] Decoding operations
0709 13:19:31.230758 (+293664us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:31.233349 (+  2591us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:31.235428 (+  2079us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:19:31.417725 (+182297us) tablet.cc:701] Row locks acquired
0709 13:19:31.417753 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:19:31.417943 (+   190us) write_op.cc:270] Start()
0709 13:19:31.418091 (+   148us) write_op.cc:276] Timestamp: P: 1783603171417885 usec, L: 0
0709 13:19:31.418121 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:19:31.483408 (+ 65287us) log.cc:844] Serialized 9567 byte log entry
0709 13:19:32.124522 (+641114us) op_driver.cc:464] REPLICATION: finished
0709 13:19:32.241531 (+117009us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeebf8c0ac 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feef2accef0
0709 13:19:32.335091 (+ 93560us) write_op.cc:301] APPLY: starting
0709 13:19:32.335170 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:32.335591 (+   421us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:32.335611 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:32.620914 (+285303us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:32.621248 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 13:19:32.621292 (+    44us) write_op.cc:312] APPLY: finished
0709 13:19:32.622399 (+  1107us) log.cc:844] Serialized 164 byte log entry
0709 13:19:32.622566 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:32.622742 (+   176us) write_op.cc:454] Released schema lock
0709 13:19:32.622797 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:32.623350 (+   553us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:32.623379 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28569,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":209872,"apply.run_cpu_time_us":8829,"apply.run_wall_time_us":288211,"num_ops":24,"prepare.queue_time_us":251073,"prepare.run_cpu_time_us":18516,"prepare.run_wall_time_us":683677,"raft.queue_time_us":284535,"raft.run_cpu_time_us":14408,"raft.run_wall_time_us":257611,"replication_time_us":693259,"spinlock_wait_cycles":97293696,"thread_start_us":516354,"threads_started":4,"wal-append.queue_time_us":181947,"wal-append.run_cpu_time_us":19729,"wal-append.run_wall_time_us":1949570}]]}
I20260709 13:19:34.821256 19725 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:19:34.875417 19558 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.945751 16956 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:19:34.950145 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 49821.8us
I20260709 13:19:34.847440 19590 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.951792 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.952275 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:34.956171 19732 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.956801 19665 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:34.957026 19732 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.957567 19665 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.958585 16803 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:34.958675 19487 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:34.959448 19487 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.944618 19641 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:34.962474 17526 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:34.963201 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:34.961071 19622 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:34.974023 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:34.963222 16952 raft_consensus.cc:1240] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:34.970150 19632 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:34.979331 18987 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.979923 19632 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.981614 18987 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:34.983191 19633 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:34.985163 19404 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:34.983210 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:34.988137 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:34.989018 16952 raft_consensus.cc:2368] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6.
I20260709 13:19:34.990147 19659 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:34.961304 19735 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:34.991832 19686 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:34.992336 19735 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:34.992646 19686 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.993206 16850 leader_election.cc:400] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9.
I20260709 13:19:34.993566 16850 leader_election.cc:403] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:19:34.994944 19686 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:34.984411 19622 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:34.997200 19622 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:34.997328 19675 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9.
I20260709 13:19:34.997596 19622 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:34.998077 19622 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.004156 19505 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.005045 19698 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:35.004877 19505 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:34.961716 19487 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:34.982589 19632 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.005741 19698 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.013720 19698 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.015003 19665 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.016049 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:35.006887 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:35.018342 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:35.019187 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.020053 19633 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:35.021490 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:35.024049 16850 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:35.021428 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:35.026652 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:34.959621 19732 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:34.969918 19590 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.053169 17526 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:34.974025 19656 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:34.995561 19735 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.058082 19505 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:35.059819 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.060006 16885 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:35.061383 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:35.062249 16952 raft_consensus.cc:2368] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6.
I20260709 13:19:35.061486 19685 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:34.991367 19687 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:19:35.030599 19578 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.073314 16807 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
W20260709 13:19:35.075685 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 50395.9us
I20260709 13:19:35.069857 19683 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:35.025025 19669 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:35.078143 19665 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:35.088114 19698 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:35.137210 19698 raft_consensus.cc:697] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:35.138621 19698 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:35.088523 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 114861us
I20260709 13:19:35.088809 19524 raft_consensus.cc:2764] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:35.089666 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:35.091572 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.091914 19656 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.094945 19590 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:35.095904 16692 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 599f9a88b6cd4e818a1c59a0b4522480 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:35.158921 19463 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:35.159020 16692 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 75058.7us
I20260709 13:19:35.159255 16924 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:35.159704 19463 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.160887 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:35.161645 19616 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.162809 19463 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.163589 19665 raft_consensus.cc:697] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:35.164163 19680 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.164783 19665 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:35.097257 19664 consensus_meta.cc:287] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.558s	user 0.000s	sys 0.011s
I20260709 13:19:35.117669 19641 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.167652 19664 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:35.168123 19649 consensus_meta.cc:287] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.628s	user 0.006s	sys 0.004s
I20260709 13:19:35.168661 19649 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:35.097853 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 76780.1us
I20260709 13:19:35.170384 16876 raft_consensus.cc:1240] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:35.170668 19649 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.171464 16955 raft_consensus.cc:2368] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7.
W20260709 13:19:35.097275 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.173803 16775 leader_election.cc:400] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4.
I20260709 13:19:35.174129 16775 leader_election.cc:403] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:35.073385 19633 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:35.101505 19654 consensus_meta.cc:287] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.003s
I20260709 13:19:35.101460 19651 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:35.107234 16957 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:35.108167 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.109730 16950 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:35.111130 16952 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:35.107750 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:35.168057 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.177590 16951 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:35.178573 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:35.179206 19651 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:35.112119 16882 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:19:35.110296 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:35.118094 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.154884 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.108704 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:35.157183 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:35.106258 19635 consensus_meta.cc:287] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.711s	user 0.009s	sys 0.003s
I20260709 13:19:35.158145 19567 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:35.158231 19675 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:35.181670 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:35.179836 16882 pending_rounds.cc:85] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 7
I20260709 13:19:35.182679 19739 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:35.180979 16881 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:35.169812 19664 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.187824 16958 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.169790 19656 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.188480 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:35.188627 19512 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:35.189155 16876 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:35.189208 19558 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:35.190028 19535 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 3. Current term is 4.
I20260709 13:19:35.189843 19496 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.190630 16885 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:35.191277 19590 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.192015 19641 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:35.231920 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:35.232745 16881 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.192816 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:35.192572 19567 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.195602 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:35.198062 16922 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.198161 19675 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.199303 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:35.200011 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:35.200142 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.224189 19633 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.186081 16882 pending_rounds.cc:107] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:19:35.242615 16882 raft_consensus.cc:2889] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:35.238508 16883 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.242738 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:35.226788 19616 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.226974 19680 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.249094 17521 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:35.248899 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:35.253150 18987 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:35.249848 16879 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:35.246822 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.250270 16952 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
W20260709 13:19:35.246093 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 48115.1us
I20260709 13:19:35.259550 17526 raft_consensus.cc:1217] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Deduplicated request from leader. Original: 4.7->[6.8-6.8]   Dedup: 6.8->[]
I20260709 13:19:35.260181 17526 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:19:35.261345 18987 raft_consensus.cc:697] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:35.243731 19512 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:35.261695 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:35.236779 19658 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:35.265290 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 91689.6us
W20260709 13:19:35.267761 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.274145 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:35.278565 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.278693 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.279644 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:35.281987 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:35.282119 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.262356 19633 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.295152 19658 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.292696 17521 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.324412 16801 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:35.305294 19622 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.308161 19675 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.308949 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:35.309345 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:35.311338 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 51764.5us
I20260709 13:19:35.277261 19664 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.287734 19512 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.293373 18987 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.319192 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.269409 17523 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:35.273559 19683 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:19:35.336933 19744 log.cc:927] Time spent T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:19:35.337256 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:35.329563 17520 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:35.329619 16953 raft_consensus.cc:2393] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:35.305933 19590 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:35.331483 16879 raft_consensus.cc:1240] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:35.346482 17522 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:19:35.326004 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 47732us
I20260709 13:19:35.337158 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:35.339299 16958 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:35.327348 16883 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:35.345194 16885 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:35.345494 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:35.379873 16804 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:35.381090 19664 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.381774 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:35.382323 17520 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:35.383236 19664 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.384167 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:35.384809 16806 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:35.388038 19633 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.388471 19735 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:35.388949 19658 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.390028 19753 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:19:35.390900 19622 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.391027 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:35.392473 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.392853 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:35.393342 19735 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:35.393208 19649 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:35.393787 19735 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.394313 19735 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.393172 19586 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:35.395916 16775 leader_election.cc:400] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6.
I20260709 13:19:35.396299 16775 leader_election.cc:403] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:19:35.398280 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.399070 19586 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:35.399330 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:35.399569 19586 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:35.400009 17519 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:35.400624 16954 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:19:35.400832 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:35.400538 19586 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.401422 17519 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:35.405194 19750 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:19:35.406559 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.406781 16953 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:35.410630 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.410952 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:35.357071 16884 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:35.378736 16952 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:35.411559 16805 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:35.427847 16881 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:35.357623 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.347819 19496 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.478842 17520 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:35.429441 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.478886 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:35.484479 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:35.480038 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 67155.4us
W20260709 13:19:35.480939 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 94436.3us
I20260709 13:19:35.485656 16883 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:35.481560 16878 raft_consensus.cc:2410] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:19:35.447286 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.431926 16879 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:19:35.481032 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 52034.6us
W20260709 13:19:35.484519 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 61614.7us
I20260709 13:19:35.488415 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.490780 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:35.369294 19732 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.113s
I20260709 13:19:35.429037 19698 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.541282 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:35.424541 19717 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:35.422583 19633 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:35.487824 19404 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:35.547084 19404 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.547514 19404 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:35.552001 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:35.552830 16805 raft_consensus.cc:2410] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:19:35.544281 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.484015 19578 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.429181 19616 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:35.554857 16876 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
W20260709 13:19:35.555790 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:35.556203 17521 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
W20260709 13:19:35.553511 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 59587.6us
I20260709 13:19:35.563293 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.567081 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:35.539464 19658 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:35.578613 16775 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.580404 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:35.584817 16878 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.580407 18987 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:35.581115 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.585493 16876 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:35.535122 19651 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:35.583397 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 92707.3us
W20260709 13:19:35.589155 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 52685.8us
I20260709 13:19:35.592650 16883 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:35.615959 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:35.604648 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.599836 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:35.554595 19567 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.553839 19622 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:35.539619 19632 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:19:35.555378 19717 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.640704 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:35.635412 18987 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.646570 18987 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.647727 19558 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:35.648391 19757 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:19:35.648326 19558 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.649586 19569 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:19:35.650426 19558 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:35.651306 19590 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:35.651881 19590 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:35.652582 19748 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.403s	user 0.003s	sys 0.000s
I20260709 13:19:35.653976 19590 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:35.657433 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:35.657970 16881 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:35.569021 19680 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.552416 19739 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:19:35.556174 19698 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.672497 19698 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.586879 19496 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:35.669040 19756 log.cc:927] Time spent T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:35.677019 17519 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:35.670215 19735 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.671418 16924 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:35.592300 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:35.674888 16876 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.676568 17523 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:35.568060 19633 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:35.681699 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 77172.1us
I20260709 13:19:35.569862 19578 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.581709 19654 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:19:35.691835 19524 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:35.663105 19717 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.695920 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:35.696046 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:35.613905 19658 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.680160 19569 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:35.640178 19651 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.661116 19680 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.738909 16885 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.685233 19641 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:35.693159 19735 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:35.682133 19753 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:35.737679 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:35.592468 19683 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:35.743252 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 54847.8us
I20260709 13:19:35.744951 16810 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:35.754519 16883 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:35.757388 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.771500 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.777580 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:35.759392 16881 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:35.764034 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:35.764827 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:35.779513 17520 raft_consensus.cc:2393] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 4: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:35.760622 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:35.780462 16810 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.749392 19674 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:35.767601 16876 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:35.744216 19622 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:35.767022 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:35.788259 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:35.788865 17524 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:35.789063 19524 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.789220 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:35.789855 16958 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:35.789907 16922 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.790736 16955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 1870) took 1055 ms. Trace:
I20260709 13:19:35.791154 16922 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.792392 16922 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.792987 18987 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:35.793227 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:35.794230 17526 raft_consensus.cc:2393] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:35.795619 16882 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:35.796077 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:35.796765 16952 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:35.797243 19578 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.798020 19512 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:35.798557 19512 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:35.798678 19740 log.cc:927] Time spent T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.626s	user 0.002s	sys 0.006s
I20260709 13:19:35.799449 19512 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.790812 19558 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:35.803947 19558 raft_consensus.cc:697] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:35.804562 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 1757) took 1146 ms. Trace:
I20260709 13:19:35.804885 19558 consensus_queue.cc:237] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.804924 16877 rpcz_store.cc:276] 0709 13:19:34.658017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.672051 (+ 14034us) service_pool.cc:224] Handling call
0709 13:19:34.672596 (+   545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.673237 (+   641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.673289 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.869151 (+195862us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.944949 (+ 75798us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:34.944980 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.945081 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:35.797968 (+852887us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:35.804137 (+  6169us) raft_consensus.cc:1685] finished
0709 13:19:35.804157 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:35.804369 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151138,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":181,"spinlock_wait_cycles":9135488,"thread_start_us":75341,"threads_started":1,"wal-append.queue_time_us":302706}
I20260709 13:19:35.811452 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:35.812237 16804 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:35.812692 18987 raft_consensus.cc:697] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:35.813117 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:35.793061 19753 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.814311 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:35.813673 18987 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.828073 16804 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:35.785167 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:35.791296 16955 rpcz_store.cc:276] 0709 13:19:34.735684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.738977 (+  3293us) service_pool.cc:224] Handling call
0709 13:19:35.790548 (+1051571us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400396cd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:35.790666 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991781248}
I20260709 13:19:35.735246 19496 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.796770 19635 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.833273 19496 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.833312 19635 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.743314 19669 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:19:35.835795 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:35.824028 19756 log.cc:927] Time spent T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:35.815368 19674 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.846321 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:35.815804 19622 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:35.854959 16924 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:35.835548 19635 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.862581 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:35.865100 19641 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:35.867503 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:35.868237 16876 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.869745 16881 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:35.871767 16924 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:35.852531 19674 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.852959 19622 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.876649 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.865528 19641 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:35.879647 16804 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:35.879392 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:35.860384 19649 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:35.882819 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:35.884559 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 315551us
I20260709 13:19:35.861294 19496 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:35.894012 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:35.894763 16806 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:35.878029 19739 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:35.880453 19586 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:35.902691 19507 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:35.903787 19496 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:35.922235 19759 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:35.890136 19633 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:35.904914 19651 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.884939 19641 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:35.914604 16810 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:35.904589 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:35.929787 16806 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:35.935475 19578 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.947557 16802 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:35.947419 19578 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:35.948596 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:35.949087 19743 log.cc:927] Time spent T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.786s	user 0.002s	sys 0.000s
I20260709 13:19:35.949477 19578 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:35.936720 19651 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:35.951143 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:35.952104 16806 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:35.951927 16876 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:35.954301 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:35.954986 16807 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:35.909945 19649 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:35.923364 19496 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:35.924762 19507 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:35.950196 19651 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:35.963452 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:35.979146 16810 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:35.929812 19635 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:19:35.965628 19649 raft_consensus.cc:697] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:35.971226 19507 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:35.988283 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.044886 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:35.946131 19641 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:35.985298 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 296798us
I20260709 13:19:35.967854 19680 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.047560 16850 leader_election.cc:400] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6.
I20260709 13:19:36.047901 16850 leader_election.cc:403] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:19:36.047878 19656 consensus_queue.cc:1059] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:36.048632 19567 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6.
I20260709 13:19:36.048882 19656 raft_consensus.cc:3055] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:36.049314 19656 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:36.050153 19567 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:36.050586 16850 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:36.051374 19641 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:36.051792 19567 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:19:36.054606 19567 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:36.055042 19567 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.050182 19656 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.057132 19656 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:36.055475 19567 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:36.070127 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 112517us
I20260709 13:19:36.021452 19569 raft_consensus.cc:697] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:36.032063 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.041580 19505 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:36.001077 16807 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:36.072074 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:36.078868 16878 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:36.083205 19569 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.088201 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:36.088712 19738 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.916s	user 0.000s	sys 0.003s
W20260709 13:19:36.089356 19404 consensus_meta.cc:287] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.002s
W20260709 13:19:36.091279 19764 log.cc:927] Time spent T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:19:36.063408 19654 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:36.095757 16876 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 3.
I20260709 13:19:36.100489 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:36.103384 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:36.103936 16878 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:36.095633 19665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.018s	sys 0.003s
I20260709 13:19:36.092594 19753 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.113878 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:36.117221 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 339739us
I20260709 13:19:36.119293 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:36.108623 19665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.018s	sys 0.004s
I20260709 13:19:36.121663 19698 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.122292 19698 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.124774 19698 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.125751 16956 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.120893 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:36.128657 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 249318us
I20260709 13:19:36.129817 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:36.127400 16957 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:36.101971 19404 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.135628 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:36.130910 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:36.146333 16885 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:36.125458 19772 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:36.149051 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:36.149927 16955 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:36.154760 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:36.158890 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:36.163972 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:36.112142 19654 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.166227 18987 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:36.140064 19590 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:36.160683 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:36.138778 16773 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:36.171995 18987 raft_consensus.cc:697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:36.146202 19635 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.179263 19777 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:36.182946 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:36.186793 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 46989.8us
I20260709 13:19:36.152421 19512 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:36.192996 16808 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:36.113929 19649 consensus_queue.cc:237] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.162261 19651 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:36.174980 17523 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:36.217140 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:36.205241 18987 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.154024 19772 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.195190 19512 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.227774 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:36.163573 19735 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:19:36.234401 16808 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:19:36.196636 19496 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:36.198978 19590 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:36.203749 19777 raft_consensus.cc:697] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:36.234853 16808 pending_rounds.cc:85] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 3
I20260709 13:19:36.212371 19463 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:36.242203 16808 pending_rounds.cc:107] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:36.243827 16808 raft_consensus.cc:2889] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:36.244071 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 63895.4us
I20260709 13:19:36.233135 19512 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:36.214107 19578 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:19:36.195806 19635 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.252686 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:36.256515 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:36.266829 19777 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.273711 19578 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:36.274549 19616 consensus_meta.cc:287] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.000s
I20260709 13:19:36.296109 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:36.299132 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:36.311144 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:36.314517 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:36.308990 16802 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
W20260709 13:19:36.308750 19717 consensus_meta.cc:287] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
W20260709 13:19:36.306965 19783 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:19:36.249847 19463 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.298588 19616 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6.
I20260709 13:19:36.251410 19496 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.307791 19772 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.314702 19687 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:36.314313 19771 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.329934 19632 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.336695 19404 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.316867 19685 consensus_queue.cc:1059] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:19:36.374703 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 122168us
I20260709 13:19:36.322264 19698 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:36.403528 16804 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
W20260709 13:19:36.374444 19774 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:19:36.343163 19717 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:36.405941 19782 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.098s	user 0.002s	sys 0.005s
I20260709 13:19:36.410526 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:36.414453 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:36.417011 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:36.405315 19654 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:36.422502 16803 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:36.424865 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:36.415956 19804 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:36.433805 19804 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:36.418956 19797 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:19:36.434231 19804 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:36.432482 16801 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:36.436319 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:36.432973 19512 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.437378 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:36.445767 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:36.446583 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:36.445925 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:36.426270 19794 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:19:36.364403 19590 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:36.449471 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:36.436758 19717 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.446668 16801 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:36.452948 17518 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:36.463986 16808 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.466828 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:36.463442 16956 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:36.473608 19505 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:36.474136 19505 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:36.452924 19769 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.157s
W20260709 13:19:36.458716 19789 log.cc:927] Time spent T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:19:36.447269 19778 consensus_queue.cc:1059] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.171s
I20260709 13:19:36.445540 19770 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:36.463811 19741 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 1.290s	user 0.000s	sys 0.007s
I20260709 13:19:36.485394 19496 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:36.486929 19792 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:19:36.488047 19658 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:36.490711 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:36.492558 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:36.479487 19674 consensus_meta.cc:287] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.001s
I20260709 13:19:36.495478 16808 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:36.500356 16806 raft_consensus.cc:1275] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:19:36.481858 16775 leader_election.cc:400] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7.
I20260709 13:19:36.502868 16775 leader_election.cc:403] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:19:36.483480 19770 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:36.479487 19567 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.511363 19770 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.514686 16959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34330 (request call id 1868) took 1799 ms. Trace:
I20260709 13:19:36.515008 16959 rpcz_store.cc:276] 0709 13:19:34.714941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:34.715190 (+   249us) service_pool.cc:224] Handling call
0709 13:19:34.868572 (+153382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:34.872452 (+  3880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:34.872480 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:34.873011 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:19:34.945413 (+ 72402us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:19:34.945440 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:34.945482 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.348599 (+1403117us) spinlock_profiling.cc:243] Waited 83.9 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:36.512324 (+163725us) raft_consensus.cc:1685] finished
0709 13:19:36.512346 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.514486 (+  2140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3299,"raft.queue_time_us":4050,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":192902400,"thread_start_us":68452,"threads_started":1,"wal-append.queue_time_us":300090}
W20260709 13:19:36.519126 19622 consensus_meta.cc:287] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.000s
I20260709 13:19:36.520423 19512 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:36.521059 19567 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:36.511780 19778 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7.
I20260709 13:19:36.504242 19674 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.537037 19818 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:36.537665 19818 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:36.542306 16694 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 78ca000fd50c4b38bfdd60badc024845 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:36.542990 19512 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.543468 19512 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.544952 17526 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:36.545408 19512 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:36.546159 19787 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:19:36.548383 19507 consensus_meta.cc:287] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.001s
I20260709 13:19:36.548777 19507 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.551275 19507 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:36.553602 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 71893.4us
I20260709 13:19:36.560822 16951 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:36.564167 19818 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:36.565341 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:36.566717 19770 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.568007 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:36.568689 19770 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.569453 17525 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:19:36.569532 19793 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:19:36.570935 19505 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.571796 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:36.560828 19463 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.574581 19507 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:36.519523 19622 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.585131 17527 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:36.586179 19622 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.594520 19804 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:36.596650 19779 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.289s	user 0.000s	sys 0.002s
I20260709 13:19:36.597875 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:36.598073 19771 raft_consensus.cc:3055] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:36.598659 19683 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.599040 19658 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:36.599222 19798 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:19:36.651243 19762 log.cc:927] Time spent T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.766s	user 0.003s	sys 0.000s
I20260709 13:19:36.653559 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:36.709159 17519 raft_consensus.cc:2393] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:36.678689 19771 raft_consensus.cc:740] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:36.736603 19781 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.530s	user 0.000s	sys 0.002s
I20260709 13:19:36.736820 19771 consensus_queue.cc:260] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.681298 19798 consensus_queue.cc:1243] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer 96eaa6dafb3e4bbe914e54dc12507912 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:19:36.793649 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 195741us
I20260709 13:19:36.794883 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:36.682998 17520 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:36.798063 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1514) took 1012 ms. Trace:
I20260709 13:19:36.758548 19804 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.800110 19765 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:36.800724 19674 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.801473 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:36.802053 16955 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:36.772441 19800 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.805843 17521 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:36.798561 16881 rpcz_store.cc:276] 0709 13:19:35.785232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.959069 (+173837us) service_pool.cc:224] Handling call
0709 13:19:35.959634 (+   565us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:35.966921 (+  7287us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:19:35.992251 (+ 25330us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.204976 (+212725us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:36.216809 (+ 11833us) log.cc:844] Serialized 78 byte log entry
0709 13:19:36.216971 (+   162us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:36.217188 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 13:19:36.572515 (+355327us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b240010d8b8. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebe2f9c4 00007feeebe2dacb 00007feeebfe8dc9 00007feeebfe8a55 00007feeebfe7fb0 00007feeeec5e488 00007feeeec5ebe8 00007feeeec36398 00007feeeec3176a 00007feeeec30bb6
0709 13:19:36.590714 (+ 18199us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b1800433900. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf23c0a 00007feef5663219 00007feeebfaba40 00007feeebfa64e4 00007feeebfa6455 00007feeef08e060 00007feeef0a0716 00007feeef0b1287 00007feeef0b1208
0709 13:19:36.590912 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.591002 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:36.591052 (+    50us) raft_consensus.cc:1685] finished
0709 13:19:36.591072 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:36.797960 (+206888us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":379303,"prepare.queue_time_us":30152,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1461,"raft.queue_time_us":392567,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":17839,"spinlock_wait_cycles":53210880,"thread_start_us":116202,"threads_started":1,"wal-append.queue_time_us":204674}
I20260709 13:19:36.738481 19771 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.814265 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:36.771773 19524 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:36.816277 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:36.816730 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:36.818861 16950 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:36.804486 19798 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:36.820114 16958 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:36.808090 19777 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:36.683848 19683 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.818323 19463 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:19:36.826251 19567 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:36.811558 19651 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:36.827737 19776 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:36.817042 19569 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.838706 19776 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.839071 19569 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.841171 19569 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.841280 19776 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:36.828778 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:36.842077 16950 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:36.833694 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:36.842738 19651 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:36.832683 16848 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:36.819489 19674 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:36.845194 19651 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:36.845320 19674 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:36.845978 19674 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:36.835924 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:36.824780 19524 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.848527 16877 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:36.835924 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:36.824783 19698 consensus_queue.cc:1059] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:19:36.834664 19622 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.834762 19567 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:36.822645 19798 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:36.818020 19505 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:36.861223 16924 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:36.850075 16957 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:36.850668 16848 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:36.831804 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:36.862222 16881 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:36.863319 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:36.865418 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:36.870056 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:36.874715 16848 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:36.875633 16848 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:36.888178 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:36.888360 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:36.891251 16879 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 3.
I20260709 13:19:36.892563 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:36.892608 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:36.893306 16957 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:36.893536 16808 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:36.879272 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:36.897648 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:36.899477 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:36.849524 19698 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:36.860795 19798 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:36.856223 19685 raft_consensus.cc:3055] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:36.906319 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:36.907091 16876 raft_consensus.cc:2368] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7.
I20260709 13:19:36.908036 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:36.909075 16809 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:36.898486 16882 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:36.852041 19496 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.880373 19590 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:36.872242 19776 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.889163 19680 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:36.913331 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:36.914893 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:36.912343 16805 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:36.849519 19622 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.825179 19777 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:36.933707 16803 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 1494) took 1350 ms (client timeout 1537 ms). Trace:
I20260709 13:19:36.888180 19658 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:36.959638 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:36.961958 16876 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:36.920547 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:36.963925 16804 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:36.947199 16803 rpcz_store.cc:269] 0709 13:19:35.565830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.587481 (+ 21651us) service_pool.cc:224] Handling call
0709 13:19:36.915728 (+1328247us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b540011a8d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:36.915894 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1809978624}
I20260709 13:19:36.944072 16881 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:36.945665 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:36.895895 19507 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:36.905527 19685 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:36.972121 18987 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:36.976531 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:36.977505 16808 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:36.979264 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:36.980072 16881 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:36.906474 19505 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:36.911761 19791 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:36.923290 19765 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:36.934201 19590 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:36.892119 19665 consensus_queue.cc:1059] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:19:36.995968 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:37.000725 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 64112.9us
I20260709 13:19:36.945498 19578 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:36.969084 19496 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:36.999333 19815 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:19:36.999197 19791 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:36.946026 19787 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:36.968855 19717 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.010712 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:36.969774 19512 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:19:37.023706 16804 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:37.025362 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:37.001633 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:37.006191 19590 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:37.013794 19665 raft_consensus.cc:3055] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:37.047426 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:37.048228 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:37.050709 16881 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:36.939283 19698 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.038481 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:37.051012 16956 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:19:37.050406 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:36.997359 19505 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.057336 16955 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:37.048398 19804 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.033326 16876 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:37.061728 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.066179 16879 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:37.073680 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.074692 16808 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:37.047725 19665 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:37.025940 19578 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.031556 19496 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.086954 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:37.014043 19567 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.070446 19787 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:37.036289 19717 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.100306 16876 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:37.108388 16879 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:19:37.078102 19524 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:37.102908 19819 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:19:37.115509 19665 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.116858 19717 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:37.117087 19821 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:19:37.117831 16804 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:37.120623 16808 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:37.123768 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:37.075553 19804 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:37.113260 19820 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:19:37.135433 16952 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.152633 16808 pending_rounds.cc:85] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 4
I20260709 13:19:37.153045 16879 raft_consensus.cc:1240] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:37.153080 16808 pending_rounds.cc:107] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:37.154342 16808 raft_consensus.cc:2889] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:37.159426 19827 log.cc:927] Time spent T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:19:37.179441 16879 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:19:37.167068 16848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.880s (SENT) [suppressed 19 similar messages]
I20260709 13:19:37.164772 19622 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.173273 19665 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:37.174849 19777 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:37.181419 16807 raft_consensus.cc:2955] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 2 to 6, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:37.195628 19698 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:37.195827 19822 log.cc:927] Time spent T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:19:37.192296 19823 log.cc:927] Time spent T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:19:37.198443 16879 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:36.800426 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:37.193009 19791 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:37.216171 16957 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:37.217248 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:37.253219 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 86180.3us
I20260709 13:19:37.222527 19505 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:37.255777 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 88227.4us
W20260709 13:19:37.258351 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.259553 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:37.254055 19578 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.263056 16775 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.248317 19496 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.278693 19674 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.265338 19505 consensus_queue.cc:1059] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 13:19:37.267482 19830 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:19:37.281596 16877 raft_consensus.cc:2393] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:37.288007 19825 log.cc:927] Time spent T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:19:37.288055 19828 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:19:37.294598 19590 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.261421 19698 consensus_queue.cc:1059] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:19:37.295946 19798 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.297979 19698 consensus_queue.cc:1243] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:37.282930 19778 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:37.298555 19777 raft_consensus.cc:3055] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:37.298903 19777 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:37.263696 19622 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.299896 19777 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.300042 19622 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:37.300946 19801 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.780s	user 0.007s	sys 0.007s
I20260709 13:19:37.301139 19777 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.301956 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1507) took 1628 ms. Trace:
I20260709 13:19:37.302099 19622 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.302301 16884 rpcz_store.cc:276] 0709 13:19:35.673329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.788733 (+115404us) service_pool.cc:224] Handling call
0709 13:19:36.027575 (+238842us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b580013ef98. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:19:36.027841 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:36.066608 (+ 38767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:36.066657 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:36.103425 (+ 36768us) log.cc:844] Serialized 26 byte log entry
0709 13:19:36.212168 (+108743us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:36.212224 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:36.213833 (+  1609us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:37.300436 (+1086603us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:37.301761 (+  1325us) raft_consensus.cc:1685] finished
0709 13:19:37.301785 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:37.301898 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52342,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":19468,"spinlock_wait_cycles":87302400,"thread_start_us":99925,"threads_started":1,"wal-append.queue_time_us":403238}
I20260709 13:19:37.303951 19804 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.262099 19717 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:37.304512 16951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1884) took 1192 ms. Trace:
I20260709 13:19:37.304939 16951 rpcz_store.cc:276] 0709 13:19:36.112636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.112775 (+   139us) service_pool.cc:224] Handling call
0709 13:19:37.304321 (+1191546us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54003098d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:37.304454 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002912640}
I20260709 13:19:37.309388 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.309829 16952 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:37.314911 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.320964 19569 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:37.323487 19569 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:37.283314 19505 consensus_queue.cc:1243] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:19:37.323781 19590 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:37.304518 19717 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:37.320333 19698 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.323858 19569 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:37.329066 19717 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.336856 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:37.341847 17492 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:37.352108 19622 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.352262 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:37.352854 16810 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:37.353765 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:37.359580 19622 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:37.360438 19622 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:37.361188 19622 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.363255 19622 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.366962 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:37.336287 19674 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.373298 19698 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:37.373526 19771 consensus_meta.cc:287] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
I20260709 13:19:37.373884 19698 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.350764 19685 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.382787 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.390399 19698 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.390913 19524 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:37.384644 19578 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:37.392010 19687 raft_consensus.cc:3055] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:37.392156 19578 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.392659 19578 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.392490 19717 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.395031 19717 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.395206 19635 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:37.396487 19798 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.397394 17523 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:19:37.400035 19685 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.390859 16850 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:37.408015 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.409818 19798 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:37.410389 19798 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:37.410836 19798 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:37.392513 19687 raft_consensus.cc:740] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:37.412886 19687 consensus_queue.cc:260] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.414422 19687 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.433844 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.438949 19674 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:37.437125 19753 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.447839 19798 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.449734 19683 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:37.449884 19798 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:37.450181 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.450824 16885 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:37.451092 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.451825 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.453083 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:37.453799 16884 raft_consensus.cc:2410] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:37.456166 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.456710 16884 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:37.456593 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:37.457672 16876 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:37.459024 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:37.459533 16876 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:37.466221 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.467459 16884 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:37.466888 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.468379 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.468945 16879 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:37.470461 17519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44648 (request call id 420) took 1045 ms. Trace:
I20260709 13:19:37.470853 17519 rpcz_store.cc:276] 0709 13:19:36.424876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.424985 (+   109us) service_pool.cc:224] Handling call
0709 13:19:37.470282 (+1045297us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54004317d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:37.470404 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622967040}
I20260709 13:19:37.472764 16876 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:37.481199 16878 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:37.486006 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.495034 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.495028 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:37.499913 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.501991 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.502280 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:37.503603 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:37.498920 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:37.505096 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 118573us
I20260709 13:19:37.505249 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.507313 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:37.507876 16802 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.443382 19578 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.508597 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:37.510589 16805 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:37.511719 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:37.512331 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.512442 16880 raft_consensus.cc:2376] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5. Re-sending same reply.
I20260709 13:19:37.501462 19635 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:37.516355 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.500586 19798 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.518409 16877 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:37.502920 19769 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:37.523121 16803 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:19:37.523478 16803 pending_rounds.cc:85] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 7
I20260709 13:19:37.524479 16803 pending_rounds.cc:107] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:19:37.524782 16803 raft_consensus.cc:2889] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:37.510041 19717 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:37.525820 19680 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:37.536432 19680 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.538522 19680 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.513760 19753 consensus_queue.cc:1059] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:19:37.540175 19717 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.540594 19717 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.541543 19753 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:37.541605 19635 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:37.542054 19753 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:37.542268 19635 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.545990 16808 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:37.543052 19753 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.509858 19770 consensus_queue.cc:1059] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:19:37.557783 19753 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.527695 19798 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.567593 19798 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.569065 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:37.570623 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:37.570791 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:37.571872 19680 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:37.513600 19683 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:19:37.544358 19635 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.572865 16808 raft_consensus.cc:2393] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:19:37.580444 17527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44626 (request call id 663) took 1823 ms (client timeout 1880 ms). Trace:
W20260709 13:19:37.580899 17527 rpcz_store.cc:269] 0709 13:19:35.757401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:35.757626 (+   225us) service_pool.cc:224] Handling call
0709 13:19:37.580232 (+1822606us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54005b4fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:37.580371 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1706566400}
I20260709 13:19:37.582904 19578 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:37.584283 19717 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.592705 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:37.593356 16805 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:37.594126 19798 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:37.594730 19798 raft_consensus.cc:697] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:37.598225 19569 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:37.599598 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 525775us
I20260709 13:19:37.600152 19635 raft_consensus.cc:3055] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:37.600538 19635 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:37.601732 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:37.602738 19829 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:37.604053 19776 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:37.606519 19649 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:37.606904 19649 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.607262 19649 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:37.573125 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.573537 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:37.608419 16883 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:37.572297 19680 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:37.613973 19680 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:37.621356 18987 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:37.625140 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 114595us
I20260709 13:19:37.625520 17518 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 13:19:37.625952 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:37.621969 18987 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.628634 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:37.629436 17523 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:37.630892 19804 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:37.631140 17525 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:37.631377 19804 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.631929 19804 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.632081 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:37.632897 17522 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:37.610385 19787 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:37.638825 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:37.639523 17524 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:37.639441 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:37.643164 17520 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:37.614241 19524 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:37.640347 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:37.595741 19798 consensus_queue.cc:237] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.658052 18987 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:37.661033 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:37.661266 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:37.647022 16773 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:37.662745 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:37.624907 19685 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:37.663640 17521 raft_consensus.cc:2368] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:37.668160 17524 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:37.668092 18987 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:37.668871 18987 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.667661 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:37.666440 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:37.670990 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:37.673134 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:37.657013 16802 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:37.660876 19578 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:37.678980 18987 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:37.639504 19505 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:19:37.666131 19685 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.667562 19778 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:37.660418 19524 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:37.674777 19765 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.017s	sys 0.028s
I20260709 13:19:37.684588 19777 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:37.685269 19685 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:37.686703 19778 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:37.705260 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.705476 19844 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:37.706180 19844 raft_consensus.cc:697] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:37.699196 19846 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:37.708108 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.708734 16954 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:37.711104 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:37.700858 19765 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.017s	sys 0.028s
I20260709 13:19:37.712849 19765 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:37.689605 19569 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.714054 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.713861 19765 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.713143 19853 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:37.720506 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.722973 19853 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:37.730655 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 128980us
I20260709 13:19:37.733994 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:37.737457 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 64388.9us
I20260709 13:19:37.741494 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:37.744871 16694 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 78ca000fd50c4b38bfdd60badc024845 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:37.685717 19578 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.749159 16877 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:37.728224 19778 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.765237 16950 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:37.767261 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.765236 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.774412 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:37.775076 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.778909 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:37.775808 19846 raft_consensus.cc:697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:37.783632 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:37.787130 16950 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:37.789065 17518 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:37.747856 19849 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:37.699252 19787 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.778054 19853 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:37.707228 19844 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.781522 19651 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:37.803246 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:37.829809 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.839567 16950 raft_consensus.cc:2393] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:37.813151 16924 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:37.843547 19846 consensus_queue.cc:237] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.848942 19829 raft_consensus.cc:2764] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:19:37.849731 19847 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:37.849926 16924 leader_election.cc:400] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7.
I20260709 13:19:37.850274 16924 leader_election.cc:403] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:19:37.851193 19829 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7.
I20260709 13:19:37.852818 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:37.854909 19829 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:37.855342 19829 raft_consensus.cc:697] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:37.856273 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:37.862250 16802 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:37.858105 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:37.867517 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:37.868389 16879 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:37.870404 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:37.873689 16951 raft_consensus.cc:2368] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:37.873719 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:37.880383 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:37.881043 16877 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:37.919902 16802 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:37.920879 19669 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:37.921658 19669 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:37.921939 19669 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:37.922727 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:37.922684 19669 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:37.924839 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:37.924930 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.925176 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:37.925561 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:37.925796 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.925587 16951 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:37.924841 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:37.928315 17519 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:37.936266 19524 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.873203 19753 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:37.936167 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:37.961032 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:37.951939 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.840751 19651 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.812541 19849 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.966264 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.876196 19852 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:37.981900 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:37.982344 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.982610 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.971366 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:37.971688 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.974139 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:37.918004 19674 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:37.974651 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:37.983827 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.984571 16952 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:37.985342 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.985874 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.987349 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.987629 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:37.988706 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:37.959560 19753 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:37.962626 19856 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:37.968365 19505 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:37.965175 19669 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:37.994498 16957 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:37.973919 19567 consensus_queue.cc:1059] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:19:37.995096 19578 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:37.999945 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:38.001827 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:38.021697 16877 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:37.989241 17523 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEARNER]: Advancing to term 8
I20260709 13:19:37.977933 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:37.981511 19569 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:37.962960 19791 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:19:38.015134 19496 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:38.036636 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 49356.7us
I20260709 13:19:38.016175 19665 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.011384 19753 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:38.016202 19649 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:37.989758 19632 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:37.980126 19687 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:19:38.001120 19852 raft_consensus.cc:697] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:38.019208 19850 log.cc:927] Time spent T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.139s	user 0.001s	sys 0.001s
I20260709 13:19:38.059267 16958 raft_consensus.cc:1240] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:38.057323 19578 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:38.019017 19856 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:38.058946 19632 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:38.053619 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 75757.2us
I20260709 13:19:38.019038 19505 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:38.056799 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 81720.2us
I20260709 13:19:38.031450 19569 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:38.019609 19804 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:37.974295 19829 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:38.054100 19651 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:38.066272 16773 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:38.065023 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:38.098392 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 171394us
I20260709 13:19:38.099542 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:38.100747 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:38.101198 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:38.103408 17523 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:19:38.110157 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:38.118400 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:38.125326 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 59140.7us
W20260709 13:19:38.086942 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 148026us
I20260709 13:19:38.129029 16848 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:38.133628 19776 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.126797 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:38.136680 17520 raft_consensus.cc:2368] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7.
I20260709 13:19:38.136081 19864 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:38.060282 19665 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:38.132133 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 261516us
I20260709 13:19:38.059742 19800 raft_consensus.cc:3055] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:38.061280 19649 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:38.076058 19569 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:38.062110 19856 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:38.066922 19505 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:38.145016 19524 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:38.153437 18987 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:38.060415 19578 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:38.135447 19687 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:38.076890 19717 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:38.078001 19849 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:38.136333 19770 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.125581 19857 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.064337 19632 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:38.082720 19771 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:19:38.153748 19850 log.cc:927] Time spent T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:38.237663 19798 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.071506 19778 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:38.080511 19685 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.077400 19680 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.147532 19674 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:38.151487 19800 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:19:38.230116 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 177659us
I20260709 13:19:38.150709 19787 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:19:38.180542 16848 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:38.232312 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:38.168232 19578 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:38.236634 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 98908.1us
I20260709 13:19:38.080915 19635 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:38.239787 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 77565.9us
I20260709 13:19:38.239147 18987 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:19:38.247988 16850 leader_election.cc:400] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:38.248349 16850 leader_election.cc:403] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:19:38.248015 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 67616.1us
I20260709 13:19:38.249738 16848 leader_election.cc:400] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 4 election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:38.250813 16848 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:38.254312 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:38.096424 19852 consensus_queue.cc:237] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.170619 19524 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:38.265532 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:38.255287 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:38.266402 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:38.245837 19632 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.242208 19798 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.261144 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:38.263517 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:38.252408 16956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:38.252043 19791 consensus_queue.cc:1059] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:19:38.255828 16848 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:38.241222 19770 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:38.348755 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 81782.4us
I20260709 13:19:38.280547 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:38.389061 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 127977us
I20260709 13:19:38.254526 19669 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:38.276397 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:38.405230 16807 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
W20260709 13:19:38.306355 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 46295.6us
I20260709 13:19:38.406113 16810 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:38.295295 16956 raft_consensus.cc:606] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:38.407369 16956 raft_consensus.cc:614] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:38.280145 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:38.409796 16804 raft_consensus.cc:2393] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:38.404884 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:38.424463 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 168693us
I20260709 13:19:38.272255 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:38.428246 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 156058us
W20260709 13:19:38.381557 19833 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 1.115s	user 0.007s	sys 0.010s
I20260709 13:19:38.254459 19873 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5.
I20260709 13:19:38.281282 19857 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.270423 19680 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:38.257212 19880 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.427096 19871 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:38.268975 19524 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:38.348307 19687 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.348047 19874 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:38.376047 19855 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:38.270402 19804 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:38.281309 19798 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:38.429402 16850 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:38.427161 19732 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:38.439183 19665 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:38.558593 16807 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:38.280858 19849 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.215s
I20260709 13:19:38.273851 19739 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.223s
I20260709 13:19:38.272944 19753 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.274730 19632 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:38.592439 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 163081us
I20260709 13:19:38.269358 19674 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.606701 16802 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:38.386072 19800 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:38.591532 19804 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:38.649277 16807 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:38.601883 19870 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:38.605365 19798 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.572865 19687 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:38.660004 16924 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:38.601444 19874 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:38.670710 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:38.646768 19680 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:38.677429 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:38.678512 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 273689us
I20260709 13:19:38.675524 16802 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:38.669293 19877 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.680140 19874 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.655792 19685 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:38.670034 19878 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:19:38.678918 16924 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:38.655485 19891 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:38.684163 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:38.689160 19891 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:38.692688 19891 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:38.671778 19732 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:38.676839 19798 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.620216 19569 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.677944 19787 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:38.702741 19891 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.696751 19892 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 13:19:38.703924 19875 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:19:38.704677 19879 log.cc:927] Time spent T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:19:38.708063 19896 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.683939 19868 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:38.718492 16848 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:38.683652 19669 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:38.720505 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:38.678159 19649 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:19:38.740042 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:38.740238 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:38.742178 19881 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:38.742820 19881 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:38.743889 19770 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:38.745067 19632 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:38.745342 19881 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:38.716007 19798 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.684857 19680 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.777263 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:38.810122 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:38.778322 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:38.796906 16956 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:38.846668 17527 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:38.747619 19798 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:38.735108 19868 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:38.852512 19868 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:19:38.852847 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 446130us
I20260709 13:19:38.853251 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:38.660799 19870 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.854272 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:38.873322 16955 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:38.873596 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:38.862246 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 166727us
I20260709 13:19:38.868932 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:38.741245 19863 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.874764 16802 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:38.698159 19877 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:38.886720 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:38.719503 19891 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.890038 18987 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:38.749070 19787 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:38.776643 19567 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.777132 19880 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:38.895880 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:38.897395 18987 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:38.748090 19778 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:38.853420 19896 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:38.909135 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:38.747985 19669 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:38.893821 19685 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:38.912810 18987 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.942744 16883 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:38.944547 16879 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:38.944806 18987 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:38.945504 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:38.930294 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:38.930351 16880 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:38.947166 16881 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:38.926038 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:38.949745 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 94486us
I20260709 13:19:38.956964 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:38.957835 16802 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:38.960760 19669 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:38.961457 19669 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:38.962035 19669 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.957000 16881 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:38.966938 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:38.967036 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:38.967631 16881 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:38.967851 16884 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:38.968756 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:38.968945 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:38.969579 16881 raft_consensus.cc:2368] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8.
W20260709 13:19:38.917353 19578 consensus_meta.cc:287] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
I20260709 13:19:38.897380 19770 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:38.915381 19569 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:38.980305 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:38.910872 19753 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:38.914675 19632 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:38.977843 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:38.982290 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 672) took 1344 ms. Trace:
I20260709 13:19:38.983459 16881 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:38.982728 17522 rpcz_store.cc:276] 0709 13:19:37.637839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.639934 (+  2095us) service_pool.cc:224] Handling call
0709 13:19:37.658822 (+ 18888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.727588 (+ 68766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:37.727617 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:37.727654 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:37.727701 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.982002 (+1254301us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b5400158954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:38.982061 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:38.982199 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157667072}
I20260709 13:19:38.982836 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:38.946261 19881 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:38.990082 16881 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:19:38.945742 19798 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:38.907960 19567 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:38.966353 19896 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:38.964083 19787 raft_consensus.cc:697] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:38.986524 19687 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:39.074224 19687 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.074872 19687 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.075496 19680 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:38.972558 19778 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.074302 19909 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:39.079509 16950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
W20260709 13:19:39.066556 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 109899us
I20260709 13:19:39.107002 19883 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:39.107254 19900 log.cc:927] Time spent T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:19:39.108155 19787 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.108388 19778 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:39.109742 19907 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:39.110217 19907 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.110647 19778 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:39.114326 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:39.101706 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:39.125339 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 148704us
I20260709 13:19:39.126044 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:39.130666 19778 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:38.995862 19632 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:39.068555 19669 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:39.147161 19901 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:38.985363 19578 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.112296 19770 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.154186 19770 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.155014 19899 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:39.155543 19899 raft_consensus.cc:697] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:19:39.156785 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 55211.2us
I20260709 13:19:39.160841 19912 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.161315 19912 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.161798 19891 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:39.111908 19864 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:39.067477 19881 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.131340 19778 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:39.069237 19798 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.163415 19912 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:39.186646 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:39.188613 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:39.189059 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:39.189199 16807 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:39.190289 16804 raft_consensus.cc:2410] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:39.191215 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:39.192782 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:39.193315 16802 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:39.200721 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:39.201491 16807 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:39.202634 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:39.203398 16804 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:39.134315 19829 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:19:39.132565 19683 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:19:39.153056 19669 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:39.214061 16884 raft_consensus.cc:2410] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:19:39.184471 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 68849.5us
I20260709 13:19:39.222426 16802 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:39.217036 16924 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:39.225104 18987 consensus_queue.cc:1059] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:39.225812 18987 consensus_queue.cc:1059] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:39.164340 19870 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:39.071224 19896 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.228780 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:39.148527 19632 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.164667 19901 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.248275 19901 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:39.220256 19897 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:39.231035 19739 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:39.267654 19904 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:39.270327 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.237303 19512 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:39.267599 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:39.175207 19864 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.250299 19770 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:39.279336 18987 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:39.227053 19669 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.156364 19899 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.268414 19904 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.281997 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:39.235448 19674 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:19:39.263541 19903 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.264612 19739 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:39.237143 19908 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.331s
I20260709 13:19:39.273612 19512 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:39.286270 19883 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:39.299288 19770 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.330849 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:39.302351 19877 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:39.302479 19739 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:39.332216 18987 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:39.614638 18987 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.616531 18987 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:39.330684 19883 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:39.334322 19907 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:39.617079 19883 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:39.303905 19898 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:39.453490 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:39.332981 19873 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.334224 19687 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:39.347289 19765 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 13:19:39.622344 16883 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:39.622745 19765 consensus_queue.cc:1243] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer 4b60b701acc7473e87e3e529a2a34689 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:39.625382 16883 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:39.330202 19567 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:39.457850 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 166847us
I20260709 13:19:39.390702 19512 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.264196 19897 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.276537 19778 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.300238 19910 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.324s
I20260709 13:19:39.440778 19921 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.452934 19894 raft_consensus.cc:3055] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:39.499919 19911 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:19:39.502452 19915 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:19:39.457986 19622 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:19:39.505576 19917 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 13:19:39.512458 19829 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:39.513116 19890 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:39.645838 19890 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:39.646255 19890 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.648269 19898 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:39.391052 19770 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.649248 19622 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.554452 19798 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:39.555757 19929 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
W20260709 13:19:39.560050 19868 consensus_meta.cc:287] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.681s	user 0.004s	sys 0.005s
W20260709 13:19:39.562947 19665 consensus_meta.cc:287] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.954s	user 0.002s	sys 0.007s
W20260709 13:19:39.577284 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 273918us
I20260709 13:19:39.578743 16879 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:39.553536 19914 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:39.582070 19669 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:39.587255 19904 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:39.571280 19578 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:39.588172 19524 consensus_meta.cc:287] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.987s	user 0.009s	sys 0.002s
I20260709 13:19:39.283393 19641 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:19:39.599951 19632 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:39.333225 19680 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.606302 19918 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:39.644104 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:39.664426 19665 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:39.644534 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 415817us
I20260709 13:19:39.704187 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:39.645084 16880 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.006s	sys 0.007s
W20260709 13:19:39.705420 16880 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.006s	sys 0.008s
I20260709 13:19:39.631248 19765 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:39.304446 19903 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.659598 16804 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:39.643217 19921 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.644876 19512 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.640041 19881 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:39.652148 19787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.007s	sys 0.007s
I20260709 13:19:39.643883 19894 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:39.677608 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:39.680429 19770 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:39.682045 16883 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:39.707295 19680 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:39.711236 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 427253us
I20260709 13:19:39.727764 16801 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:39.714470 16878 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:39.717689 19787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.007s	sys 0.007s
I20260709 13:19:39.717149 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:39.723325 18987 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.727838 16775 leader_election.cc:400] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8.
I20260709 13:19:39.721977 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:39.736066 16775 leader_election.cc:403] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:19:39.655933 19829 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.736631 18987 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.729393 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:39.662117 19868 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.739578 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:39.740504 19946 log.cc:927] Time spent T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:19:39.715340 19765 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.714957 19669 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.715117 19880 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.736893 16959 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:39.681962 19524 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.755945 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:39.719904 19622 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:39.726008 19798 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:39.717825 19851 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:39.757290 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:39.757709 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 429) took 2953 ms. Trace:
I20260709 13:19:39.757579 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:39.759624 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:39.767839 16807 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:39.763010 16922 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:39.750120 16956 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:39.763935 16959 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:19:39.770956 19919 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:39.765631 18987 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:39.761341 16953 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.773463 19769 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:39.777989 19769 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.778334 19769 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.735752 19897 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:39.781416 16922 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:39.766136 17526 rpcz_store.cc:276] 0709 13:19:36.794871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.328742 (+533871us) service_pool.cc:224] Handling call
0709 13:19:37.331009 (+  2267us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:37.331482 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:37.496287 (+164805us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.872941 (+1376654us) spinlock_profiling.cc:243] Waited 970 us on lock 0x7b18002f42e0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeeec3e4bc 00007feeebf8c48b 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa6455 00007feeef08e060 00007feeef0a0716 00007feeef0b1287
0709 13:19:38.884115 (+ 11174us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.996469 (+112354us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:39.083449 (+ 86980us) log.cc:844] Serialized 52 byte log entry
0709 13:19:39.083642 (+   193us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.083903 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.084081 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.135564 (+ 51483us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.747795 (+612231us) raft_consensus.cc:1685] finished
0709 13:19:39.747814 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.747939 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32672,"prepare.queue_time_us":218638,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":2527,"raft.queue_time_us":143607,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":22040,"spinlock_wait_cycles":2230144,"thread_start_us":504147,"threads_started":4,"wal-append.queue_time_us":607983,"wal-append.run_cpu_time_us":1670,"wal-append.run_wall_time_us":1111657}
I20260709 13:19:39.781785 17523 raft_consensus.cc:1240] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:39.759781 19874 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8.
I20260709 13:19:39.675341 19914 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.797098 19524 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:39.773058 19798 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:39.661948 19911 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.801563 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:39.779549 19898 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:39.803009 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:39.709483 19918 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.808492 19798 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:39.758107 19739 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.962590 16883 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:39.798985 19896 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:39.765309 19669 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.765430 19880 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.774643 19851 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.807511 19787 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:19:39.799620 19907 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:39.746325 19894 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:39.953331 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 151835us
I20260709 13:19:39.952813 19524 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:39.956498 16807 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:39.958217 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:39.957000 19919 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:39.959879 19641 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:39.954244 17492 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:39.976184 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1529) took 1716 ms. Trace:
I20260709 13:19:39.956221 19622 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:40.000170 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 45961.9us
I20260709 13:19:40.000396 19958 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:40.000962 19958 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:40.001317 19958 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.016156 19665 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.016848 19665 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:40.019230 19665 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.021606 19958 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.977542 19907 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:39.981065 16809 rpcz_store.cc:276] 0709 13:19:38.250066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.388048 (+137982us) service_pool.cc:224] Handling call
0709 13:19:38.428520 (+ 40472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:38.830258 (+401738us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:39.090562 (+260304us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.238383 (+147821us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:39.253240 (+ 14857us) log.cc:844] Serialized 52 byte log entry
0709 13:19:39.253376 (+   136us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:39.253405 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.960845 (+707440us) spinlock_profiling.cc:243] Waited 947 us on lock 0x7b1800437ce0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf772a6 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419
0709 13:19:39.966107 (+  5262us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54002a7954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:39.966175 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:39.966271 (+    96us) raft_consensus.cc:1685] finished
0709 13:19:39.966291 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:39.966463 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9416,"prepare.queue_time_us":377395,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2321,"raft.queue_time_us":82883,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":106828,"spinlock_wait_cycles":549238784,"thread_start_us":399662,"threads_started":3,"wal-append.queue_time_us":255466}
I20260709 13:19:40.026559 16807 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:39.972846 19880 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:39.980660 19897 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:39.966513 19883 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:39.978722 19524 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:39.983471 19919 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:40.067142 19918 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.025957 19894 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:40.057952 19907 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.093389 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 1808) took 1126 ms. Trace:
I20260709 13:19:40.096401 16884 rpcz_store.cc:276] 0709 13:19:38.966980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.982576 (+ 15596us) service_pool.cc:224] Handling call
0709 13:19:40.093095 (+1110519us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400318654. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:40.093285 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519087872}
I20260709 13:19:40.090969 16809 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:40.093396 19903 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.094236 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 1801) took 1135 ms. Trace:
I20260709 13:19:40.098143 16877 rpcz_store.cc:276] 0709 13:19:38.958968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.959150 (+   182us) service_pool.cc:224] Handling call
0709 13:19:38.980007 (+ 20857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.214563 (+234556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.214590 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.214623 (+    33us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.214649 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.093980 (+879331us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000b4354. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:40.094042 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.094179 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540871296}
I20260709 13:19:39.999516 19622 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.100553 16807 raft_consensus.cc:1240] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:19:40.102092 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 101008us
I20260709 13:19:40.107905 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.108304 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:40.108650 16877 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:40.109018 16884 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:40.077520 19897 raft_consensus.cc:697] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:40.111245 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.099576 19868 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:40.122390 16950 raft_consensus.cc:606] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:40.123373 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:40.139943 19887 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 1.463s	user 0.003s	sys 0.000s
I20260709 13:19:40.141034 17518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 431) took 2348 ms. Trace:
I20260709 13:19:40.141390 17518 rpcz_store.cc:276] 0709 13:19:37.792211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.792932 (+   721us) service_pool.cc:224] Handling call
0709 13:19:37.793319 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:38.052775 (+259456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.054704 (+  1929us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:38.096186 (+ 41482us) log.cc:844] Serialized 26 byte log entry
0709 13:19:38.372987 (+276801us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:38.373041 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:38.373111 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.139388 (+1766277us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:40.140758 (+  1370us) raft_consensus.cc:1685] finished
0709 13:19:40.140778 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.140981 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40947,"raft.queue_time_us":48480,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":13943,"spinlock_wait_cycles":9804032,"thread_start_us":473984,"threads_started":2,"wal-append.queue_time_us":508489}
I20260709 13:19:40.143272 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:40.143865 17518 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
W20260709 13:19:40.144044 19952 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:19:40.144827 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:40.119666 19739 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:40.145560 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.145637 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.149372 17518 raft_consensus.cc:2410] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:19:40.149435 19954 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:19:40.152031 16958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1902) took 2384 ms. Trace:
I20260709 13:19:40.155431 17519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 443) took 1420 ms. Trace:
I20260709 13:19:40.132300 19769 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.159910 16877 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:40.427445 17518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44626 (request call id 689) took 1124 ms. Trace:
I20260709 13:19:40.428042 17518 rpcz_store.cc:276] 0709 13:19:39.303206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.144618 (+841412us) service_pool.cc:224] Handling call
0709 13:19:40.427370 (+282752us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:40.323793 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.322779 16884 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:40.443737 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.445147 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.447111 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:40.441828 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 337807us
I20260709 13:19:40.460035 17519 rpcz_store.cc:276] 0709 13:19:38.735011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.735127 (+   116us) service_pool.cc:224] Handling call
0709 13:19:38.739116 (+  3989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.930555 (+191439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:38.930598 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:38.930650 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:38.930706 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.155213 (+1224507us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54005d0a54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:40.155267 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.155379 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410205952}
I20260709 13:19:40.462196 16884 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.424356 16958 rpcz_store.cc:276] 0709 13:19:37.767605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.776911 (+  9306us) service_pool.cc:224] Handling call
0709 13:19:37.788893 (+ 11982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:38.059701 (+270808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.151797 (+2092096us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b540026c854. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:40.151977 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621395712}
I20260709 13:19:40.425741 16879 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
W20260709 13:19:40.466710 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 484033us
I20260709 13:19:40.472411 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:40.474735 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:40.159736 19890 consensus_meta.cc:287] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.010s
W20260709 13:19:40.418489 19953 log.cc:927] Time spent T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:19:40.474994 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.479125 16879 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:40.481432 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:40.483717 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.484588 16879 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:40.485683 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.486441 16879 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:40.145525 19921 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.490821 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:40.492242 19960 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:19:40.492624 16877 pending_rounds.cc:85] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 3
I20260709 13:19:40.492925 16877 pending_rounds.cc:107] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:19:40.493168 16877 raft_consensus.cc:2889] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:40.487756 19890 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.469475 19851 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:40.502111 19622 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.147356 19911 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:40.423007 19798 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.508251 19798 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:40.193769 19958 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:40.463140 19896 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:40.196858 19855 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:40.530614 19855 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:40.531785 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.533972 19590 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:40.534494 19590 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:40.413225 19524 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.536491 19590 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:40.511994 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1545) took 1574 ms. Trace:
I20260709 13:19:40.382426 19883 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.488533 16884 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:19:40.525030 19890 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:40.385553 19919 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.537186 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:40.554868 17519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44636 (request call id 883) took 1252 ms (client timeout 1652 ms). Trace:
I20260709 13:19:40.196640 19914 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.536549 19851 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:40.555341 17519 rpcz_store.cc:269] 0709 13:19:39.302030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.536871 (+1234841us) service_pool.cc:224] Handling call
0709 13:19:40.554796 (+ 17925us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.491657 19769 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:40.505386 19907 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.537252 16880 rpcz_store.cc:276] 0709 13:19:38.937232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.947528 (+ 10296us) service_pool.cc:224] Handling call
0709 13:19:38.949292 (+  1764us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.705837 (+756545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.705879 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.709062 (+  3183us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.878305 (+169243us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.885708 (+  7403us) log.cc:844] Serialized 14 byte log entry
0709 13:19:39.891565 (+  5857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.891640 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:40.511753 (+620113us) raft_consensus.cc:1685] finished
0709 13:19:40.511770 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.511901 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23675,"prepare.queue_time_us":185,"prepare.run_cpu_time_us":12369,"prepare.run_wall_time_us":75856,"raft.queue_time_us":126415,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":34670,"thread_start_us":899035,"threads_started":2,"wal-append.queue_time_us":261077}
I20260709 13:19:40.489367 19961 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:40.587338 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:40.591763 18987 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:40.563313 19896 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.270704 19897 consensus_queue.cc:237] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:40.619971 17518 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:40.577018 19894 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:40.630259 16803 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.016s	sys 0.021s
W20260709 13:19:40.626601 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 174805us
I20260709 13:19:40.576503 19787 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:40.630908 16803 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.017s	sys 0.021s
I20260709 13:19:40.616567 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:40.631492 17519 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:40.585877 19739 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.618150 19907 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:40.626456 19961 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.637758 19524 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:19:40.645596 16953 raft_consensus.cc:3055] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:40.653439 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:40.620744 19896 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.653836 16953 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:40.654102 16951 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:40.624694 19590 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:19:40.651331 16959 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:40.651654 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:40.630474 19844 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:40.652357 17520 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44648 (request call id 437) took 2724 ms (client timeout 2201 ms). Trace:
I20260709 13:19:40.666626 17524 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:40.677770 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44636 (request call id 882) took 1377 ms. Trace:
W20260709 13:19:40.655200 19899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.138s	user 0.008s	sys 0.020s
I20260709 13:19:40.678328 17524 rpcz_store.cc:276] 0709 13:19:39.300338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.651410 (+1351072us) service_pool.cc:224] Handling call
0709 13:19:40.677696 (+ 26286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.654628 16953 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.684494 16953 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:40.592550 16877 raft_consensus.cc:2955] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
W20260709 13:19:40.666214 17520 rpcz_store.cc:269] 0709 13:19:37.921550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.924952 (+  3402us) service_pool.cc:224] Handling call
0709 13:19:40.644824 (+2719872us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54006428d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:40.645686 (+   862us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484750720}
I20260709 13:19:40.635044 19894 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:40.636291 19787 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:40.712962 19964 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:19:40.732316 16884 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:19:40.732775 16884 pending_rounds.cc:85] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 4
I20260709 13:19:40.733026 16884 pending_rounds.cc:107] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:40.733285 16884 raft_consensus.cc:2889] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:40.713725 19969 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:19:40.716732 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:40.737231 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.737938 16884 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:40.718520 19776 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:40.684204 19907 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:40.719235 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.748440 16882 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:40.719933 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:40.749387 16880 raft_consensus.cc:3060] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.720556 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1537) took 1793 ms. Trace:
I20260709 13:19:40.721745 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 1558) took 1019 ms. Trace:
I20260709 13:19:40.711114 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:40.646678 19739 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:40.680855 19896 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:40.683893 19899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.008s	sys 0.021s
I20260709 13:19:40.734768 17519 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
W20260709 13:19:40.759358 17519 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44636 (request call id 881) took 1470 ms (client timeout 1809 ms). Trace:
I20260709 13:19:40.750087 16878 rpcz_store.cc:276] 0709 13:19:38.927531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.927630 (+    99us) service_pool.cc:224] Handling call
0709 13:19:38.956624 (+ 28994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.728344 (+771720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.720316 (+991972us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b5400342e54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:40.720498 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742449024}
I20260709 13:19:40.758169 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:40.759714 17519 rpcz_store.cc:269] 0709 13:19:39.289383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.585856 (+1296473us) service_pool.cc:224] Handling call
0709 13:19:40.759302 (+173446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.762385 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:40.759943 16883 rpcz_store.cc:276] 0709 13:19:39.702434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.726832 (+ 24398us) service_pool.cc:224] Handling call
0709 13:19:40.721585 (+994753us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400145fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:40.721688 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474661632}
I20260709 13:19:40.766484 16810 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:40.767635 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.767812 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:40.768270 16807 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.768404 16802 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:40.769179 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:40.770123 17524 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:40.771183 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:40.774060 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 685) took 2032 ms. Trace:
I20260709 13:19:40.774672 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1547) took 1095 ms. Trace:
I20260709 13:19:40.774995 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:40.774458 17520 rpcz_store.cc:276] 0709 13:19:38.741577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.773230 (+2031653us) service_pool.cc:224] Handling call
0709 13:19:40.773501 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.773686 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.773723 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.773775 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:40.773818 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.773888 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.774008 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.775794 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.776191 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.776343 16882 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:40.776955 19524 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:40.777522 19524 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:40.777681 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:40.777925 19524 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:40.778085 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:40.778793 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.779896 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:40.780191 19968 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:19:40.780294 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:40.781105 16801 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:40.760258 19907 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:40.781713 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:40.681409 19844 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.776298 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:40.784037 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:40.776747 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 884) took 1017 ms. Trace:
I20260709 13:19:40.787031 17520 rpcz_store.cc:276] 0709 13:19:39.760051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.776055 (+1016004us) service_pool.cc:224] Handling call
0709 13:19:40.776311 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.776459 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.776482 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.776518 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:40.776577 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.776621 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.776703 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.776999 19899 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:40.775063 16804 rpcz_store.cc:276] 0709 13:19:39.679390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.996952 (+317562us) service_pool.cc:224] Handling call
0709 13:19:39.997336 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.997590 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:40.032534 (+ 34944us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.774360 (+741826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.774409 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:40.774460 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.774519 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.774623 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":581659,"prepare.queue_time_us":36202,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":587040,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":155397,"threads_started":1,"wal-append.queue_time_us":554254}
I20260709 13:19:40.763427 19903 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.795855 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.789537 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 688) took 1567 ms. Trace:
I20260709 13:19:40.799798 17524 rpcz_store.cc:276] 0709 13:19:39.221965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.788639 (+1566674us) service_pool.cc:224] Handling call
0709 13:19:40.788918 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.789149 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.789185 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.789240 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:40.789287 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.789355 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.789471 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.801296 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:40.802127 17524 raft_consensus.cc:2393] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:40.803136 16883 raft_consensus.cc:1240] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:40.794030 19899 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:40.804790 19874 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:40.804993 19899 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:40.805322 19874 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.807371 19874 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:40.807952 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.809152 19685 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:40.809219 19851 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:40.809731 19685 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.802742 19903 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:40.811805 19769 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:40.811859 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.812443 19961 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.813401 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.813797 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 885) took 1048 ms. Trace:
I20260709 13:19:40.813405 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.814172 17520 rpcz_store.cc:276] 0709 13:19:39.765280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.789951 (+1024671us) service_pool.cc:224] Handling call
0709 13:19:40.813352 (+ 23401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.813511 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.813545 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.813584 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:40.813615 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.813667 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.813749 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.789258 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 880) took 1502 ms. Trace:
I20260709 13:19:40.812089 19903 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:40.815464 17521 rpcz_store.cc:276] 0709 13:19:39.286459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.788571 (+1502112us) service_pool.cc:224] Handling call
0709 13:19:40.788823 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.788965 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.788988 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.789026 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:40.789055 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.789106 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.789195 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:40.819382 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:40.788359 19974 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.819630 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.821381 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:40.794298 19849 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:40.799664 19914 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:40.840410 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.842608 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.843333 16884 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:40.811606 19685 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:40.833421 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:40.833606 16882 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:40.824713 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.825479 16804 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:40.834460 19966 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:40.835379 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.835702 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:40.812484 19769 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:40.768465 19896 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.836859 16773 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:40.757375 19776 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.844972 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.847865 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:40.795077 19855 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.852236 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:40.852344 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 55685.8us
I20260709 13:19:40.833029 16807 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:19:40.890775 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:40.892366 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.846901 16801 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:40.796115 19940 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:19:40.871238 16803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1551) took 1142 ms. Trace:
I20260709 13:19:40.896677 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.837466 19849 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:40.853313 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:40.840029 19777 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.862257 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:40.868072 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:40.870229 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.842958 19890 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:40.894366 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 57575.8us
I20260709 13:19:40.894781 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.898801 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:40.922663 16883 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:40.922925 16801 raft_consensus.cc:2410] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:40.897105 16959 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:40.817543 19970 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:19:40.836301 19974 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.931572 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:40.908718 19911 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:40.920792 19849 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:40.935343 19787 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:40.872151 19882 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:40.869861 19961 consensus_queue.cc:1059] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:19:40.945493 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:40.961129 17520 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:40.972891 17524 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:40.974547 19984 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.978348 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.951505 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1551) took 1964 ms. Trace:
I20260709 13:19:40.975055 19984 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:40.979839 16885 rpcz_store.cc:276] 0709 13:19:38.987022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.568431 (+581409us) service_pool.cc:224] Handling call
0709 13:19:39.578239 (+  9808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.630044 (+ 51805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.630074 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.630110 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:39.630142 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.951230 (+1321088us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b54002f6f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:40.951286 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.951429 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118692608}
I20260709 13:19:40.980787 17524 raft_consensus.cc:2410] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 13:19:40.981514 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:40.981804 19984 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:40.981431 16801 raft_consensus.cc:2955] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:19:40.982594 19984 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:40.982925 16802 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:40.870862 19966 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:40.989094 16880 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
W20260709 13:19:40.969709 19979 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:19:40.966264 19975 log.cc:927] Time spent T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:19:40.942030 19894 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:40.930371 19777 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:40.948155 19911 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:40.973474 19739 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:40.932847 19890 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.002936 16802 raft_consensus.cc:1240] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:41.007463 16807 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:41.010128 19776 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:41.010972 19777 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:41.013481 17518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44636 (request call id 879) took 1733 ms (client timeout 1665 ms). Trace:
W20260709 13:19:41.014021 17518 rpcz_store.cc:269] 0709 13:19:39.279915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.472182 (+1192267us) service_pool.cc:224] Handling call
0709 13:19:41.013265 (+541083us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54005a5d54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:41.013398 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337751808}
I20260709 13:19:41.018847 19885 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:41.019423 19885 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:41.020399 19885 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.021672 19985 raft_consensus.cc:3055] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:41.022099 19985 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:41.002344 19911 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:41.015362 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:40.961071 19895 consensus_queue.cc:1059] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:19:41.027244 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 129539us
I20260709 13:19:41.032989 17518 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:41.033670 17518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 887) took 1250 ms. Trace:
I20260709 13:19:41.034004 17518 rpcz_store.cc:276] 0709 13:19:39.782903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.030547 (+1247644us) service_pool.cc:224] Handling call
0709 13:19:41.031200 (+   653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.033450 (+  2250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.033623 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:41.035660 17518 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:41.036164 17518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 447) took 1238 ms. Trace:
I20260709 13:19:41.036399 17518 rpcz_store.cc:276] 0709 13:19:39.797889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.034616 (+1236727us) service_pool.cc:224] Handling call
0709 13:19:41.035550 (+   934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.036006 (+   456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.036128 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:41.011539 19864 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:41.038106 19981 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:19:41.038666 19980 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:19:41.041015 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:41.042522 17518 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:40.989899 19882 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.031594 19844 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.044534 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1560) took 1341 ms. Trace:
I20260709 13:19:41.042694 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:41.046052 17518 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:41.044917 16877 rpcz_store.cc:276] 0709 13:19:39.702927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.491738 (+788811us) service_pool.cc:224] Handling call
0709 13:19:40.492296 (+   558us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:40.493840 (+  1544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:40.493872 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:40.495324 (+  1452us) log.cc:844] Serialized 544 byte log entry
0709 13:19:40.592418 (+ 97094us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:40.759558 (+167140us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.873741 (+114183us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.874935 (+  1194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.875002 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.027197 (+152195us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b180034fde0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebfa93f3 00007feeebfab7c1 00007feeebfab779 00007feeebfab709 00007feeebfab6d1 00007feeebfaa9cd 000000000038f354 000000000038f199 00007feeebf8c83a
0709 13:19:41.044341 (+ 17144us) raft_consensus.cc:1685] finished
0709 13:19:41.044363 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.044484 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":187315,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1719,"raft.queue_time_us":1071,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":27530,"spinlock_wait_cycles":3224448,"thread_start_us":187077,"threads_started":2,"wal-append.queue_time_us":272780}
I20260709 13:19:41.050532 19899 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.052294 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1908) took 3214 ms. Trace:
I20260709 13:19:41.044766 19683 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:41.059923 19683 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:41.024310 19985 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.055127 16954 rpcz_store.cc:276] 0709 13:19:37.838134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:37.838247 (+   113us) service_pool.cc:224] Handling call
0709 13:19:37.838531 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:37.993486 (+154955us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:37.993752 (+   266us) log.cc:844] Serialized 14 byte log entry
0709 13:19:38.137548 (+143796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:38.137631 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:38.137730 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.052089 (+2914359us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54000537d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:41.052138 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.052243 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2145,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":2297,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":2810,"spinlock_wait_cycles":355864448,"thread_start_us":141147,"threads_started":1,"wal-append.queue_time_us":563423,"wal-append.run_cpu_time_us":1907,"wal-append.run_wall_time_us":1179469}
W20260709 13:19:41.058207 19977 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:19:41.054389 19918 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:41.059468 19855 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.064349 19913 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:41.054247 19889 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 2.397s	user 0.000s	sys 0.013s
I20260709 13:19:41.069849 19918 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.069630 19524 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.060570 19769 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.060340 19683 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.071599 19890 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:41.077003 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 104027us
I20260709 13:19:41.214906 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.203079 16880 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:19:41.088078 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:41.224566 16802 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
W20260709 13:19:41.139304 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 46158.6us
W20260709 13:19:41.228216 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.088356 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:41.229022 16809 raft_consensus.cc:2410] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:19:41.205053 19886 log.cc:927] Time spent T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 2.421s	user 0.010s	sys 0.000s
I20260709 13:19:41.138234 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.235208 16878 raft_consensus.cc:2410] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:19:41.081683 19918 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.235725 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.213423 19896 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:41.236605 16880 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:41.239084 19885 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:41.087781 19913 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:41.241739 19683 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.244490 19800 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.246019 19798 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:41.089104 19524 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.234651 19868 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.214088 19899 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.248085 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:41.088023 19911 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.256621 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.164083 19990 consensus_queue.cc:1059] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:19:41.255508 19798 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:41.260265 19934 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 1.747s	user 0.010s	sys 0.006s
I20260709 13:19:41.252306 19885 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.257133 19868 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.270411 19890 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.271283 19798 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.271324 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:41.276664 16885 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:41.274024 19926 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 1.991s	user 0.003s	sys 0.018s
I20260709 13:19:41.274138 19683 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.278566 19890 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.293756 17527 raft_consensus.cc:1240] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:41.295001 17527 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:41.295240 17520 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:41.297428 19885 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.297870 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:41.301016 19890 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:41.308746 19994 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:41.313491 16885 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:41.314769 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.315452 16802 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:41.267222 19913 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:41.320811 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.319235 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 684) took 2577 ms. Trace:
I20260709 13:19:41.323928 19913 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.321321 17522 rpcz_store.cc:276] 0709 13:19:38.741327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.065576 (+324249us) service_pool.cc:224] Handling call
0709 13:19:39.074812 (+  9236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:39.075033 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.075058 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:39.075482 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:19:39.206445 (+130963us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:39.206487 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:39.206557 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.273519 (+2066962us) spinlock_profiling.cc:243] Waited 970 us on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:41.301460 (+ 27941us) raft_consensus.cc:1685] finished
0709 13:19:41.301485 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.319149 (+ 17664us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231040,"thread_start_us":130590,"threads_started":1,"wal-append.queue_time_us":202775}
I20260709 13:19:41.326399 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.326753 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:41.328846 19831 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:40.895874 16803 rpcz_store.cc:276] 0709 13:19:39.728655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:40.072386 (+343731us) service_pool.cc:224] Handling call
0709 13:19:40.072698 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.072901 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:40.631293 (+558392us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.849404 (+218111us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.870777 (+ 21373us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.870856 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:40.870919 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.871004 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:40.871171 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46714,"prepare.queue_time_us":29620,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":66,"raft.queue_time_us":48158,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":17375,"spinlock_wait_cycles":37971456,"thread_start_us":747409,"threads_started":2}
I20260709 13:19:41.314705 19868 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:41.310547 19967 raft_consensus.cc:3055] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:41.334497 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.339370 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.335343 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.336606 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.339464 16951 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.335160 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.329347 19831 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.344201 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.351819 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.352416 16956 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:41.353188 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.339272 19967 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:41.373612 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:41.374046 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.375372 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.376236 16956 raft_consensus.cc:2410] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:41.406924 19911 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.407980 19831 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:41.408774 19967 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.420604 16951 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:41.422327 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.422936 16956 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:41.423282 19918 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.426235 19776 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.426751 19776 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.427237 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.427795 16884 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:41.428361 16953 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:41.428759 19765 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:41.422165 19849 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:41.431058 19995 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:19:41.432130 19849 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:41.432636 19829 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:41.433341 19967 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.436822 16957 raft_consensus.cc:2410] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:41.439021 16958 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:41.441200 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.446803 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.448626 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.449863 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.450819 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.451767 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.452760 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.452790 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.453480 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.453840 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.454733 16954 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:19:41.455924 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.456779 16952 raft_consensus.cc:2368] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8.
I20260709 13:19:41.457741 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.459993 19985 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.461099 16950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50296 (request call id 11) took 2390 ms. Trace:
I20260709 13:19:41.461440 16950 rpcz_store.cc:276] 0709 13:19:39.070846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.070988 (+   142us) service_pool.cc:224] Handling call
0709 13:19:41.460939 (+2389951us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003093d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef090853 00007feef405e60a 00007feeed5e47d4 00007feeed5e4762 00007feeed5e4691 00007feeed5e460c 00007feeed5e38c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:41.461022 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385629440}
I20260709 13:19:41.468513 19635 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.482300 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.489861 19966 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.492739 19918 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:41.499204 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.501466 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.503110 16956 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:41.503423 16950 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:19:41.503785 16950 pending_rounds.cc:85] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 3
I20260709 13:19:41.503993 16950 pending_rounds.cc:107] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:19:41.504271 16950 raft_consensus.cc:2889] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:41.504233 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.505105 16951 raft_consensus.cc:2368] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8.
I20260709 13:19:41.505430 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:41.505843 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 87344.9us
I20260709 13:19:41.504061 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.504125 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.505988 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.511933 16958 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:41.516440 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:41.518924 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.519047 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:41.522091 19680 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.523325 19907 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:41.531122 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 1809) took 2560 ms. Trace:
I20260709 13:19:41.532094 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.533041 16881 rpcz_store.cc:276] 0709 13:19:38.967217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.067029 (+ 99812us) service_pool.cc:224] Handling call
0709 13:19:39.067391 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:41.517499 (+2450108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.517546 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:41.517600 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:41.517638 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.527118 (+  9480us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b5400342954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:41.527177 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.527319 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5634103680}
I20260709 13:19:41.533197 16959 raft_consensus.cc:2376] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7. Re-sending same reply.
I20260709 13:19:41.544075 19680 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.005s
W20260709 13:19:41.549952 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.550243 19776 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:41.551038 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.551753 19569 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.552261 19569 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.554821 19569 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:41.561537 17552 heartbeater.cc:646] Failed to heartbeat to 127.15.90.62:35161 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.15.90.62:35161 timed out after 15.000s (SENT)
I20260709 13:19:41.565693 19907 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.566149 19961 raft_consensus.cc:3055] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:41.566210 19907 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.566689 19961 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:41.565734 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:41.569310 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.569538 16959 raft_consensus.cc:606] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:41.570096 16952 raft_consensus.cc:2410] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:41.571185 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.570665 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.573855 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.573920 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.574868 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.575394 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.576288 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:41.576496 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 98198.4us
I20260709 13:19:41.576889 16881 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:41.578871 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.580974 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.567515 19967 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:41.582736 16775 leader_election.cc:400] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8.
I20260709 13:19:41.586054 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.588565 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.587704 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.590107 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.590701 16878 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:41.591207 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:41.589260 16881 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:41.576328 19776 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:41.576195 19680 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:41.567704 19753 consensus_queue.cc:1059] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:19:41.581283 19778 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:41.596072 19890 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:41.602491 19907 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:41.602682 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:41.587211 19967 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:41.584233 19505 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:19:41.581867 19569 consensus_queue.cc:1059] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:19:41.610455 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:41.612236 16881 raft_consensus.cc:2376] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6. Re-sending same reply.
I20260709 13:19:41.612566 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:41.586378 19770 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:19:41.613148 16959 raft_consensus.cc:606] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:41.609154 19635 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:41.615494 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.616075 16952 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:41.616623 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.617368 16881 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:41.608579 19967 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.614482 19635 raft_consensus.cc:697] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:41.637199 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:41.637804 17521 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:41.637681 19635 consensus_queue.cc:237] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.639285 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.619556 19680 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:41.641409 19680 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.642503 16880 raft_consensus.cc:2393] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:41.643329 19680 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.626960 19882 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.632880 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1549) took 2662 ms. Trace:
I20260709 13:19:41.635061 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:41.636596 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:41.644354 19853 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:41.645825 16952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:41.668439 16952 raft_consensus.cc:606] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:41.668777 16952 raft_consensus.cc:614] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:41.647920 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:41.669384 17526 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:41.599973 19961 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.625169 19991 raft_consensus.cc:3055] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:41.657526 19925 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:41.664664 16876 rpcz_store.cc:276] 0709 13:19:38.970747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.169155 (+198408us) service_pool.cc:224] Handling call
0709 13:19:40.094320 (+925165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:40.094532 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:40.094834 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:19:40.557523 (+462689us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:40.557586 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:40.557643 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:40.557729 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.632016 (+1074287us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b1800380a40. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf772a6 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4
0709 13:19:41.632738 (+   722us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b5400318650. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:41.632833 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3781,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":295,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":18334,"spinlock_wait_cycles":2136731904,"thread_start_us":462029,"threads_started":1,"wal-append.queue_time_us":531644}
I20260709 13:19:41.672056 16848 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:41.673295 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 395) took 2717 ms. Trace:
I20260709 13:19:41.673655 16806 rpcz_store.cc:276] 0709 13:19:38.951779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.970199 (+ 18420us) service_pool.cc:224] Handling call
0709 13:19:38.994557 (+ 24358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.266127 (+271570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:39.266164 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:39.266204 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:39.266232 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.668464 (+2402232us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54003e8ad4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:41.668517 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.668625 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624052096}
I20260709 13:19:41.676756 16848 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:41.678848 19881 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:41.679216 19881 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:41.679571 19881 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.682718 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:41.684912 19905 raft_consensus.cc:3055] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:41.685258 19905 raft_consensus.cc:740] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:41.685956 19905 consensus_queue.cc:260] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.687059 19905 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:41.688546 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:41.689417 19882 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:41.689792 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.689877 19882 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.691159 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 877) took 3437 ms. Trace:
I20260709 13:19:41.690428 16954 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:41.691578 17523 rpcz_store.cc:276] 0709 13:19:38.253440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.253905 (+   465us) service_pool.cc:224] Handling call
0709 13:19:38.254180 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:39.789780 (+1535600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.690887 (+1901107us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54002526d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:41.691087 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3512564480}
I20260709 13:19:41.695264 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:41.698056 19880 consensus_queue.cc:1059] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:41.698912 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.699077 19880 raft_consensus.cc:3055] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:41.699461 19880 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:41.700227 19880 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.701514 19880 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:41.704355 19505 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:41.704744 19505 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:41.705098 19505 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:41.708024 16848 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:41.708647 19961 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:41.708688 19776 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:41.709271 19776 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.709591 19776 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.690442 19882 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.714728 19669 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.717998 16848 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:41.720108 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:41.721128 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.721902 16951 raft_consensus.cc:2410] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:19:41.671353 19932 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:41.727905 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.728014 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.727934 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.728979 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.730471 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.674319 19991 raft_consensus.cc:740] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:41.732456 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:41.745975 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.734704 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.693835 19680 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:41.750663 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.740947 19914 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:41.741357 19776 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.742344 19861 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:41.740967 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.753772 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.754585 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.743121 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.737152 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.747859 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:41.749158 16877 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:41.740535 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.758239 17524 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:41.749868 17492 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:41.762581 16878 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:19:41.763288 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 45900.2us
I20260709 13:19:41.766098 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.766642 16951 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:19:41.769735 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:41.770387 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.755188 16954 raft_consensus.cc:2376] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8. Re-sending same reply.
I20260709 13:19:41.771777 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.772328 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.744772 19753 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:41.772864 16954 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:41.731101 19932 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:41.772485 16882 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:41.775739 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.776881 16883 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:19:41.780356 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.781929 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.765746 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.775357 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.784140 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.751614 19846 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:41.730144 19967 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.786964 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:41.752141 19922 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:41.792328 16951 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:41.793130 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:41.793941 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.795270 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.796773 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.791970 16881 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:41.789294 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.786031 19861 raft_consensus.cc:697] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:41.802170 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.804255 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.805904 16775 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.778376 19914 raft_consensus.cc:2804] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:41.807060 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.813977 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.807247 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.800719 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.814389 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.809480 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.810222 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:41.810676 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 444) took 3071 ms. Trace:
I20260709 13:19:41.818524 16956 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:41.753494 19641 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:19:41.777613 19753 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:41.783263 19932 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:41.819572 16881 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:41.820487 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.818626 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.828800 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.805913 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.751966 19853 consensus_queue.cc:1059] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:19:41.787580 19569 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:41.830328 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.815750 17525 rpcz_store.cc:276] 0709 13:19:38.739444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:38.739857 (+   413us) service_pool.cc:224] Handling call
0709 13:19:38.740150 (+   293us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:40.713583 (+1973433us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b18000c6c40. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeeec3e4bc 00007feeebf8c48b 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa6455 00007feeef08e060 00007feeef08ebfb 00007feeef09964b
0709 13:19:40.713731 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:40.713759 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:40.714375 (+   616us) log.cc:844] Serialized 52 byte log entry
0709 13:19:40.823835 (+109460us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:40.823886 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:41.810379 (+986493us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400378f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:41.810428 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:41.810468 (+    40us) raft_consensus.cc:1685] finished
0709 13:19:41.810480 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:41.810626 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25746,"raft.queue_time_us":68170,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":4432,"spinlock_wait_cycles":283952896,"thread_start_us":205605,"threads_started":2,"wal-append.queue_time_us":138192}
I20260709 13:19:41.831638 16951 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 13:19:41.787765 19846 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:41.836477 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.839710 16951 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:19:41.771446 19732 consensus_queue.cc:1059] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:19:41.842710 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.843266 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:41.802588 19901 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:41.845681 16951 pending_rounds.cc:85] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 3
I20260709 13:19:41.848018 16951 pending_rounds.cc:107] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:19:41.848356 16951 raft_consensus.cc:2889] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:41.812896 19895 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:41.849939 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.850481 16883 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:41.852277 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:41.817836 19687 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:41.822286 19890 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:41.856560 16850 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:41.818161 19669 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.820120 19874 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:41.858208 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 48039.4us
I20260709 13:19:41.873831 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:41.822856 19578 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:41.865154 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:41.834189 19753 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:41.831971 19769 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:41.842823 19941 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:41.848229 19908 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:41.898063 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:41.872393 19958 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:41.833902 19918 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:41.844677 19680 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:41.909155 16924 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:41.910609 19908 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:41.940675 19908 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.941322 19853 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:41.941890 19908 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.941819 19590 consensus_queue.cc:1059] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:41.942167 19512 consensus_queue.cc:1059] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:41.942970 19512 raft_consensus.cc:993] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:19:41.859895 19907 raft_consensus.cc:3055] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:41.943360 19512 raft_consensus.cc:1081] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:19:41.857488 19925 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:41.849182 19846 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.860287 19496 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:41.872361 19800 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:41.947820 19941 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:41.948424 19941 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:41.948539 19967 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:41.949350 19985 raft_consensus.cc:1064] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:19:41.949294 19941 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.941957 19853 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:19:41.898375 19769 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:41.951005 19769 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.857800 19687 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:41.916704 20005 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:19:41.918403 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 44632.9us
I20260709 13:19:41.872020 19914 raft_consensus.cc:697] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:41.968278 19914 consensus_queue.cc:237] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.951872 19687 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:41.973816 19882 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.930970 19893 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:41.947850 19496 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:41.976533 20010 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:19:41.976703 19496 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:41.919201 19505 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.899747 19984 raft_consensus.cc:3055] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:41.843701 19991 consensus_queue.cc:260] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:41.934590 19861 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.943387 19907 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:41.914152 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:41.864941 19890 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:41.939605 16924 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:41.873488 19874 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:41.919425 19776 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:41.958308 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:41.959111 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:41.953843 19958 raft_consensus.cc:697] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:41.960355 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:41.961333 19932 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:41.991247 16848 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
W20260709 13:19:42.002333 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 62809.7us
I20260709 13:19:42.042953 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:41.978348 19881 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:42.062739 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 71602.4us
I20260709 13:19:41.956364 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:42.063964 17524 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.007718 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:42.031716 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:42.046237 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.070125 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:42.005445 19890 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:41.994024 19984 raft_consensus.cc:740] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:42.072278 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.079152 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:42.007318 19910 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:42.008639 19874 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.085476 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.085399 16883 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:42.086197 17524 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:42.087117 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:42.028708 19800 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:42.089424 16885 raft_consensus.cc:1275] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:42.092073 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:42.092526 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:42.095386 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.096652 19800 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.098969 19922 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.080803 19961 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:42.100080 19961 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:42.100253 20007 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:19:42.100492 19961 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:42.102180 19958 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.103157 19922 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:42.103907 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:42.104609 16879 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:42.105008 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.106168 19922 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:42.072623 19776 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:42.107754 19984 consensus_queue.cc:260] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.108384 19776 raft_consensus.cc:697] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:42.109107 19984 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:42.078454 19962 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.109006 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.112617 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.113471 19922 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:42.113258 19907 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.114218 19922 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.114929 19907 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.082346 19990 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:19:41.951411 19985 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.121814 16848 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:42.072257 19791 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:42.085134 19804 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.062166 19753 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.083962 19991 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:42.142479 16922 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:42.155823 16922 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:42.119408 19910 raft_consensus.cc:697] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:42.142764 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 277658us
I20260709 13:19:42.143760 16959 pending_rounds.cc:85] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 6
W20260709 13:19:42.141872 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 327927us
I20260709 13:19:42.147157 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:42.147442 19778 raft_consensus.cc:3055] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:19:42.152110 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.144111 19880 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.139626 19905 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:42.163647 16775 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:42.162976 16959 pending_rounds.cc:107] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:42.166574 16959 raft_consensus.cc:2889] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.167419 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.164291 19778 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:42.170977 19649 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.153904 19853 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:19:42.109223 19776 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.198549 19641 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:19:42.235294 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.258525 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.165599 19680 consensus_queue.cc:1059] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
W20260709 13:19:42.243093 16924 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.686s (SENT) [suppressed 23 similar messages]
I20260709 13:19:42.159152 19990 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:42.172914 16885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44078
W20260709 13:19:42.223908 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 56542.1us
I20260709 13:19:42.174530 19569 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:19:42.207297 19895 raft_consensus.cc:697] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:42.230113 19909 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.164746 19882 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.268488 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.268076 16885 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.283224 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:42.277164 16804 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:19:42.284204 16804 pending_rounds.cc:85] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 3
I20260709 13:19:42.284515 16804 pending_rounds.cc:107] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:42.284783 16804 raft_consensus.cc:2889] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:42.277552 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:42.282327 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:42.289361 16801 raft_consensus.cc:2368] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9.
I20260709 13:19:42.283407 16885 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.292024 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.292768 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:42.174270 19901 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.294898 16810 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:42.261102 19505 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.209218 19846 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.299155 20013 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:42.288563 19909 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.327831 19882 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:42.359110 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:42.342748 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:42.360989 16803 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:42.344336 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:42.365747 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:42.351872 16885 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:42.359884 16804 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:42.389832 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:42.388001 16808 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:19:42.391019 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:42.392006 16803 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:42.206490 19769 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:42.393633 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.174929 19880 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:42.358036 19909 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:42.358481 19882 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.286487 19910 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.264451 19778 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.411018 16808 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:42.428987 16885 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.406594 19882 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.403120 19958 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:42.444842 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 211423us
I20260709 13:19:42.461534 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:42.464453 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:42.465319 16808 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:42.471918 17525 raft_consensus.cc:2368] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9.
W20260709 13:19:42.477630 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.478338 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.479527 17518 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:42.482133 16885 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 9. Ops: []
I20260709 13:19:42.412596 19941 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:19:42.456909 19908 consensus_meta.cc:287] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.007s
I20260709 13:19:42.445183 19778 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:42.495419 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 252335us
W20260709 13:19:42.497447 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.487388 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 195415us
I20260709 13:19:42.433167 19753 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:42.500164 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:42.488183 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:42.499370 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.505826 16804 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:42.511291 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:42.554147 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.557302 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 46093.5us
I20260709 13:19:42.564395 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.567797 16924 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:42.403879 19895 consensus_queue.cc:237] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:42.553431 19687 consensus_meta.cc:287] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
I20260709 13:19:42.498102 19905 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:42.574968 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:42.555253 19569 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.471215 19958 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:42.572108 19925 consensus_meta.cc:287] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.628s	user 0.006s	sys 0.003s
I20260709 13:19:42.564481 19901 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.564888 20015 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:42.577750 19505 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:42.595938 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.605098 19505 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.605660 19505 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:42.601245 19669 consensus_meta.cc:287] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.725s	user 0.010s	sys 0.000s
I20260709 13:19:42.608235 17519 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:42.608486 19669 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.609130 19958 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.578852 19687 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:42.612486 19687 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.613044 20015 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.613448 16810 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:42.615265 20015 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:42.592593 19512 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:19:42.598027 20018 log.cc:927] Time spent T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:19:42.616734 19890 consensus_meta.cc:287] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.000s
W20260709 13:19:42.617239 20029 log.cc:927] Time spent T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:19:42.617164 19890 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:42.620358 20021 log.cc:927] Time spent T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:19:42.619969 19505 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:42.621487 20016 log.cc:927] Time spent T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:19:42.622463 16808 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:42.623759 19687 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:42.624794 20022 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:19:42.626056 19687 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:42.631027 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.634626 16807 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:42.637452 19569 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:42.637948 19569 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:42.638391 19569 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.641776 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:42.599632 19925 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:42.642937 16876 raft_consensus.cc:1240] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:42.643824 20030 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:42.645264 16957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52044 (request call id 1935) took 1277 ms. Trace:
I20260709 13:19:42.645653 16957 rpcz_store.cc:276] 0709 13:19:41.369621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.369871 (+   250us) service_pool.cc:224] Handling call
0709 13:19:42.645072 (+1275201us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b54002eb154. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:42.645209 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142205312}
W20260709 13:19:42.648465 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.647576 19569 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:42.652136 19569 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:42.653983 19961 consensus_meta.cc:287] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.553s	user 0.004s	sys 0.004s
I20260709 13:19:42.619124 19890 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.654386 19961 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.654910 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.655429 17524 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:42.656809 19905 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.622025 19505 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.658398 19505 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:42.658736 19505 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.659072 19505 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:42.639513 16707 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51366 (request call id 186) took 16038 ms (client timeout 15000 ms). Trace:
W20260709 13:19:42.607553 19496 consensus_meta.cc:287] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.630s	user 0.004s	sys 0.005s
I20260709 13:19:42.579573 19908 consensus_queue.cc:1059] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:19:42.574304 20013 consensus_queue.cc:1059] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
W20260709 13:19:42.685101 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.687965 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.699398 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.705657 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.708549 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:42.718101 16801 raft_consensus.cc:2410] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 13:19:42.686616 19590 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:42.660142 16707 rpcz_store.cc:269] 0709 13:19:26.606900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:26.607144 (+   244us) service_pool.cc:224] Handling call
0709 13:19:42.639336 (+16032192us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:34.812388 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:34.813176 (+   788us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:34.813229 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:19:34.813262 (+    33us) tablet.cc:662] Decoding operations
0709 13:19:34.813974 (+   712us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:34.814073 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:34.814108 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:19:34.814647 (+   539us) tablet.cc:701] Row locks acquired
0709 13:19:34.814695 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:19:34.814859 (+   164us) write_op.cc:270] Start()
0709 13:19:34.815019 (+   160us) write_op.cc:276] Timestamp: P: 1783603174814789 usec, L: 0
0709 13:19:34.815062 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:19:34.816158 (+  1096us) log.cc:844] Serialized 1345 byte log entry
0709 13:19:35.552172 (+736014us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:36.087741 (+535569us) op_driver.cc:464] REPLICATION: finished
0709 13:19:36.428361 (+340620us) write_op.cc:301] APPLY: starting
0709 13:19:36.453456 (+ 25095us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:36.495039 (+ 41583us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:36.503594 (+  8555us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:36.521876 (+ 18282us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:36.522160 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:19:36.522209 (+    49us) write_op.cc:312] APPLY: finished
0709 13:19:36.522483 (+   274us) log.cc:844] Serialized 35 byte log entry
0709 13:19:36.522664 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:36.522752 (+    88us) write_op.cc:454] Released schema lock
0709 13:19:36.522803 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:36.523152 (+   349us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:36.523179 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28769,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":320464,"apply.run_cpu_time_us":2651,"apply.run_wall_time_us":104015,"num_ops":3,"prepare.queue_time_us":109432,"prepare.run_cpu_time_us":14141,"prepare.run_wall_time_us":327300,"raft.queue_time_us":341223,"raft.run_cpu_time_us":25140,"raft.run_wall_time_us":237414,"replication_time_us":1250491,"spinlock_wait_cycles":24393984,"thread_start_us":696786,"threads_started":4,"wal-append.queue_time_us":433180,"wal-append.run_cpu_time_us":20522,"wal-append.run_wall_time_us":2274204}]]}
I20260709 13:19:42.715948 19569 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:42.710537 19769 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.673604 19496 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:42.709635 19880 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.734769 16775 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:42.719271 20036 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:42.746361 20036 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.733355 19590 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.748564 20036 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:42.749606 19590 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:42.741183 20013 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:42.755882 19961 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.756295 20013 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.756736 20013 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:42.757011 19496 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.762135 19505 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:42.744503 19882 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:42.744727 19909 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:42.745848 19974 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.774783 16803 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:19:42.772163 19769 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:42.775815 19769 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:42.776212 19769 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.780475 19881 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:42.772526 19907 consensus_meta.cc:287] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.004s
W20260709 13:19:42.786062 20027 log.cc:927] Time spent T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
W20260709 13:19:42.755520 19874 consensus_meta.cc:287] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.627s	user 0.006s	sys 0.003s
I20260709 13:19:42.806949 19505 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:42.808913 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 234017us
I20260709 13:19:42.814515 16924 leader_election.cc:400] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9.
I20260709 13:19:42.817579 16924 leader_election.cc:403] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:42.820442 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:42.889430 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 69075.3us
I20260709 13:19:42.890618 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
W20260709 13:19:42.887130 19896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.008s	sys 0.007s
I20260709 13:19:42.893846 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:42.902493 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:42.796433 19874 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:42.796133 20013 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:42.925208 16850 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.002s	sys 0.036s
W20260709 13:19:42.926918 16880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 1838) took 1288 ms (client timeout 1625 ms). Trace:
W20260709 13:19:42.914742 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:42.928853 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:42.921720 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:42.928696 16880 rpcz_store.cc:269] 0709 13:19:41.638965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.639077 (+   112us) service_pool.cc:224] Handling call
0709 13:19:42.926732 (+1287655us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b5400135e54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:42.926865 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5625216}
W20260709 13:19:42.930281 16850 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.002s	sys 0.036s
W20260709 13:19:42.930660 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 752541us
I20260709 13:19:42.892164 19907 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.891862 19985 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.931326 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:42.930167 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 195445us
I20260709 13:19:42.895717 19984 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:42.941845 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:42.942051 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:42.895805 19896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.008s	sys 0.007s
I20260709 13:19:42.942454 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:42.947649 16956 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:42.942991 16801 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:42.947958 16956 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:42.895996 19908 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:42.944731 16809 raft_consensus.cc:2393] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:42.895613 20030 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:42.926676 19922 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.904670 19851 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:42.927462 19853 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:42.903967 19512 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:42.950953 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:42.948652 16956 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:42.956799 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:42.896052 19590 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:19:42.931556 20035 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:42.959811 16956 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:42.961680 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:42.959924 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:42.962129 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:42.968425 16954 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:42.964438 16880 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:42.965243 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:42.961877 19922 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.972100 19922 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.959877 19851 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:42.973091 19851 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:42.976518 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:42.958417 20030 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:42.978037 16958 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:42.978678 20030 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:42.965823 20044 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.981120 20044 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.982630 19907 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9.
I20260709 13:19:42.965966 19905 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:42.966729 19853 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.986452 19905 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.958318 20049 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:42.987882 19853 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:42.988358 19905 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:42.946585 19985 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:42.989948 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:42.990679 19985 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:42.990993 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:42.991498 16879 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:42.993060 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:42.993350 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:42.993916 16880 raft_consensus.cc:2410] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:42.943949 19776 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:42.944433 19984 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:42.904129 19769 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:42.997366 16806 raft_consensus.cc:2393] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:43.001529 16802 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:43.019778 16954 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:19:43.040653 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1582) took 1181 ms. Trace:
I20260709 13:19:43.052589 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.056779 16883 rpcz_store.cc:276] 0709 13:19:41.865616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.873608 (+  7992us) service_pool.cc:224] Handling call
0709 13:19:41.914766 (+ 41158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.088438 (+173672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.037472 (+949034us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54000ee2d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:43.040576 (+  3104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392032640}
I20260709 13:19:43.005254 20044 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:43.012827 20048 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:43.013998 20013 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:42.997370 19905 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.049270 19791 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:43.053438 16956 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:43.012106 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:43.059429 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:43.006062 19984 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.063822 16882 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:43.066938 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:43.066013 16954 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
W20260709 13:19:43.066493 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.069614 16805 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:43.069269 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:43.070592 16808 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:43.057688 19776 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.071355 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:43.088506 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:43.132676 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 64169.1us
I20260709 13:19:43.134843 16885 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:43.067854 16956 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:43.137741 16954 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:19:43.138302 16954 pending_rounds.cc:85] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 6
I20260709 13:19:43.138748 16954 pending_rounds.cc:107] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:19:43.139115 16954 raft_consensus.cc:2889] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:43.132507 16810 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:43.135036 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:43.068922 19896 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:43.142465 16802 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:43.069067 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:43.144150 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:43.145161 16803 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.145183 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:43.065047 19791 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.073127 19753 raft_consensus.cc:3055] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:19:43.136270 20056 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:19:43.152184 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:43.068966 19922 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:43.084589 19769 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:43.085244 19909 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:43.144333 19861 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:19:43.159148 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:43.159809 16810 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.073899 19590 raft_consensus.cc:2955] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:43.167049 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:43.167716 16806 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.086539 19851 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:43.171281 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:43.150225 19753 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:43.173986 16802 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:43.067257 20050 consensus_queue.cc:1059] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:19:43.070987 19905 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.147281 19961 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:19:43.181219 16810 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:43.141736 19776 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.151211 19896 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.161365 19922 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.192229 19753 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:43.194710 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:43.195518 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:43.208009 16802 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:43.186529 20050 raft_consensus.cc:3055] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:19:43.206595 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.207489 16809 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:43.210427 16806 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:43.174964 19874 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:43.283053 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.298422 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 135308us
I20260709 13:19:43.299875 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:43.301338 16810 raft_consensus.cc:1275] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:43.303212 16809 raft_consensus.cc:3055] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:43.303535 16809 raft_consensus.cc:740] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:43.308969 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.309458 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.313297 16802 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:19:43.314280 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:43.215042 20050 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:43.317260 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:43.317935 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:43.247327 19800 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:43.246622 19687 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:43.588275 19687 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.588449 20050 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.589614 20050 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:43.590468 19687 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:43.592370 16880 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:43.314066 16809 consensus_queue.cc:260] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.326079 16810 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:43.328045 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:43.595178 16806 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:43.304711 19770 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.313799 19753 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:43.691891 16809 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:43.418800 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.450266 16803 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
W20260709 13:19:43.454829 20064 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:19:43.455991 19896 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:43.458259 19776 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:43.459362 20063 log.cc:927] Time spent T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:43.460212 19922 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:43.461098 19851 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:43.464854 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.466128 19905 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:43.485395 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.558825 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 252925us
I20260709 13:19:43.703583 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:43.584674 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:43.583491 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.471567 19984 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:43.704185 16954 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:43.705571 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:43.706643 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.709110 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:43.690053 20035 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:43.694519 19687 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.717203 20035 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:43.699934 19896 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:43.739555 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.694044 19770 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:43.705206 19922 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:43.706744 19909 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:43.740406 20067 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:19:43.779387 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:43.781178 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.740149 19687 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.752635 19922 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.746477 19896 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.791910 19874 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:43.806128 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:43.813719 19791 consensus_meta.cc:287] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.004s
I20260709 13:19:43.814158 19791 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:43.817480 19922 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:43.817762 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.818001 19922 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:43.818326 16885 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:43.818459 19922 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.819293 20073 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:43.819834 20073 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.820274 20071 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.820791 20071 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.821182 19687 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:43.821789 20073 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:43.783396 19909 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.824409 19909 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:43.823999 20073 consensus_queue.cc:1048] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:19:43.828332 19791 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:43.822782 19590 consensus_meta.cc:287] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.001s
W20260709 13:19:43.829994 20006 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 1.927s	user 0.014s	sys 0.000s
I20260709 13:19:43.831545 19770 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:43.832451 19896 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:43.836573 19984 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:43.822773 20071 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:43.838274 16809 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:19:43.839455 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:43.840370 16885 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
W20260709 13:19:43.845577 16850 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.024s	sys 0.074s
W20260709 13:19:43.851040 16850 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.024s	sys 0.074s
W20260709 13:19:43.851356 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 527345us
I20260709 13:19:43.852663 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:43.853670 16885 raft_consensus.cc:2410] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:43.855093 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.856226 16885 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:43.857158 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 58745.8us
W20260709 13:19:43.836608 20037 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 1.146s	user 0.000s	sys 0.020s
I20260709 13:19:43.859431 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.863759 16885 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:43.864094 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.864814 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.865557 16880 raft_consensus.cc:2368] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:19:43.866499 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.867283 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:43.869163 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.870122 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.871347 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:43.872180 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:43.874153 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:43.874698 16807 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:19:43.875622 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.876240 16882 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.876533 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.877215 16880 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.880708 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.882596 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.882813 16877 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:43.883908 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.881472 20078 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:19:43.887135 20075 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:43.887558 20075 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:43.887913 20075 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:43.888765 19932 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:43.889778 16880 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:43.890553 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.890688 16882 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:43.891039 16880 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:43.891758 16882 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:19:43.892654 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:43.885139 19962 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:43.870359 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:43.899660 16883 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:43.899262 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:43.866544 19984 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.902477 19687 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:43.903203 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:43.904282 19874 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:43.904810 19874 raft_consensus.cc:697] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:43.905948 19874 consensus_queue.cc:237] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:43.914011 16704 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 4 to 6, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 6 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.916054 19882 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:43.920426 19770 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:43.920924 19770 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.921633 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1586) took 1844 ms. Trace:
I20260709 13:19:43.921988 16876 rpcz_store.cc:276] 0709 13:19:42.076868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.079729 (+  2861us) service_pool.cc:224] Handling call
0709 13:19:42.080100 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:42.643305 (+563205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:43.921402 (+1278097us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b5400341554. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:43.921579 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293954944}
I20260709 13:19:43.922808 19770 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:43.928753 16877 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:43.933820 16877 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:43.934211 16775 leader_election.cc:400] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:19:43.934540 16775 leader_election.cc:403] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:43.934370 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:43.933705 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:43.932627 16924 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:43.942899 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:43.915629 16704 catalog_manager.cc:5697] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 3 to 6, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 6 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.952122 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:43.953531 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:43.953585 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:43.956086 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:43.956593 19846 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:43.958734 19882 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:19:43.936492 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:43.959784 19851 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:43.960180 16876 raft_consensus.cc:2393] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:43.960248 19851 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:43.960774 19851 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:43.963521 16880 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:43.963779 19649 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:43.924510 19991 raft_consensus.cc:3055] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:43.932943 20079 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.965631 19991 raft_consensus.cc:740] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:43.965999 20079 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.966503 19991 consensus_queue.cc:260] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:43.968106 16704 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 5 to 6, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 6 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:43.970274 20017 log.cc:927] Time spent T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 1.409s	user 0.006s	sys 0.013s
I20260709 13:19:43.970381 16704 catalog_manager.cc:5697] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 5 to 6, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 6 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:43.971992 19922 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:43.933786 20070 log.cc:927] Time spent T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:43.919328 20035 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:43.976747 16775 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:43.979416 16950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1948) took 2240 ms. Trace:
I20260709 13:19:43.982663 19680 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.983258 19680 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:43.983588 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:43.986073 19932 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:43.986768 19932 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:43.990707 19680 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:43.991091 19861 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:19:43.975201 19890 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:19:43.981145 16704 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:43.995719 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:43.991752 16850 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:43.996770 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:43.933667 20044 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:43.980438 16950 rpcz_store.cc:276] 0709 13:19:41.739340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.757768 (+ 18428us) service_pool.cc:224] Handling call
0709 13:19:41.785487 (+ 27719us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:41.810646 (+ 25159us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:41.810676 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:41.811153 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:19:42.269791 (+458638us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:42.269866 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:42.269995 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:43.969740 (+1699745us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:43.975967 (+  6227us) raft_consensus.cc:1685] finished
0709 13:19:43.975986 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:43.979371 (+  3385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15814,"raft.queue_time_us":17692,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":20078,"spinlock_wait_cycles":9748864,"thread_start_us":410394,"threads_started":1,"wal-append.queue_time_us":607530}
I20260709 13:19:44.031574 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:44.045755 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 172589us
I20260709 13:19:43.933969 19984 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:43.979640 19769 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:44.047438 16704 catalog_manager.cc:5697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 2 to 5, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 5 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:43.994920 19569 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:43.979079 19590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34326 (request call id 81) took 4261 ms. Trace:
I20260709 13:19:44.055354 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:44.045928 20045 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:44.058164 16704 catalog_manager.cc:5697] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 3 to 7, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:44.057504 16958 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:44.042845 19680 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:44.046038 19905 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:44.064754 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:44.065629 16801 raft_consensus.cc:2368] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9.
I20260709 13:19:44.050042 19787 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:44.065678 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 140366us
I20260709 13:19:44.068929 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:44.069864 16807 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:44.070629 16880 pending_rounds.cc:85] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 4
I20260709 13:19:44.070914 16880 pending_rounds.cc:107] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:19:44.032395 19983 consensus_queue.cc:1059] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:19:44.074011 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:44.033846 19732 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:19:44.075018 16809 raft_consensus.cc:2393] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:44.071146 16880 raft_consensus.cc:2889] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:44.076282 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:43.997849 19861 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:44.077803 17524 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:44.043268 20044 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:44.055529 19769 raft_consensus.cc:697] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:44.089736 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:44.085276 19851 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:44.090862 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.083927 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:44.085403 16877 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:44.063429 19569 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:44.063133 19680 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:44.086304 17521 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:44.067975 20045 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:44.088423 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:44.090335 16878 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:44.081004 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:44.088490 16806 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:44.071833 19905 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:44.105086 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:44.107936 16885 raft_consensus.cc:2393] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:44.112051 20033 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:44.112795 20033 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:44.116721 19787 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:44.117903 19787 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:44.121466 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 125803us
I20260709 13:19:44.122062 17521 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:44.124347 19851 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:44.124233 16704 catalog_manager.cc:5697] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 3 to 4, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 4 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.124931 16885 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:19:44.126649 16883 raft_consensus.cc:2955] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:44.133244 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:44.135483 16850 leader_election.cc:400] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9.
I20260709 13:19:44.135871 16850 leader_election.cc:403] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:19:44.145856 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:44.147579 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:44.148618 17519 raft_consensus.cc:2393] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:44.153347 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:44.154217 16704 catalog_manager.cc:5697] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 3 to 4, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 4 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:44.103482 20079 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:44.107597 19680 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.159278 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:44.169955 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:44.170785 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1570) took 2419 ms. Trace:
I20260709 13:19:44.185070 16704 catalog_manager.cc:5697] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 3 to 4, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 4 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.168373 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:44.099922 19687 consensus_queue.cc:1059] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:19:44.154219 19882 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:44.150241 19770 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:44.190321 16884 rpcz_store.cc:276] 0709 13:19:41.751249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:41.768649 (+ 17400us) service_pool.cc:224] Handling call
0709 13:19:41.769056 (+   407us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:41.776834 (+  7778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:41.776878 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:41.786744 (+  9866us) log.cc:844] Serialized 52 byte log entry
0709 13:19:42.208059 (+421315us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:42.231062 (+ 23003us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.053557 (+1822495us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b18003f9640. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa6455 00007feeef08e060 00007feeef0a0716 00007feeef0b1287 00007feeef0b1208
0709 13:19:44.159856 (+106299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.159988 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.161392 (+  1404us) raft_consensus.cc:1685] finished
0709 13:19:44.170561 (+  9169us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.170706 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15301,"prepare.queue_time_us":22822,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":2656,"raft.queue_time_us":198446,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":24703,"spinlock_wait_cycles":62326656,"thread_start_us":460040,"threads_started":2,"wal-append.queue_time_us":481352,"wal-append.run_cpu_time_us":2705,"wal-append.run_wall_time_us":1293213}
I20260709 13:19:44.192404 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:44.146126 20033 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:44.192297 16806 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:44.132440 19890 consensus_queue.cc:1059] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:19:44.158612 20073 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:44.199097 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.212544 19770 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:44.212750 20071 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:44.160594 19776 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:44.263000 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.263077 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 70761.6us
I20260709 13:19:44.192252 19851 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.268738 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:44.187067 19896 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.202040 19804 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:44.298352 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 439) took 1332 ms. Trace:
I20260709 13:19:44.363394 16879 rpcz_store.cc:276] 0709 13:19:42.965681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.992240 (+ 26559us) service_pool.cc:224] Handling call
0709 13:19:42.992497 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.992685 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.992707 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.962530 (+969823us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b2c00000e98. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:19:43.962912 (+   382us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.069768 (+106856us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:44.069817 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.069907 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.290741 (+220834us) raft_consensus.cc:1685] finished
0709 13:19:44.290768 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.298276 (+  7508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7539456,"thread_start_us":106451,"threads_started":1,"wal-append.queue_time_us":114871}
W20260709 13:19:44.285030 20061 log.cc:927] Time spent T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:19:44.300319 16704 catalog_manager.cc:5697] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 5 to 6, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 6 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.301750 16773 leader_election.cc:400] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9.
W20260709 13:19:44.366405 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 64820.8us
I20260709 13:19:44.366519 16704 catalog_manager.cc:5697] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 5 to 6, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 6 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.367237 16773 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:44.258445 20068 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:44.262902 20098 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:19:44.288852 20099 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:19:44.202726 20079 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:44.290956 20033 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.289927 20035 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:44.196460 19769 consensus_queue.cc:237] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:44.296835 19890 raft_consensus.cc:3055] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:44.356024 19984 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:44.321830 19770 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:44.449671 20101 log.cc:927] Time spent T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:19:44.480484 20075 consensus_meta.cc:287] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.000s
I20260709 13:19:44.481022 20075 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:44.439860 20079 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.483083 20079 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:44.483994 20035 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.484591 20035 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:44.356891 19776 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:44.488363 16885 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
W20260709 13:19:44.454232 20092 log.cc:927] Time spent T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:19:44.449838 20068 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:44.496076 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:44.381265 20084 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:19:44.334614 20044 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:44.333330 20102 consensus_queue.cc:1059] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:44.506517 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.332078 19861 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:44.335214 20082 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:19:44.264139 19569 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:44.054348 19590 rpcz_store.cc:276] 0709 13:19:39.715753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:39.715904 (+   151us) service_pool.cc:224] Handling call
0709 13:19:39.778560 (+ 62656us) log.cc:844] Serialized 487 byte log entry
0709 13:19:43.975613 (+4197053us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2905,"raft.queue_time_us":37947,"raft.run_cpu_time_us":1838,"raft.run_wall_time_us":69958,"thread_start_us":139161,"threads_started":1,"wal-append.queue_time_us":190798,"wal-append.run_cpu_time_us":2249,"wal-append.run_wall_time_us":1527217}
I20260709 13:19:44.453902 19890 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:44.215080 20045 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:44.367233 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 52983.5us
I20260709 13:19:44.535524 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:44.537993 17492 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:44.259192 19905 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:44.335947 19851 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:44.460848 19909 consensus_queue.cc:1059] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:44.449206 19846 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:19:44.269359 20073 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:44.513746 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.508275 16959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 1962) took 1560 ms. Trace:
I20260709 13:19:44.547216 16959 rpcz_store.cc:276] 0709 13:19:42.947543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.947705 (+   162us) service_pool.cc:224] Handling call
0709 13:19:42.947944 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:43.004045 (+ 56101us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:43.004075 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:43.004118 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:43.004149 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.508034 (+1503885us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b5400208ad4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:44.508082 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.508220 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128560896}
I20260709 13:19:44.487020 20035 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:44.517904 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 372068us
I20260709 13:19:44.563825 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:44.502725 19800 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:44.381781 19896 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:44.506695 20093 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:44.545300 19861 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:44.544173 19635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.013s
W20260709 13:19:44.567711 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 200530us
W20260709 13:19:44.529605 16882 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.005s	sys 0.009s
I20260709 13:19:44.567270 19895 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:19:44.446800 20098 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:44.625123 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:44.625969 17526 raft_consensus.cc:2368] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9.
I20260709 13:19:44.625908 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:44.581903 20114 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:44.585999 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:44.578234 19983 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.627151 20114 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:44.628012 19983 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:44.592866 20068 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:44.630519 19983 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:44.590399 19791 raft_consensus.cc:3055] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:44.574630 20035 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:44.585135 19861 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:44.601202 19909 raft_consensus.cc:3055] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:44.612743 20044 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:44.570444 19590 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:19:44.623987 16882 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.006s	sys 0.009s
I20260709 13:19:44.624414 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:44.625193 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:44.672617 17522 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:44.629726 20114 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:44.590747 19896 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:44.594074 19776 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:44.627312 20098 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:44.634859 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:44.576844 20078 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:44.600152 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1597) took 1913 ms. Trace:
I20260709 13:19:44.584476 20093 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:44.642460 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:44.669952 20075 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:44.577647 19800 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:44.664348 19732 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:44.665226 19861 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:44.665585 19909 raft_consensus.cc:740] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:44.666276 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 80375.8us
I20260709 13:19:44.666241 20118 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:44.631217 19791 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:44.668026 20073 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:44.700471 20078 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:44.669373 19851 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:44.632750 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78ca000fd50c4b38bfdd60badc024845 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
W20260709 13:19:44.674443 16810 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.005s	sys 0.039s
I20260709 13:19:44.673074 16924 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:44.746198 16810 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.005s	sys 0.039s
I20260709 13:19:44.638878 19983 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:44.748390 16694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 115656us
I20260709 13:19:44.747615 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.701365 17521 raft_consensus.cc:2955] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:44.728706 16959 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:19:44.729257 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.812424 16810 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:44.813592 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.814154 16951 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:44.815073 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.815699 16957 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:44.816972 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 143982us
I20260709 13:19:44.818801 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.668843 20115 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:44.821010 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.708209 16881 rpcz_store.cc:276] 0709 13:19:42.686601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:42.701101 (+ 14500us) service_pool.cc:224] Handling call
0709 13:19:42.701435 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:42.720140 (+ 18705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:42.720172 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:43.894012 (+1173840us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b2c00000e98. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:19:43.894420 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.091234 (+196814us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:44.091271 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.092392 (+  1121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:44.578703 (+486311us) raft_consensus.cc:1685] finished
0709 13:19:44.578729 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:44.600076 (+ 21347us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28088,"raft.queue_time_us":20465,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":1253,"spinlock_wait_cycles":26521472,"thread_start_us":193641,"threads_started":1,"wal-append.queue_time_us":228547}
I20260709 13:19:44.736115 16803 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:19:44.745502 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 169297us
W20260709 13:19:44.618824 19635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.000s	sys 0.013s
I20260709 13:19:44.676532 19590 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:44.714403 19649 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:44.750876 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.666224 20102 raft_consensus.cc:3055] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:44.711632 20119 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:44.732051 19732 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:44.747946 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.810436 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.811403 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.819896 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.745853 20078 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:44.828872 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:44.831286 16951 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:44.878718 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:44.692173 20108 consensus_queue.cc:1059] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
W20260709 13:19:44.881449 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 53790.6us
I20260709 13:19:44.880409 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:44.809712 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.914742 16803 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:44.915194 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:44.915323 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:44.893281 16950 raft_consensus.cc:2368] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:19:44.894215 16958 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:44.916781 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:44.897356 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:44.902280 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:44.903241 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:44.909608 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:44.811786 19905 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:44.890177 20102 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:44.832314 19851 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:44.826042 20098 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:44.919999 16954 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:44.922794 16957 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:44.825917 20115 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:44.894338 20061 log.cc:927] Time spent T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:44.961261 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:44.962059 16950 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:44.817857 19983 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:44.963352 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 145712us
I20260709 13:19:44.966041 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:44.966656 16881 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:44.747051 20120 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.215s
I20260709 13:19:44.883347 19787 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:44.954061 16957 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:44.955237 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:44.879655 20114 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:44.879733 20035 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:44.957515 16952 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:44.885030 20127 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:44.960933 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 132167us
I20260709 13:19:44.953537 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:44.815335 19791 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.017675 16950 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:19:45.017747 16954 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:44.976648 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:45.021486 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.023918 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.025983 20137 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:44.890137 19649 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:44.961138 20115 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:45.097249 16958 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
W20260709 13:19:45.088958 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 68404.2us
I20260709 13:19:45.026901 16953 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:45.087826 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.102073 16954 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
W20260709 13:19:45.102671 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 126088us
I20260709 13:19:45.102835 19791 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:45.103585 16954 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:45.103638 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:44.965513 20068 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 13:19:45.106165 19961 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:45.108594 16883 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
W20260709 13:19:45.111351 19680 consensus_meta.cc:287] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.926s	user 0.008s	sys 0.000s
I20260709 13:19:44.884866 19909 consensus_queue.cc:260] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:44.963593 20098 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.009106 19962 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:45.139551 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:44.973713 19895 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:45.028518 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.114521 16884 raft_consensus.cc:2410] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:45.017733 20110 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.117512 20075 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:45.111127 16883 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:45.130316 16952 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:45.121138 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:44.956794 19851 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.112594 16885 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:45.016886 20114 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:44.910888 20119 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.026979 20035 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.141896 16954 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:45.137603 20108 raft_consensus.cc:3055] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:45.178824 16956 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
W20260709 13:19:45.176944 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 55917.7us
I20260709 13:19:45.194772 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:45.195346 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.163817 19787 raft_consensus.cc:697] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:45.124004 19800 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:44.959139 19905 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:45.172345 20109 log.cc:927] Time spent T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:19:45.084868 20127 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.100399 20112 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:19:45.183975 19962 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:45.141515 19680 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.236290 19962 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.236755 19962 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:45.191890 20111 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:19:45.208562 19984 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:45.242240 19787 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.202958 20075 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:45.244966 20121 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
W20260709 13:19:45.254482 20134 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:19:45.261294 20044 consensus_meta.cc:287] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.006s
I20260709 13:19:45.270956 20114 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:45.212327 20136 log.cc:927] Time spent T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:19:45.272231 20119 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:45.213047 20149 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:45.219659 20123 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260709 13:19:45.272886 20149 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.274564 20149 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:45.191817 20108 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:45.192559 20093 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.096877 20137 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.209265 20098 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.275501 20108 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.276912 20108 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:45.277190 20137 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.196592 20131 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:45.280006 20131 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.281518 20131 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.111712 20102 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.183553 20130 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:19:45.270875 20127 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:45.284363 20079 consensus_meta.cc:287] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.801s	user 0.011s	sys 0.000s
I20260709 13:19:45.284917 20079 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.421159 20079 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:45.126039 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.135185 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 254812us
I20260709 13:19:45.424480 20155 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:45.425619 20155 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:45.169866 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 44430.7us
I20260709 13:19:45.429301 20155 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.317579 16805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 1804) took 1248 ms. Trace:
I20260709 13:19:45.317987 16876 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:45.318256 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1616) took 1111 ms. Trace:
I20260709 13:19:45.319543 16882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 1851) took 1456 ms. Trace:
I20260709 13:19:45.324671 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.328591 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.330178 16955 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:45.332779 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.202958 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:45.344285 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.440780 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:45.441449 20158 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:19:45.431993 16805 rpcz_store.cc:276] 0709 13:19:44.069027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.069161 (+   134us) service_pool.cc:224] Handling call
0709 13:19:44.084603 (+ 15442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:44.092575 (+  7972us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:19:44.125278 (+ 32703us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.596288 (+471010us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18003e4940. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec3623a 00007feeef0a0a2a
0709 13:19:44.810205 (+213917us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:44.810759 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.810886 (+   127us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:44.810915 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.812142 (+  1227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.316559 (+504417us) raft_consensus.cc:1685] finished
0709 13:19:45.316796 (+   237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.317157 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13046,"prepare.queue_time_us":39035,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":166681,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":37402,"spinlock_wait_cycles":2799872,"thread_start_us":181884,"threads_started":1,"wal-append.queue_time_us":820007}
I20260709 13:19:45.442472 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.345285 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.445045 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.346403 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:45.446249 17522 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:45.347497 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.432327 16882 rpcz_store.cc:276] 0709 13:19:43.862686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:43.893360 (+ 30674us) service_pool.cc:224] Handling call
0709 13:19:43.893605 (+   245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:43.893952 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:19:44.671360 (+777408us) log.cc:844] Serialized 14 byte log entry
0709 13:19:44.778318 (+106958us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:44.820563 (+ 42245us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.821023 (+   460us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:44.821078 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.821164 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.318885 (+497721us) raft_consensus.cc:1685] finished
0709 13:19:45.318937 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.319306 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22572,"prepare.queue_time_us":63928,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":6752,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":17393,"thread_start_us":824905,"threads_started":2,"wal-append.queue_time_us":467348}
I20260709 13:19:45.208520 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:45.348212 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.432258 16878 rpcz_store.cc:276] 0709 13:19:44.206847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.207016 (+   169us) service_pool.cc:224] Handling call
0709 13:19:44.207306 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:44.519755 (+312449us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:44.519784 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:44.520247 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.804458 (+284211us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:44.804551 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.804691 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.317591 (+512900us) raft_consensus.cc:1685] finished
0709 13:19:45.317643 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.318039 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129620,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":546633,"threads_started":2,"wal-append.queue_time_us":589427}
I20260709 13:19:45.210297 19590 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:45.238178 19680 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:45.352264 19882 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.000s	sys 0.009s
I20260709 13:19:45.211141 19890 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.457784 20144 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:45.198158 19909 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:45.458679 20144 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.460724 17523 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:45.355199 19905 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:45.213930 19983 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:45.356544 19851 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:45.286907 20110 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:45.464628 19882 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.252s	user 0.000s	sys 0.009s
I20260709 13:19:45.285362 20115 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.464917 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.465168 19882 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:45.465749 17525 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
W20260709 13:19:45.381829 16773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.008s
W20260709 13:19:45.467865 16773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.005s	sys 0.008s
I20260709 13:19:45.446269 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.469772 17524 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:45.397832 20093 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:45.400092 19941 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:45.401301 19649 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.402644 20035 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:45.268424 20044 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:45.258085 19984 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.467382 20115 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:45.467023 19882 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.431355 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:45.438372 19932 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:45.454985 17526 raft_consensus.cc:2393] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:45.471968 16806 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:45.472287 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.472803 16877 raft_consensus.cc:1240] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:45.516229 16808 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:45.471503 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.551017 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:45.517542 20144 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:45.544001 19861 consensus_meta.cc:287] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.797s	user 0.011s	sys 0.007s
I20260709 13:19:45.539454 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:45.581475 20094 log.cc:927] Time spent T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 1.266s	user 0.000s	sys 0.006s
I20260709 13:19:45.581398 19861 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.520438 19984 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:45.522024 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:45.531661 20033 consensus_meta.cc:287] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 1.082s	user 0.006s	sys 0.011s
I20260709 13:19:45.609231 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:45.609963 20113 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.801s	user 0.002s	sys 0.000s
I20260709 13:19:45.610713 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.587581 19983 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:19:45.474156 20112 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 13:19:45.611884 16924 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:45.613373 19649 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:45.613822 19649 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.614279 19649 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.615598 20154 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:45.616072 20154 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:45.532545 20035 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.616945 20035 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:45.617583 20152 log.cc:927] Time spent T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.178s	user 0.000s	sys 0.002s
I20260709 13:19:45.620154 20127 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.620795 20127 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.621816 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 455) took 1548 ms. Trace:
I20260709 13:19:45.622179 16876 rpcz_store.cc:276] 0709 13:19:44.073307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.073435 (+   128us) service_pool.cc:224] Handling call
0709 13:19:44.073734 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:45.447072 (+1373338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:45.621574 (+174502us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540041a0d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:45.621741 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2859520896}
I20260709 13:19:45.622912 20127 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:45.617267 20154 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.624514 19769 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:45.625224 19769 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.625810 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.626597 16958 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 4.
I20260709 13:19:45.627012 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:45.628340 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.629601 16956 raft_consensus.cc:2393] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:45.629503 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:45.625229 20154 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:45.628461 19890 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:45.631996 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.632349 20102 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:45.633141 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.633337 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:45.633862 16776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.015s	sys 0.031s
W20260709 13:19:45.634197 16776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.015s	sys 0.031s
I20260709 13:19:45.541911 19961 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:45.627480 19769 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.470189 19732 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:45.517704 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:45.637725 16801 raft_consensus.cc:2410] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 13:19:45.638770 20093 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.641736 20093 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.582914 17527 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:45.633596 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.641834 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.582448 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:45.536538 19895 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.650009 17522 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:45.515902 19932 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.659236 19962 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.619788 20035 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.585466 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 438) took 1532 ms. Trace:
I20260709 13:19:45.549896 19978 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:45.587432 19804 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:45.553646 20076 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:45.591601 19874 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:45.685997 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.660112 19861 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:45.690829 17520 raft_consensus.cc:2393] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:45.663606 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.697348 16808 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:45.697346 16802 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:45.677340 19732 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.589397 19590 consensus_queue.cc:1059] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
W20260709 13:19:45.701759 16953 consensus_meta.cc:287] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.008s
W20260709 13:19:45.701941 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.704491 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:45.704766 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 167808us
W20260709 13:19:45.705768 19791 consensus_meta.cc:287] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.014s
I20260709 13:19:45.706327 20156 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:45.706729 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.708866 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.710999 17522 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:45.711690 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.712674 17525 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:45.713696 17523 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:19:45.714313 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.685645 19769 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:45.715106 19991 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:45.715534 20132 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:45.716157 20093 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:45.716449 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:45.678507 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 247536us
I20260709 13:19:45.720465 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:45.693077 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 66281.1us
I20260709 13:19:45.522418 19941 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.688956 20033 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:45.584272 20138 consensus_queue.cc:1059] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
I20260709 13:19:45.734905 16810 raft_consensus.cc:2410] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:19:45.686731 19874 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:45.679653 19895 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.590667 19851 consensus_queue.cc:1059] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
W20260709 13:19:45.748102 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:45.742703 16953 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:45.678628 16804 rpcz_store.cc:276] 0709 13:19:44.052822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.054431 (+  1609us) service_pool.cc:224] Handling call
0709 13:19:44.054808 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:44.065492 (+ 10684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:44.065521 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:44.070992 (+  5471us) log.cc:844] Serialized 26 byte log entry
0709 13:19:44.251361 (+180369us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:44.251416 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:44.251507 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:45.580948 (+1329441us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b2400181c58. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebe2f9c4 00007feeebe2dacb 00007feeebfe8dc9 00007feeebfe8a55 00007feeebfe809d 00007feeeec1a10e 00007feeeec3188c 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221
0709 13:19:45.584944 (+  3996us) raft_consensus.cc:1685] finished
0709 13:19:45.584970 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:45.585271 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10243,"raft.queue_time_us":12198,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":5858,"spinlock_wait_cycles":28346112,"thread_start_us":180015,"threads_started":1,"wal-append.queue_time_us":214160}
I20260709 13:19:45.754715 17526 raft_consensus.cc:1813] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Handling vote request from an unknown peer 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:45.723980 19978 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.745750 20093 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.763945 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.762392 17526 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:45.737080 19732 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.772744 17521 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:45.774237 16806 raft_consensus.cc:2393] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:45.771548 16802 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:45.775301 16803 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:45.782704 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:45.765730 20093 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:45.787879 20078 consensus_meta.cc:287] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.009s
I20260709 13:19:45.788319 20078 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.790161 20078 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:45.793059 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:45.796075 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.796391 16876 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:45.796985 16885 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:45.797760 17519 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:45.796425 20127 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:45.798190 19732 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.798540 20127 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:45.798897 16773 leader_election.cc:400] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9.
I20260709 13:19:45.799006 20127 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.799258 16773 leader_election.cc:403] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:19:45.796013 20108 consensus_queue.cc:1059] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:19:45.800714 20108 raft_consensus.cc:3055] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:45.800856 19941 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.801151 20108 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:45.801553 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.801954 16773 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:45.802274 16884 raft_consensus.cc:1813] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Handling vote request from an unknown peer 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:45.802662 19769 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9.
I20260709 13:19:45.802984 16884 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:45.804138 20145 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:45.804525 20145 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:45.804870 20145 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.804912 19978 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.796017 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.797652 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:45.799343 16880 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:45.810225 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 93926.6us
I20260709 13:19:45.765990 19890 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:45.814855 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.745054 19804 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.764829 19649 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.742098 20156 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.829669 19851 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:45.830909 20156 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.832191 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.834667 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:45.834918 20154 raft_consensus.cc:3055] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:45.835430 20154 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:45.835765 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.836457 20154 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.837149 20131 raft_consensus.cc:2764] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:19:45.837986 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:45.838394 20163 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:19:45.838662 16950 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:45.840281 16953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 1967) took 1021 ms. Trace:
I20260709 13:19:45.840710 16953 rpcz_store.cc:276] 0709 13:19:44.818881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.819637 (+   756us) service_pool.cc:224] Handling call
0709 13:19:45.840106 (+1020469us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400215cd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:45.840217 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307364224}
I20260709 13:19:45.802178 20108 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.812888 19769 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.844126 19769 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.846187 19732 consensus_queue.cc:1059] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:45.847813 20033 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:45.766150 20132 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.848445 20033 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.850281 19791 raft_consensus.cc:3055] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:45.850351 20132 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:45.850867 19791 raft_consensus.cc:740] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:45.851068 20033 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:45.851833 20162 raft_consensus.cc:3055] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:45.852035 16810 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:45.852344 20162 raft_consensus.cc:740] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:45.853462 20162 consensus_queue.cc:260] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.854024 20108 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.854929 20162 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:45.855734 19895 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:45.856114 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.856341 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.856863 20154 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:45.846501 19769 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:45.857242 16877 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:45.851259 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:45.822252 20091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.030s	sys 0.055s
I20260709 13:19:45.763942 20076 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.848461 20140 raft_consensus.cc:3055] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:45.775748 19874 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.867367 16954 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:19:45.863441 20091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.033s	sys 0.055s
I20260709 13:19:45.872036 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.872684 16877 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:45.870509 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:45.871798 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.876634 16801 raft_consensus.cc:2410] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:45.876839 16805 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:45.884621 16810 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:45.867545 20140 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:45.859967 19890 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.877414 19962 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:45.905287 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 102037us
I20260709 13:19:45.906461 16881 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:45.874344 19769 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:45.907367 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.852080 19791 consensus_queue.cc:260] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.877413 19732 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:45.918177 16879 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:19:45.919178 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 68038.3us
I20260709 13:19:45.915557 19895 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:45.934334 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.924235 19932 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:45.939724 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.939507 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.948014 16807 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:45.950917 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.951036 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:45.956530 20050 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Leader election lost for term 8. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9.
I20260709 13:19:45.960053 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.961086 19569 consensus_queue.cc:1059] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:19:45.961544 16877 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:45.962096 19569 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:45.962774 19569 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.963250 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.946141 19769 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:19:45.964036 20102 raft_consensus.cc:3055] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:45.964690 19769 raft_consensus.cc:3055] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:45.964917 20102 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:45.965101 19769 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:45.965489 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:45.966396 16884 raft_consensus.cc:2393] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 10: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:45.965919 20102 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.967274 20140 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:45.964715 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.947048 19732 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.966106 19769 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:45.968973 20140 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:45.964066 17519 raft_consensus.cc:2368] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6.
I20260709 13:19:45.971565 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.967331 20102 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:45.975808 16810 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:45.970129 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:45.977700 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 66257.6us
I20260709 13:19:45.998886 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:45.996378 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:46.001181 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.996771 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:46.006124 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:46.006250 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:46.007534 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:45.974947 19791 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:46.012362 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:46.014241 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:46.006908 16808 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:46.004652 16809 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 4.
I20260709 13:19:46.019219 16773 leader_election.cc:400] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6.
I20260709 13:19:46.019542 16773 leader_election.cc:403] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:46.029716 17523 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:46.031149 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:46.003151 19769 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.032850 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:46.003635 19649 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:46.037236 16810 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:46.039165 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:46.005553 19882 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:46.012907 19874 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:46.042922 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 114770us
I20260709 13:19:45.975164 19895 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:46.040813 16924 leader_election.cc:336] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.686s (SENT)
I20260709 13:19:46.050335 17519 raft_consensus.cc:2393] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:46.026347 20132 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6.
I20260709 13:19:46.056169 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:46.040880 20159 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:19:46.054231 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:46.062677 16881 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:46.061025 16954 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:46.065709 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:46.058452 16924 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.068396 16877 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:46.044215 19804 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:46.071684 19890 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:46.092783 16957 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:46.095052 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.097263 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:46.098022 17524 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:46.099021 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:46.099820 17522 raft_consensus.cc:2393] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:46.103024 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:46.104015 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:46.086395 20076 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:46.085564 19895 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:46.106468 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:46.106822 16775 leader_election.cc:400] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
W20260709 13:19:46.084378 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.108328 19569 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:46.110745 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:46.117103 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:46.120151 16959 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:46.120262 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:46.122706 16808 raft_consensus.cc:1240] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:46.131253 16950 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:46.135977 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:46.064958 19882 raft_consensus.cc:697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:46.149811 20117 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:46.150146 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:46.149997 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:46.150950 17521 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:46.153558 17519 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:46.127532 19983 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.165011 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:46.168069 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:46.120543 20145 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.172322 16881 raft_consensus.cc:2393] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:46.175534 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 80700.3us
I20260709 13:19:46.162138 19991 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:46.183573 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 163049us
I20260709 13:19:46.187284 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:46.187578 19882 consensus_queue.cc:237] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.186398 19569 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.163193 19983 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.200781 16952 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:46.206171 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:46.206784 17521 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.207806 20145 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:46.208719 19732 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:46.212083 16807 raft_consensus.cc:2410] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:46.214120 16958 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
W20260709 13:19:46.226081 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.230943 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 124317us
I20260709 13:19:46.232317 16950 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:46.232769 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.235752 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.244285 17521 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
W20260709 13:19:46.254927 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.246081 16773 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:46.272411 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 70236.6us
I20260709 13:19:46.196702 19991 consensus_queue.cc:1059] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:19:46.244019 16959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 1970) took 1407 ms (client timeout 1741 ms). Trace:
I20260709 13:19:46.197392 19569 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.234181 20045 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.284276 16801 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:19:46.280964 16959 rpcz_store.cc:269] 0709 13:19:44.827074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.878449 (+ 51375us) service_pool.cc:224] Handling call
0709 13:19:46.222508 (+1344059us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540032bed4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:46.234385 (+ 11877us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2784384384}
W20260709 13:19:46.306823 20176 log.cc:927] Time spent T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:46.310149 19983 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:46.310743 19983 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.312136 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:46.316833 20045 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:46.319207 20045 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:46.320421 20093 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.323103 20093 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:46.323895 16877 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:46.286505 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:46.279479 20145 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:19:46.337884 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:46.339098 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 65813.7us
I20260709 13:19:46.341213 16924 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.311260 19983 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.340312 20145 raft_consensus.cc:697] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:46.338856 19769 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:46.342373 20093 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.353233 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:46.349136 19861 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:46.360613 19978 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.366421 19932 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:46.366876 19983 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:46.370090 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.364382 19895 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:46.371399 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:46.372287 16807 raft_consensus.cc:2410] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:19:46.374389 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 90214.1us
I20260709 13:19:46.374529 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:46.371426 19895 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.388989 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.391336 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:46.365118 20093 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.395821 20050 consensus_queue.cc:1059] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:46.396754 20050 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:46.397135 20050 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:46.397634 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.398043 20050 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.398433 19991 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:46.398914 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:46.399291 19991 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:46.400954 19991 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:46.401430 19991 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:46.401778 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:46.402209 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:46.402667 16809 raft_consensus.cc:2410] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:46.402274 19991 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.400107 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.404414 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.405145 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:46.406042 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:46.408624 19905 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:46.409053 19905 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.409096 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:46.409565 19905 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:46.409758 16807 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.410383 16850 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:46.411288 20174 log.cc:927] Time spent T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.107s	user 0.003s	sys 0.000s
I20260709 13:19:46.412190 19569 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:46.411224 20033 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.413772 20162 raft_consensus.cc:3055] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:46.414183 20162 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:46.415032 20162 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.388305 19769 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:46.390177 20045 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.389729 19895 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:46.422820 19791 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:46.427070 16848 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.400655 20145 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.431883 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:46.442799 16958 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
W20260709 13:19:46.395215 20127 consensus_meta.cc:287] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.555s	user 0.002s	sys 0.009s
I20260709 13:19:46.438473 16954 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:46.457901 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:46.388140 19932 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:19:46.460630 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:46.434963 19769 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:46.460675 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 67328.7us
I20260709 13:19:46.468761 16956 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.445851 20050 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:46.486897 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 82652.1us
I20260709 13:19:46.471547 19769 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:46.445925 19962 consensus_queue.cc:1059] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:19:46.444284 20131 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:19:46.463629 20127 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.544354 16924 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:46.532496 20162 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:46.546298 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 88688.2us
I20260709 13:19:46.485716 20045 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:46.569896 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 159585us
I20260709 13:19:46.545746 19861 raft_consensus.cc:697] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:46.579356 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.585464 16924 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.590590 19991 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:46.590875 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:46.587227 19791 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:46.596396 20181 log.cc:927] Time spent T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:19:46.598692 20033 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:46.601739 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:46.601990 20193 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:46.602320 20045 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:46.603709 20078 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:46.603873 20127 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:46.604482 20078 consensus_queue.cc:1059] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:46.587826 19932 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:46.605284 19932 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:46.605791 19932 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:46.608486 20189 raft_consensus.cc:3055] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:46.608872 20189 raft_consensus.cc:740] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:46.609794 20189 consensus_queue.cc:260] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.614020 20189 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:46.627957 20093 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:46.583997 20108 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:46.618564 20117 raft_consensus.cc:3055] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:46.628808 20108 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:46.628880 20117 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:46.629333 20108 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.629957 20117 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.631340 20117 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:46.628008 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 211758us
I20260709 13:19:46.637060 16848 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:46.638054 20093 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:46.639741 20093 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:46.641686 16848 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:46.642519 20093 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:46.642946 20093 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:46.643369 20093 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:46.651974 19791 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:46.652452 19791 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:46.652107 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 61095.6us
I20260709 13:19:46.652985 19791 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.654384 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:46.655340 19978 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:46.655470 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:46.655784 19978 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:46.656361 19978 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.656550 20162 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:46.656934 20162 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:46.657297 20162 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:46.661303 19791 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.662607 19895 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.663803 20033 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:46.651522 19861 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:46.664934 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 92632.6us
I20260709 13:19:46.666635 16807 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:19:46.666301 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:46.663427 19791 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:46.676152 20127 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:46.676210 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 70896.4us
I20260709 13:19:46.676980 19905 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.678893 16956 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:19:46.697098 16775 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:46.696964 20102 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:46.698015 19978 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.698400 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:46.698561 20102 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:46.699019 20102 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:46.699412 20102 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:46.699834 20076 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:46.700289 20076 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:46.700654 20076 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:46.703878 16704 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58326 (request call id 273) took 14394 ms (client timeout 15000 ms). Trace:
I20260709 13:19:46.704460 16924 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.694680 19932 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.708491 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:46.709573 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.681830 20127 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.711125 19983 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:46.715178 20033 consensus_queue.cc:1059] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:19:46.718791 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:46.720777 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.723570 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:46.725356 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:46.728509 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 125034us
I20260709 13:19:46.715978 20127 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.695781 19769 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.732326 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:46.734494 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:46.736403 16801 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.719930 20033 raft_consensus.cc:3055] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:46.735517 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:46.718263 20132 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:46.734494 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:46.720726 19983 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.734229 19978 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:46.737924 16809 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:46.733269 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:46.710999 20193 consensus_queue.cc:1059] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:19:46.738514 16881 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:19:46.714008 19732 consensus_queue.cc:1059] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:19:46.740003 20192 consensus_queue.cc:1059] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:46.740797 19932 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:46.741179 20033 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:46.737033 16802 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.744171 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.752048 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:46.742419 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:46.744942 16880 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:46.738984 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:46.746533 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:46.748739 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:46.729848 20162 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.750524 20050 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:46.754364 16884 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:46.745889 20145 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:46.753180 16885 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
W20260709 13:19:46.756875 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.741911 20199 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:46.722607 20140 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:19:46.769871 16801 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:46.769665 20033 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.770955 20033 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.756007 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:46.741820 20132 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:46.771965 20132 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:46.772303 19905 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:46.773466 20045 raft_consensus.cc:3055] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:46.773836 20045 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:46.762778 19991 raft_consensus.cc:3055] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:46.774665 19991 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:46.775203 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.775796 19769 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:46.775657 19991 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.777001 19991 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:46.775759 16707 catalog_manager.cc:5697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 7, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.763127 20195 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:46.759338 19978 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.764053 16878 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
W20260709 13:19:46.704367 16704 rpcz_store.cc:269] 0709 13:19:32.309098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:32.309266 (+   168us) service_pool.cc:224] Handling call
0709 13:19:32.414541 (+105275us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b5400037fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeef000090 00007feeef09ef3a 00007feef4e551cc 00007feef4f5337e 00007feef34142a4 00007feef3414232 00007feef3414161 00007feef34140dc 00007feef3413392 00007feeed3d148c 00007feeed3d08c6
0709 13:19:46.703638 (+14289097us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:45.089849 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:45.236127 (+146278us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:45.236163 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:19:45.236179 (+    16us) tablet.cc:662] Decoding operations
0709 13:19:45.237290 (+  1111us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:45.237345 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:45.237377 (+    32us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:19:45.258885 (+ 21508us) tablet.cc:701] Row locks acquired
0709 13:19:45.261744 (+  2859us) write_op.cc:260] PREPARE: finished
0709 13:19:45.266171 (+  4427us) write_op.cc:270] Start()
0709 13:19:45.266828 (+   657us) write_op.cc:276] Timestamp: P: 1783603185265406 usec, L: 0
0709 13:19:45.266847 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:19:45.267582 (+   735us) log.cc:844] Serialized 4713 byte log entry
0709 13:19:45.809678 (+542096us) op_driver.cc:464] REPLICATION: finished
0709 13:19:46.177465 (+367787us) write_op.cc:301] APPLY: starting
0709 13:19:46.186566 (+  9101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:46.329057 (+142491us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:46.329220 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:46.471147 (+141927us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:46.580573 (+109426us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:19:46.584173 (+  3600us) write_op.cc:312] APPLY: finished
0709 13:19:46.596181 (+ 12008us) log.cc:844] Serialized 89 byte log entry
0709 13:19:46.596365 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:46.596631 (+   266us) write_op.cc:454] Released schema lock
0709 13:19:46.596691 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:46.597186 (+   495us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:46.597221 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":286,"reported_tablets":48,"spinlock_wait_cycles":68020096,"child_traces":[["op",{"apply.queue_time_us":280534,"apply.run_cpu_time_us":6169,"apply.run_wall_time_us":437029,"num_ops":12,"prepare.queue_time_us":364400,"prepare.run_cpu_time_us":16993,"prepare.run_wall_time_us":378644,"raft.queue_time_us":298468,"raft.run_cpu_time_us":59824,"raft.run_wall_time_us":301250,"replication_time_us":486207,"thread_start_us":559439,"threads_started":4,"wal-append.queue_time_us":120835}]]}
I20260709 13:19:46.757627 20050 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:46.790812 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 69254.3us
I20260709 13:19:46.793429 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.751292 19569 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:46.786506 16808 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:46.799115 16959 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:46.801363 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:46.792557 20050 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:46.746479 20108 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.792618 19978 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.802728 19732 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:46.774691 20045 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.804955 20201 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:46.823345 20201 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:46.779369 16707 catalog_manager.cc:5697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 4, term changed from 6 to 8, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added, pending config changed, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:46.824311 20201 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:46.805522 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.825395 16707 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.814988 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:46.815218 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:46.821120 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:46.843151 16957 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:46.843535 16955 raft_consensus.cc:2410] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:19:46.819020 19732 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:46.819859 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:46.846941 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:46.794824 19895 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:46.801594 20195 raft_consensus.cc:697] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:46.860023 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:46.842764 16707 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 7, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 7 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:19:46.865797 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.809296 19978 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:46.861454 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:46.865171 16802 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:46.820864 20045 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:46.866786 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.779847 20199 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.808399 20162 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:46.871443 16954 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:46.823431 20127 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.813187 20108 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:46.853895 19732 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:46.861162 19890 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:46.822500 20102 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.857225 20078 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:46.880647 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:46.886826 16958 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:46.880862 16959 raft_consensus.cc:2410] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:19:46.879032 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.815037 20093 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:46.888041 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 143930us
I20260709 13:19:46.854995 19569 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.873348 19909 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:46.900030 16877 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:46.900764 20093 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:46.902537 20127 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:46.914753 16885 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:46.916003 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:46.916311 16958 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:46.916352 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:46.916939 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:46.917883 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:46.919822 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 69345.6us
I20260709 13:19:46.920161 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:46.926257 16959 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:46.920161 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 144001us
I20260709 13:19:46.928290 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:46.929800 16957 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:46.931427 20193 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.946111 16876 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:46.931320 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
W20260709 13:19:46.934237 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.919145 20076 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.947469 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:46.948655 16953 raft_consensus.cc:606] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:46.949124 16953 raft_consensus.cc:614] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:46.950371 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:46.950722 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:46.951110 16880 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:46.889204 16707 catalog_manager.cc:5697] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 7, now has a pending config: VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2), VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3), VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:46.959937 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:46.965883 16707 catalog_manager.cc:5697] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 6, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 6 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.932897 20078 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.955895 20189 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:46.968138 16707 catalog_manager.cc:5697] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 7, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:46.960927 19890 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:46.944278 19909 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:46.969946 20198 log.cc:927] Time spent T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:19:46.973840 16707 catalog_manager.cc:5697] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:46.983104 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:46.985255 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:46.971566 19962 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:46.985909 19962 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:46.986788 19962 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:46.978613 19890 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.988500 19890 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:46.990466 19909 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:46.956934 20193 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.973248 20127 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:46.964748 20093 consensus_queue.cc:1059] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:19:47.003911 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:46.973301 20189 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.011565 20189 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.000726 20203 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.000931 20102 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:47.004626 16953 raft_consensus.cc:606] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:47.014385 16953 raft_consensus.cc:614] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:19:47.004850 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 60121.9us
I20260709 13:19:47.006593 20202 raft_consensus.cc:3055] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:47.012269 16707 catalog_manager.cc:5697] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.016569 20202 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:47.016939 20192 raft_consensus.cc:3055] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:47.017295 20192 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:47.017445 20202 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:46.972465 20195 consensus_queue.cc:237] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.017838 16707 catalog_manager.cc:5697] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 7, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.018181 20192 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.019256 20192 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:47.008391 20199 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.021548 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:47.022116 16953 raft_consensus.cc:606] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Received request to transfer leadership to TS 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:47.025681 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.010028 19732 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.026240 16707 catalog_manager.cc:5697] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.043255 16880 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:47.045243 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.050501 16707 catalog_manager.cc:5697] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:47.054989 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 71921.4us
I20260709 13:19:47.058310 16956 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:47.059837 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 127581us
I20260709 13:19:47.044652 19909 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.061379 16924 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:47.063862 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.041808 20050 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.073575 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:47.074888 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.078222 19932 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:47.078745 19932 raft_consensus.cc:697] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:47.078828 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:47.079696 19932 consensus_queue.cc:237] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.067800 20203 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:47.067967 19909 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.081977 20203 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:47.071393 20132 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.084371 16884 raft_consensus.cc:2410] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:19:47.084415 19991 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.080631 20193 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.085101 19909 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.085294 19569 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:47.107288 17523 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:19:47.085848 20050 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.086205 19732 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:47.105630 19769 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:47.088660 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.108456 17521 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:47.108340 19769 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.084415 16707 catalog_manager.cc:5697] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:47.109836 16707 catalog_manager.cc:5697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:47.090934 16808 raft_consensus.cc:2410] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:19:47.111354 16773 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:47.090487 19890 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.091925 20078 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:47.096033 20076 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:47.115265 20145 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.080931 16953 raft_consensus.cc:606] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:47.115836 20145 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.117959 19890 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.105011 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.119976 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:47.103538 20203 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.120472 16953 raft_consensus.cc:606] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:47.120857 16953 raft_consensus.cc:614] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:47.127120 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:47.128894 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:19:47.130595 20196 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.395s	user 0.003s	sys 0.000s
I20260709 13:19:47.107736 20132 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.138769 20202 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:47.112728 16707 catalog_manager.cc:5697] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.140511 16707 catalog_manager.cc:5697] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 2 to 6, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 6 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.142244 20145 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.141906 16707 catalog_manager.cc:5697] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 4, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 4 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:47.113660 19569 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:47.114341 19909 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:47.146354 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 195689us
I20260709 13:19:47.148332 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.077916 20195 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.144840 16924 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:47.151746 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:47.151790 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.152588 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:47.154397 16950 raft_consensus.cc:2410] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:47.154736 16959 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:47.152892 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.156695 16954 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.157007 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.157789 17527 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:47.160359 16950 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:47.161552 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:47.162135 16950 raft_consensus.cc:2368] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6.
I20260709 13:19:47.163622 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:47.167980 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:47.164794 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.158515 16707 catalog_manager.cc:5697] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.169958 16954 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:19:47.170277 16954 pending_rounds.cc:85] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 6
I20260709 13:19:47.171952 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.172175 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.172801 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.173568 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:47.174161 16956 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:47.174907 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:47.175768 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:47.170305 16707 catalog_manager.cc:5697] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 4, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 4 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:47.177924 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.178723 17522 raft_consensus.cc:2410] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:47.184235 16958 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:47.168984 19769 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.185408 16924 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:47.185853 20108 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:47.186456 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.187147 20108 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.187278 20162 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:47.187872 20162 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.188022 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:47.188355 20162 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.188809 16957 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 5: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:47.192499 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.111711 19962 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:47.195241 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.199745 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.195986 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.200413 17523 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:47.200665 16878 raft_consensus.cc:2393] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:47.179389 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:47.196674 16951 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:47.174175 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.197373 16953 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:47.197574 16959 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:47.197850 16924 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.199265 16707 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 7, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.146227 19569 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:47.156869 20195 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.203843 16707 catalog_manager.cc:5697] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 4, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 4 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:47.167771 20127 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:47.202819 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.200261 17520 raft_consensus.cc:2376] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6. Re-sending same reply.
I20260709 13:19:47.208333 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.211544 17523 raft_consensus.cc:2376] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7. Re-sending same reply.
I20260709 13:19:47.207696 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.212564 16877 raft_consensus.cc:2410] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:19:47.208982 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:47.211521 16882 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:47.214283 16957 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:47.204252 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:47.213415 16707 catalog_manager.cc:5697] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.215276 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.218611 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:47.221830 17527 raft_consensus.cc:2393] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:47.222834 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:47.204846 19732 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:47.170629 16954 pending_rounds.cc:107] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 13:19:47.227582 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:47.227713 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:47.229205 16802 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:47.228477 16957 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:47.227932 16707 catalog_manager.cc:5697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:47.208858 20195 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.205758 19569 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:47.230351 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:47.234279 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:47.217486 16775 connection.cc:256] RPC call timeout handler was delayed by -1.1535675610000453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260709 13:19:47.227782 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.235242 16954 raft_consensus.cc:2917] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 13:19:47.232016 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.231976 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:47.232306 16807 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:47.232772 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.233062 16885 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:47.237159 17523 raft_consensus.cc:2393] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:47.237525 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:47.237855 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.235839 16954 raft_consensus.cc:2889] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:47.238476 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:47.238999 16804 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.211313 20127 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:47.240023 16953 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.243517 16879 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:47.240904 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.246271 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.205602 19962 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.257300 19962 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.243335 20145 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.259141 20145 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.261196 20145 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:47.261821 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.262603 17523 raft_consensus.cc:2410] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:47.263213 17521 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:47.228952 19732 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.243772 20127 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:47.264046 19732 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:47.267141 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:47.253798 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.215514 20131 consensus_queue.cc:1059] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:19:47.268733 20131 raft_consensus.cc:3055] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:47.269135 20131 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:47.269971 20131 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.271163 20131 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.231756 19978 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:47.272485 20162 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.246838 16877 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:47.274989 17523 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEARNER]: Advancing to term 9
I20260709 13:19:47.276605 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.277266 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:47.277899 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:47.310575 16882 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.278748 16880 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:19:47.279399 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.280859 16883 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:19:47.282042 20203 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.289731 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.290616 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.291009 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.291663 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.326165 17522 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.292726 17526 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:47.294703 19732 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.270149 20189 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.297122 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.300061 16809 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:47.252933 16802 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:47.309919 17520 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
W20260709 13:19:47.328469 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 105712us
I20260709 13:19:47.337507 16804 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:47.325237 17518 raft_consensus.cc:2376] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8. Re-sending same reply.
I20260709 13:19:47.340852 17523 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEARNER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:19:47.341449 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:47.342483 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.242997 19932 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.344074 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:47.344342 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.351138 16954 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:19:47.344153 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.351747 17521 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:47.344444 20140 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:47.348610 16953 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:47.353307 17526 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:47.353921 16773 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:47.356153 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.362397 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:47.365670 17519 raft_consensus.cc:2410] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:19:47.367013 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:47.371608 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.373817 16957 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.375403 17522 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:47.376154 17521 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 13:19:47.376387 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:47.373063 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.366765 19769 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:19:47.378580 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.404238 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.404438 17518 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:47.376039 19991 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:47.358757 19932 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.335704 19569 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.382141 20203 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:47.383824 20192 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.386045 20195 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.386926 20140 raft_consensus.cc:697] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:47.412297 16924 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.339830 20050 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:19:47.393229 20162 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:47.396147 17519 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:47.399000 16882 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:47.400251 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:47.419327 16957 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:47.357064 20145 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.407318 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.406088 20108 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.409479 19978 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.411593 17526 raft_consensus.cc:2393] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:47.392771 19732 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:47.416738 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.409982 20093 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:19:47.426821 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.431381 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.428606 16884 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:47.410033 20219 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:19:47.432140 16848 leader_election.cc:336] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.540s (SENT)
I20260709 13:19:47.411643 20193 consensus_queue.cc:1059] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:19:47.421284 20145 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.412684 20131 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 13:19:47.445075 16848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 2.117s (SENT) [suppressed 26 similar messages]
I20260709 13:19:47.427896 20210 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:47.448431 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:47.449247 16802 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:47.426968 20202 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:47.453719 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:47.454928 16882 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:47.430819 20093 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:47.421288 20192 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.437692 20219 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:47.461618 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:47.462124 16880 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.446650 19991 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:47.447010 20145 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.445101 19732 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:47.461076 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:47.451742 20210 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.450461 20203 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:19:47.465009 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:47.429191 20108 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.468808 19932 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.458828 20033 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:47.459080 19978 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:47.469491 19732 raft_consensus.cc:697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:47.473601 20210 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:47.474607 20195 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.455927 20202 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:47.459931 20093 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:47.482558 20192 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:47.484045 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.484743 16880 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:47.468003 16882 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:47.468583 19991 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.465319 20219 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:47.489668 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:47.498262 16954 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:47.492154 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:47.488857 16878 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:47.499558 16957 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.479365 20127 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.501147 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:47.501869 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:47.503036 16848 leader_election.cc:336] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.610s (SENT)
I20260709 13:19:47.504040 16959 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:47.488153 20033 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:47.495579 20045 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.496417 20203 raft_consensus.cc:697] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:47.509624 20045 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.482117 20145 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.461301 20140 consensus_queue.cc:237] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.519001 20045 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.524053 16775 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:47.503463 20102 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:47.527228 16848 leader_election.cc:336] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.647s (SENT)
I20260709 13:19:47.523512 20203 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.547838 20033 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.548839 20033 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:47.528738 20220 log.cc:927] Time spent T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:19:47.531808 19732 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.505007 20229 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.538157 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:47.540802 19890 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.541450 20108 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:47.539044 16848 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:47.554267 16957 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:47.563580 20076 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:47.563755 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:47.563922 16953 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:47.573601 16959 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:47.574342 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.577189 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:47.556030 19769 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.578567 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.584622 16922 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:47.586308 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:47.587046 16809 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:47.587634 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:47.590260 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.590873 16805 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:47.597262 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:47.603219 16880 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.580454 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:47.600564 16805 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:47.579752 16957 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:47.578006 19909 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.534502 20202 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.614079 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:47.579021 20212 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.618368 16880 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:47.564314 20132 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:19:47.619596 16805 raft_consensus.cc:2393] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:47.621192 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:47.591303 19983 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.591429 19791 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:47.629079 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 101863us
W20260709 13:19:47.633229 16848 leader_election.cc:336] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.671s (SENT)
I20260709 13:19:47.633600 16848 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:47.636603 16848 leader_election.cc:336] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.699s (SENT)
I20260709 13:19:47.637063 16848 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:47.637809 20192 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.638440 20192 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:19:47.639882 16848 leader_election.cc:336] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.753s (SENT)
I20260709 13:19:47.640318 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:47.642207 16848 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:47.642951 20192 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:47.592916 19769 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.634181 19962 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.634903 16807 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:47.632366 17492 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:47.644582 16803 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:47.648099 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 58929.5us
I20260709 13:19:47.643638 20192 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:47.657990 16848 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:47.658561 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 94909.5us
I20260709 13:19:47.659886 16809 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:47.662002 16954 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:47.664387 16959 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:47.666965 16957 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:47.567965 20229 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.646191 19978 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:47.668994 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:47.670467 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:47.656536 20202 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.667553 19804 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:47.686318 16848 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:47.672693 20212 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:47.672693 20226 log.cc:927] Time spent T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:19:47.697825 19991 consensus_queue.cc:1059] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:19:47.699961 20189 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.669173 19909 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:19:47.719252 20093 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.721470 20093 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.722222 20132 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:47.686708 19962 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:47.723956 19991 raft_consensus.cc:993] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:19:47.724325 16848 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:47.676872 20078 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:19:47.726109 16848 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:47.726938 20212 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.674681 19895 consensus_queue.cc:1059] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:19:47.726939 20108 raft_consensus.cc:1081] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Signalling peer 599f9a88b6cd4e818a1c59a0b4522480 to start an election
I20260709 13:19:47.704780 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:47.705051 20145 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:47.702628 19804 raft_consensus.cc:697] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:47.729879 19804 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:47.702728 20236 log.cc:927] Time spent T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:19:47.702613 20238 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:47.716374 20192 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:47.672907 20102 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:19:47.685010 20127 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:47.727572 20212 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.700781 19769 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:47.734845 20234 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 13:19:47.724442 19991 raft_consensus.cc:3055] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:47.700044 19978 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.735328 19991 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:47.736274 19991 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.728937 20145 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:47.737488 19991 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.737766 20145 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:47.738695 20145 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.718291 20229 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:47.676986 20201 consensus_queue.cc:1059] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:19:47.739804 16803 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:19:47.686417 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 224086us
I20260709 13:19:47.744987 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:47.745306 16848 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:47.746559 20229 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.746982 20229 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.747328 20229 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.752240 20076 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.734506 20219 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.753003 16804 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:47.754549 20219 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.754465 20210 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.755075 20162 raft_consensus.cc:993] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:19:47.748172 20093 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:47.756266 20093 raft_consensus.cc:697] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:47.757274 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.758069 16848 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:47.759704 20033 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:47.760237 20033 raft_consensus.cc:697] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:47.758615 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.769650 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:47.773305 20127 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:47.773206 20033 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.773939 19769 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.770290 20162 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.775161 20162 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.775709 20199 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:47.776281 20199 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:19:47.776678 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.777180 20162 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:47.773571 19890 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.766463 20192 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.778564 20219 raft_consensus.cc:1064] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:19:47.774452 19769 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.778976 20192 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:47.779251 20219 raft_consensus.cc:1068] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: Unable to promote non-voter 599f9a88b6cd4e818a1c59a0b4522480: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:47.779481 20192 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.780755 19769 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:47.778446 19890 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.783311 19890 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.768417 20239 raft_consensus.cc:1081] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
W20260709 13:19:47.784132 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 79433.5us
I20260709 13:19:47.784665 20239 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:47.785163 20239 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:47.785254 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.787837 16924 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.757174 20093 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.794816 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:47.796665 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.799803 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.786788 20202 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.805639 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 114903us
I20260709 13:19:47.806875 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:47.807711 16884 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:47.809065 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.810696 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:47.810767 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:47.811812 17519 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.788873 20189 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:47.815248 16883 raft_consensus.cc:2368] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:47.801641 20162 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:47.819068 16802 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:47.803030 19983 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:47.822959 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.828320 20215 raft_consensus.cc:3055] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:47.828717 20215 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:47.829546 20215 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.830842 20235 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.830700 20192 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.831338 20235 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.832355 16878 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:47.833652 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:47.832814 16808 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:47.842409 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:47.843071 16809 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:47.844086 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:47.844647 16805 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:47.844833 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:47.844944 16801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:19:47.845485 16807 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:47.845688 16801 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:47.846135 16801 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.846644 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:47.838153 19983 raft_consensus.cc:697] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:47.848569 19983 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.848944 20239 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.824574 20232 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:47.855091 16802 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:47.777190 20199 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:47.857616 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.858235 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.860168 16808 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:47.857023 16801 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.863664 16801 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.830721 20215 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:47.880455 16951 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:19:47.891799 16808 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:47.893324 16807 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:47.813735 20202 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.896988 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:47.854476 20232 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.901734 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:47.905833 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:47.906538 16808 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:47.908718 20203 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:47.909291 20203 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.909706 20203 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:47.911942 20140 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.912173 16924 leader_election.cc:400] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:47.912536 19978 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:47.912555 16924 leader_election.cc:403] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:19:47.912441 20140 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.912992 19978 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.913380 19978 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:47.914016 20131 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:47.914772 19962 raft_consensus.cc:3055] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:19:47.915038 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.915149 19962 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:47.916229 19962 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:47.917549 19962 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:47.901594 20210 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.920866 20210 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:47.921417 20210 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.925279 16957 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:47.926280 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:47.927578 16959 raft_consensus.cc:1275] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:47.927798 20202 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:47.929605 20127 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:47.930130 20242 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
I20260709 13:19:47.931418 19905 consensus_queue.cc:1059] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:47.932346 19905 consensus_queue.cc:1243] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:19:47.932991 19905 raft_consensus.cc:3055] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:47.932915 20202 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:47.933593 19905 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:47.900911 20162 raft_consensus.cc:697] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:47.934650 19905 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.935509 20050 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:47.900759 20232 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.938385 20162 consensus_queue.cc:237] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:47.940820 20145 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:47.902321 19569 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:47.904027 20233 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.945971 20233 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:47.964690 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:47.930122 20127 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:47.993482 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.001341 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:48.001405 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 87879us
I20260709 13:19:48.001963 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:48.007496 16959 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.013664 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:48.016569 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:48.019820 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 234380us
I20260709 13:19:48.030452 16807 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:48.031536 16804 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:48.031875 16801 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:48.037017 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:48.037760 20233 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:48.044490 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:48.045307 16878 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:48.046944 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:48.018821 19804 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.049153 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.052291 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.056233 16802 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:48.033417 19905 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:48.034345 20192 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:48.079764 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.053987 20251 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:48.084868 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.057201 19791 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:48.100219 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:48.100832 16882 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:48.086261 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.102564 16809 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:48.088666 16804 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:48.087271 20252 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:19:48.097345 20127 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:48.069330 19804 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.098227 16805 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:48.104090 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.113180 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.113523 16804 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:48.114352 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.114795 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:48.115578 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.106945 16802 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:48.088457 20251 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.117174 16802 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:48.117879 16954 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:48.118731 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.126574 17519 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:48.127652 16773 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:48.130995 16804 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:48.132314 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.136498 16804 raft_consensus.cc:2393] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:48.137835 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.144469 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.152678 16804 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:19:48.132119 20132 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:48.121574 20251 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:48.182359 16883 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:19:48.185549 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.160418 20131 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:48.162606 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.191689 16806 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:48.163900 20140 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:48.164397 20132 raft_consensus.cc:697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:48.195058 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.168134 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.195688 16804 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:48.196496 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.197152 16804 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:48.168977 16802 raft_consensus.cc:1240] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:48.170393 16959 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:19:48.175493 20192 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.178351 20203 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.188118 16952 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:48.101801 20229 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:48.222770 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.224100 16807 raft_consensus.cc:2393] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:19:48.207233 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 174790us
I20260709 13:19:48.209651 16804 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:48.335515 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:48.336638 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.337070 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:48.337473 16804 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:48.337965 20189 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:48.338804 20078 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:19:48.220132 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.221499 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.339781 16810 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:48.340509 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.340967 16810 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:48.224972 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.338275 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:48.344902 16803 raft_consensus.cc:1275] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:48.344971 16808 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:48.345436 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:48.345958 16803 raft_consensus.cc:1240] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:48.228636 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.346714 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:48.348486 20240 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:48.348942 20240 raft_consensus.cc:697] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:48.349767 20240 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.228936 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.232059 20203 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:48.351845 20263 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:48.234356 19804 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:48.352586 19804 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:48.353029 19804 raft_consensus.cc:697] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:48.353399 16807 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:48.353924 19804 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.222774 20192 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:48.356009 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:48.241914 20232 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:48.357142 20192 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:48.359249 16953 raft_consensus.cc:2393] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:48.359176 20232 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:48.249930 16878 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:19:48.379908 16806 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
W20260709 13:19:48.251995 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.256960 20229 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:48.258136 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:48.380658 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.380950 16884 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.261372 16883 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:48.267342 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:48.384178 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 116947us
I20260709 13:19:48.271057 20210 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:48.274124 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:48.389604 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:48.390372 16952 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:48.282920 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:48.392125 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 109275us
I20260709 13:19:48.392973 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:48.283460 20262 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.396045 16884 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:48.395977 20262 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.398083 20263 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:48.400420 20093 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:48.401113 20093 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:48.284454 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.322018 20235 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:48.309460 20251 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:48.325285 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:48.325630 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:48.326263 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:48.408571 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:48.328241 16955 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:19:48.328310 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.328713 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:48.329396 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:48.326326 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:48.330013 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:48.411986 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:48.330269 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.338620 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.415928 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:48.416436 16884 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.232762 20132 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.244266 16809 raft_consensus.cc:2410] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:48.421921 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:48.422910 16954 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:48.411074 16805 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:48.360759 20203 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.335295 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.338671 20189 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:19:48.426981 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.427304 16954 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:48.427531 16804 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.362573 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:48.364532 16803 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:48.372718 16810 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
W20260709 13:19:48.373319 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.362236 16807 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:48.250921 20108 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.174327 19978 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:48.416967 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.456583 16922 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:48.423141 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:48.391499 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:48.457996 16952 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:48.421766 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:48.458652 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:48.459045 17527 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:48.430250 16884 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:48.430409 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:48.430398 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.438908 19569 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.439165 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:48.439425 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:48.476549 19569 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.402172 20093 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:48.477160 20251 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:48.478583 19569 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:48.479104 19569 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:48.422644 20262 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:48.422137 20199 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:48.480132 20199 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:48.480310 16958 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:48.480978 20199 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:48.482549 20162 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:19:48.440492 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:48.441053 17522 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:48.442289 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:48.442463 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:48.443836 17519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
 from {username='slave'} at 127.0.0.1:44648
I20260709 13:19:48.484864 16883 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:48.444204 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:48.485608 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.446743 16802 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:48.441071 16806 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:48.447813 16805 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:48.448333 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:48.464793 16804 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:48.442238 20189 raft_consensus.cc:3055] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:48.444391 19932 consensus_queue.cc:1059] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:19:48.465813 19804 consensus_queue.cc:1059] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:48.466667 20240 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:48.467608 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:48.467689 20078 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:48.468240 20254 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:48.468258 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:48.469040 16953 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:48.470912 20045 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:48.541093 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 72895.8us
I20260709 13:19:48.541872 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:48.473275 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:48.473786 20229 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:48.474632 20250 consensus_queue.cc:1059] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:48.475486 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:48.476042 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 45702.9us
I20260709 13:19:48.479468 19978 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:48.548278 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 80736.6us
I20260709 13:19:48.551338 17521 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:48.444190 19791 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:48.491919 17527 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:48.451149 16704 catalog_manager.cc:5697] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 6 to 8, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted, no longer has a pending config: VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2), VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3), VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:48.557770 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:48.558722 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:48.558919 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:48.559746 19962 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:48.560401 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:48.561506 17525 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:48.529621 20189 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:48.483976 20108 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:48.528129 16950 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
W20260709 13:19:48.544363 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 71187.2us
I20260709 13:19:48.544631 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:48.547113 16775 leader_election.cc:400] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6.
W20260709 13:19:48.650102 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 103122us
I20260709 13:19:48.546217 20033 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:48.554610 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:48.664686 16951 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:48.642329 17519 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:48.665653 17519 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:48.646988 20243 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.529286 16806 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:48.460980 20203 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:48.552624 16956 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:48.556586 19791 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.651938 19905 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:48.652175 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:48.653914 20108 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:48.640640 20215 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:19:48.654685 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:48.640676 20201 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:19:48.648638 16924 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:48.656134 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 111554us
I20260709 13:19:48.552160 20228 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:48.555342 19569 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:19:48.561780 20212 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:48.678696 17519 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.682411 17523 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
W20260709 13:19:48.690160 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 119245us
W20260709 13:19:48.719118 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 70581.8us
I20260709 13:19:48.736856 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:48.737047 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 82451.4us
I20260709 13:19:48.738495 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:48.738947 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:48.688294 19791 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.690153 19962 raft_consensus.cc:697] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:48.741909 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:48.689786 20250 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.742903 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:48.748169 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:48.749320 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:48.749940 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:48.689625 20033 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.744050 19905 consensus_queue.cc:1059] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:19:48.744793 19890 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:48.752385 20240 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:48.752746 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:48.803573 16876 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:48.803812 16880 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:48.753639 20127 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:48.760376 20235 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:48.764403 20263 consensus_queue.cc:1059] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:48.770040 16882 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:48.677459 16806 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:48.774662 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:48.820151 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 45594us
I20260709 13:19:48.821436 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:48.822504 16880 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:48.742594 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:48.776412 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:48.735539 20108 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:48.672499 20243 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:48.805236 16879 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:48.720319 20228 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.805616 16877 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:48.809175 16848 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:48.813715 16885 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:48.814957 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:48.828560 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:48.741228 19732 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:19:48.827790 19932 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:48.810671 20033 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.828406 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:48.867854 16878 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:48.828544 20275 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:19:48.839823 16806 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:48.806634 20162 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:48.855943 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:48.873217 16880 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:48.840704 20192 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.843868 20228 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:48.875765 16885 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:48.861974 20250 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.813046 20093 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:48.837770 19991 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:48.838052 20108 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.778128 16802 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:19:48.837317 19983 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:19:48.850016 19905 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:48.861426 19890 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:48.892483 16802 pending_rounds.cc:85] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 8
I20260709 13:19:48.902016 16802 pending_rounds.cc:107] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:19:48.902271 16802 raft_consensus.cc:2889] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:48.883195 16880 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:48.895754 16878 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:48.902771 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:48.899062 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 142641us
W20260709 13:19:48.899821 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 161426us
I20260709 13:19:48.905121 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:48.907171 16808 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:48.845788 20277 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:19:48.907905 16806 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:19:48.908938 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:48.909575 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.912277 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:48.867794 20232 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:19:48.913266 16808 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:48.903903 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:48.894160 20108 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:48.901340 19991 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:48.923228 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:48.930157 20189 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.933230 17524 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:48.886368 20192 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.892848 20093 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.901053 20227 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:19:48.939472 19991 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:48.926770 20240 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:48.947273 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 138164us
W20260709 13:19:48.955549 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 119143us
I20260709 13:19:48.956326 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:48.956048 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:48.958803 16848 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:48.946419 19569 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:48.946367 20203 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:48.950735 20240 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.919410 19962 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:48.976317 20286 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:48.957074 20033 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:48.987325 20195 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:49.009009 20279 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:19:49.010474 20283 log.cc:927] Time spent T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:49.013053 20093 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:48.980043 20240 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.015990 20243 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:48.992537 20033 consensus_queue.cc:1059] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:19:49.020220 20192 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.020648 20045 raft_consensus.cc:3055] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:49.021008 20250 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.022159 20250 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:49.022627 20250 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:48.978251 19569 raft_consensus.cc:697] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:49.011449 16955 raft_consensus.cc:3055] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:49.028992 16955 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:48.982398 20286 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.982252 19905 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.980592 20285 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:49.021021 20045 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:19:49.064893 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 159815us
I20260709 13:19:49.071341 20243 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:19:49.072513 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 314888us
I20260709 13:19:49.055125 19569 consensus_queue.cc:237] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.077217 20045 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.028992 20108 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.079631 20108 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.064488 16955 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.086311 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:49.051651 20286 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.087296 16955 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.091650 16952 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:19:49.089922 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 108948us
W20260709 13:19:49.096431 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 140164us
I20260709 13:19:49.096664 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:49.099400 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:49.100030 17525 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:49.100241 17524 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:49.100943 16952 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:49.105432 16773 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:49.107064 16880 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:19:49.052675 19905 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.023564 20250 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:49.107502 16880 pending_rounds.cc:85] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 9
I20260709 13:19:49.122186 16880 pending_rounds.cc:107] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:19:49.122525 16880 raft_consensus.cc:2889] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:49.115638 16878 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:49.087958 20108 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:49.126916 16952 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:19:49.128458 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:49.129616 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:49.130252 16804 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:49.130626 20281 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:49.131326 20281 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:49.134313 16885 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:49.134313 16883 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:19:49.135764 16883 pending_rounds.cc:85] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 5
I20260709 13:19:49.135988 16883 pending_rounds.cc:107] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:19:49.136205 16883 raft_consensus.cc:2889] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:49.103775 20145 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:49.086668 20254 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:19:49.130302 19890 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:19:49.099575 20093 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:19:49.225193 16956 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:49.233407 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:49.206728 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.188530 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 69800.5us
I20260709 13:19:49.204779 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:49.145680 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:49.249184 16883 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:19:49.237902 16879 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:49.196705 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:49.249676 16885 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:49.141047 16808 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:49.250185 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:49.142558 16878 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:49.250528 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:49.252511 16877 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:49.172894 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:49.159044 16804 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:49.239773 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 140078us
I20260709 13:19:49.255646 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:49.256453 16922 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:49.120523 20251 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:49.260284 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 130621us
I20260709 13:19:49.139197 20280 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:49.263736 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:49.126168 19791 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.238095 20290 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.225373 20285 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.227190 20263 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.267473 16951 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:49.139789 20162 raft_consensus.cc:697] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:49.265092 20277 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.310613 20263 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.287853 20290 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.267159 19983 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:49.195878 19991 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:19:49.267313 20280 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.141662 20108 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.260845 20284 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:19:49.381106 20313 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:19:49.374580 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.252090 20228 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.381963 20235 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.386900 20162 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.312611 20285 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.407794 20299 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:49.408243 20285 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.388270 19905 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:49.321169 19983 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:49.372704 20273 log.cc:927] Time spent T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:19:49.278930 20240 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.316308 20298 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 13:19:49.373396 20277 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.382731 20302 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:19:49.395787 19895 raft_consensus.cc:3055] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:49.397687 20290 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.398109 20281 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:49.402374 17519 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:49.409786 16884 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:49.404521 16958 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
W20260709 13:19:49.410315 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 161043us
I20260709 13:19:49.389889 20232 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.278204 19962 consensus_queue.cc:1059] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
W20260709 13:19:49.447813 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 181982us
W20260709 13:19:49.449306 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 188377us
I20260709 13:19:49.279243 20251 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:49.474529 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 220031us
I20260709 13:19:49.474831 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:49.475515 17527 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
W20260709 13:19:49.453083 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.382287 20280 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:49.445127 19983 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:49.384996 20127 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:19:49.449606 20304 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.455313 19895 raft_consensus.cc:740] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:19:49.473403 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 212615us
W20260709 13:19:49.495914 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.451315 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 188203us
I20260709 13:19:49.480285 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:49.496675 17527 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:49.483165 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:49.497181 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:49.483891 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:49.484968 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:49.499296 16880 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:49.499403 16956 raft_consensus.cc:3055] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:49.471601 20285 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.503295 16884 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:49.490440 16848 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:49.492100 16955 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:49.492857 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:49.493610 16802 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:49.483736 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:49.508013 16955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 2009) took 1158 ms. Trace:
I20260709 13:19:49.499888 16956 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:49.472752 17519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:44648 (request call id 503) took 1056 ms. Trace:
I20260709 13:19:49.510118 16951 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:49.508459 16955 rpcz_store.cc:276] 0709 13:19:48.349606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.411248 (+ 61642us) service_pool.cc:224] Handling call
0709 13:19:49.011322 (+600074us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54003ae920. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00ddc0 00007feeef099e18 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:49.507934 (+496612us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438222080}
I20260709 13:19:49.509542 17519 rpcz_store.cc:276] 0709 13:19:48.431158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.443732 (+ 12574us) service_pool.cc:224] Handling call
0709 13:19:49.401312 (+957580us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54005a5d54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef08da3d 00007feef405dcd0 00007feeed5e2254 00007feeed5e21e2 00007feeed5e2111 00007feeed5e208c 00007feeed5e1342 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:49.464367 (+ 63055us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360957696}
I20260709 13:19:49.508945 16956 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.518278 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:49.474771 20232 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.502130 20284 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:49.514704 20262 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:19:49.528901 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:49.512317 20033 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:49.513830 19962 raft_consensus.cc:3055] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:49.524164 19991 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:49.552691 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:49.553332 16880 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:49.501848 20254 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:19:49.526799 20145 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:49.560174 19991 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.583925 20050 raft_consensus.cc:3055] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:49.584380 20050 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:49.584623 20299 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:49.584714 19991 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:49.585088 20299 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:49.585228 20050 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.586318 20050 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:49.587801 19791 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:49.588382 19791 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.588797 19791 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.590821 19791 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.592675 20299 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.567190 20292 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:19:49.568961 20108 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.570693 20240 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:49.515300 20285 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.549733 20228 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:49.573603 20263 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:49.550402 20284 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.556263 19962 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:49.576329 20306 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:49.578231 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:49.579873 20317 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:49.580644 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:49.581598 20278 raft_consensus.cc:3055] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:49.535010 20199 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.594363 20232 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:49.566649 20277 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:49.551695 20033 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.605942 20251 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.488498 20281 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.499353 20304 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.600462 19895 consensus_queue.cc:260] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:49.613137 20310 log.cc:927] Time spent T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.236s	user 0.003s	sys 0.000s
W20260709 13:19:49.614812 20311 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
W20260709 13:19:49.616997 20286 consensus_meta.cc:287] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.005s
W20260709 13:19:49.617682 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.648306 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:49.679790 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:49.708518 16803 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:49.644310 16883 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:49.678927 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:49.710053 16802 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:49.646637 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:49.691242 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:49.685352 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 132763us
I20260709 13:19:49.689782 20317 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.689960 20278 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:49.703966 16957 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:49.704591 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:49.697288 20033 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.708397 17519 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:49.693858 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:49.715956 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.728150 20317 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.711407 16955 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.722843 20321 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:49.711421 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 64884.8us
I20260709 13:19:49.712790 20306 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:19:49.713557 16775 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:49.711526 19905 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:49.729100 20250 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:49.731104 20318 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:49.731571 16775 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:49.732159 19905 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.732527 20318 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:49.732641 19905 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.732842 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:49.704154 20232 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:19:49.736184 20280 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.736835 20285 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.738215 20316 consensus_queue.cc:1059] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:49.738543 20284 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.738862 20309 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:19:49.739544 20324 consensus_queue.cc:1059] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:19:49.741604 20299 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.746724 16775 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:49.770874 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:49.773334 16955 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:19:49.693790 20199 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.744725 16951 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
W20260709 13:19:49.780937 20301 log.cc:927] Time spent T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.409s	user 0.001s	sys 0.000s
I20260709 13:19:49.783888 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:49.784150 16955 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:49.784482 17524 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:49.785360 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:49.786330 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:49.786791 17524 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:49.788841 19983 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.789117 20199 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.776296 20318 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:49.790479 20318 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:49.790755 19983 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:49.790817 20318 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:49.792212 17522 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:49.793111 16707 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58336 (request call id 236) took 5160 ms. Trace:
I20260709 13:19:49.795382 20306 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:49.769917 19962 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.796378 20306 raft_consensus.cc:697] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:49.796830 19962 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:49.797494 20306 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.797755 16704 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 5 to 6, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 6 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.705762 20108 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:19:49.799330 16704 catalog_manager.cc:5697] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.802546 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:49.811154 16959 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:49.793443 16707 rpcz_store.cc:276] 0709 13:19:44.632364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:44.632521 (+   157us) service_pool.cc:224] Handling call
0709 13:19:49.793041 (+5160520us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:47.455461 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:47.527950 (+ 72489us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:47.527999 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:19:47.528021 (+    22us) tablet.cc:662] Decoding operations
0709 13:19:47.529968 (+  1947us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:47.530046 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:47.530074 (+    28us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:19:47.582266 (+ 52192us) tablet.cc:701] Row locks acquired
0709 13:19:47.590892 (+  8626us) write_op.cc:260] PREPARE: finished
0709 13:19:47.610357 (+ 19465us) write_op.cc:270] Start()
0709 13:19:47.644982 (+ 34625us) write_op.cc:276] Timestamp: P: 1783603187591002 usec, L: 0
0709 13:19:47.645908 (+   926us) op_driver.cc:348] REPLICATION: starting
0709 13:19:47.696959 (+ 51051us) log.cc:844] Serialized 9419 byte log entry
0709 13:19:48.173130 (+476171us) op_driver.cc:464] REPLICATION: finished
0709 13:19:48.291259 (+118129us) write_op.cc:301] APPLY: starting
0709 13:19:48.292778 (+  1519us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:48.293256 (+   478us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:48.293397 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:48.318160 (+ 24763us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:48.348582 (+ 30422us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:19:48.348634 (+    52us) write_op.cc:312] APPLY: finished
0709 13:19:48.349029 (+   395us) log.cc:844] Serialized 158 byte log entry
0709 13:19:48.366807 (+ 17778us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:48.367013 (+   206us) write_op.cc:454] Released schema lock
0709 13:19:48.367078 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:48.369697 (+  2619us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:48.369726 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49878,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":115952,"apply.run_cpu_time_us":5119,"apply.run_wall_time_us":79504,"num_ops":23,"prepare.queue_time_us":1201,"prepare.run_cpu_time_us":22899,"prepare.run_wall_time_us":326785,"raft.queue_time_us":201426,"raft.run_cpu_time_us":46588,"raft.run_wall_time_us":151674,"replication_time_us":527056,"thread_start_us":274958,"threads_started":4,"wal-append.queue_time_us":60235,"wal-append.run_cpu_time_us":11756,"wal-append.run_wall_time_us":1625463}]]}
I20260709 13:19:49.804162 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:49.813463 16952 raft_consensus.cc:2410] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:19:49.802062 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.815101 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:49.768373 20232 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:49.804984 16704 catalog_manager.cc:5697] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.829800 16952 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:19:49.823556 20132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.009s	sys 0.019s
I20260709 13:19:49.730080 20321 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:49.832487 20132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.009s	sys 0.020s
I20260709 13:19:49.834256 20321 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:49.835556 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:49.839998 20322 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:49.840350 16924 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:49.840540 20322 raft_consensus.cc:697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:49.841198 20108 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:49.841466 20322 consensus_queue.cc:237] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.845709 16704 catalog_manager.cc:5697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 5 to 6, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 6 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:19:49.864467 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.847043 16704 catalog_manager.cc:5697] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 5 to 7, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 7 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.801434 19791 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:49.879791 16704 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 6 to 7, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 7 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.823518 20050 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.891306 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:49.893474 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:49.751814 20286 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.894045 16803 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.889685 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:49.895619 16885 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:49.895533 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:49.896422 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:49.908535 16804 raft_consensus.cc:2393] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:49.879876 20321 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:49.910502 16704 catalog_manager.cc:5697] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 6 to 7, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 7 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.913359 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:49.913617 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 97104.1us
I20260709 13:19:49.913543 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:49.915596 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:49.915933 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:49.828789 20251 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:19:49.918716 16876 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
W20260709 13:19:49.918718 16850 leader_election.cc:336] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.615s (SENT)
I20260709 13:19:49.918942 16881 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:49.923065 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:49.923837 16804 raft_consensus.cc:2393] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 5: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:49.885696 19983 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.924398 16704 catalog_manager.cc:5697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 3 to 5, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 5 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.926401 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:49.926419 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:49.927166 16880 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:19:49.928227 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:49.930852 16883 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:49.935231 16803 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:19:49.930034 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:49.940594 16810 raft_consensus.cc:3055] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:49.941042 16810 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:49.941792 16881 raft_consensus.cc:1240] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:49.943459 16803 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:49.945498 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:49.884325 19791 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:49.947387 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:49.948604 16801 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:49.948486 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:49.951854 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.896116 20050 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.931543 19932 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:49.955602 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:49.962080 16883 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:19:49.957056 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:49.977334 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:49.949935 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:49.953322 16810 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:49.951792 20285 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:49.928894 20321 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.999009 16810 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:50.000856 16801 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:49.939018 19983 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:49.955577 20289 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:49.959424 20199 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.950309 20309 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:19:49.951494 20192 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:19:49.951874 20212 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:19:50.001446 20285 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.954792 20314 consensus_queue.cc:1059] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:19:50.027735 16883 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:50.030179 16810 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:19:50.033499 16810 pending_rounds.cc:85] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 6
I20260709 13:19:50.034224 16810 pending_rounds.cc:107] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:19:49.993101 19932 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.035077 16810 raft_consensus.cc:2889] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.036031 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:50.036600 17525 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:50.025316 20285 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.046193 20321 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:50.048125 20338 log.cc:927] Time spent T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:19:50.049299 20336 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:19:50.054536 20331 log.cc:927] Time spent T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:19:50.057723 19983 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.061339 19932 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.062487 19932 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:50.064095 20050 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.067013 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:50.017151 20199 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.032685 20304 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.076673 20286 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.030768 20280 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.122305 16959 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:19:50.133279 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.070880 20318 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.073310 20281 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.112464 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:50.177878 17527 raft_consensus.cc:1813] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Handling vote request from an unknown peer 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:50.178426 17527 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:50.178500 19905 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.183988 20199 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.185113 16957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 363) took 1095 ms. Trace:
I20260709 13:19:50.185487 16957 rpcz_store.cc:276] 0709 13:19:49.089756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.089875 (+   119us) service_pool.cc:224] Handling call
0709 13:19:49.090161 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.727881 (+637720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.184858 (+456977us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54002e36d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:50.185039 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410639104}
I20260709 13:19:50.186002 16880 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:19:50.165448 20317 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.166272 19791 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:50.168097 17525 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:50.193475 16773 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:50.196408 16885 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
W20260709 13:19:50.196763 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.203271 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.207029 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.212224 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:50.198618 19890 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:50.204811 20321 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:50.223431 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 273549us
I20260709 13:19:50.224471 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.221959 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.209022 20313 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:19:50.230394 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.219708 20132 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:50.202308 20033 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.228854 20280 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:50.236526 20281 raft_consensus.cc:2764] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:50.236989 20328 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:50.235776 20302 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.238046 20189 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.233891 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.222467 19890 raft_consensus.cc:697] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:50.254860 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:50.256168 16878 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.256788 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:50.261070 16882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 1885) took 1522 ms. Trace:
I20260709 13:19:50.261564 16882 rpcz_store.cc:276] 0709 13:19:48.738632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:48.744361 (+  5729us) service_pool.cc:224] Handling call
0709 13:19:48.744639 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:48.816407 (+ 71768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.260804 (+1444397us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b54000b4d54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:50.261003 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57821952}
I20260709 13:19:50.266681 16879 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:50.239642 19905 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.229261 20321 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.273360 20033 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.274326 20358 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:50.277573 20321 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.260135 20302 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.254971 20357 raft_consensus.cc:2764] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:19:50.285148 16957 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:50.293136 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.295080 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.296696 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:50.293350 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 59534.6us
W20260709 13:19:50.297334 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.297461 16955 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:50.297930 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.300897 20357 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:50.306322 16955 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:50.307968 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.295934 20321 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:50.317417 20318 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.309680 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:50.310554 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:50.318048 20315 log.cc:927] Time spent T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.939s	user 0.004s	sys 0.000s
I20260709 13:19:50.318123 16958 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.319001 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:50.319366 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 2035) took 1108 ms. Trace:
I20260709 13:19:50.319772 16954 rpcz_store.cc:276] 0709 13:19:49.211289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.211417 (+   128us) service_pool.cc:224] Handling call
0709 13:19:49.211770 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.227311 (+ 15541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.227357 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.227935 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.378640 (+150705us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:49.378680 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.378743 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.317546 (+938803us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:50.319127 (+  1581us) raft_consensus.cc:1685] finished
0709 13:19:50.319146 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.319316 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15035,"raft.queue_time_us":19220,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5339,"spinlock_wait_cycles":77013376,"thread_start_us":150389,"threads_started":1,"wal-append.queue_time_us":150694}
I20260709 13:19:50.314925 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:50.322019 20305 log.cc:927] Time spent T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.914s	user 0.003s	sys 0.000s
I20260709 13:19:50.322366 20357 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:50.324466 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 469) took 1246 ms. Trace:
I20260709 13:19:50.323060 20357 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:50.324867 16806 rpcz_store.cc:276] 0709 13:19:49.078527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.079971 (+  1444us) service_pool.cc:224] Handling call
0709 13:19:49.080296 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.080653 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.080678 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.081173 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.235143 (+153970us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:49.235195 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.235278 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.321405 (+1086127us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:50.324156 (+  2751us) raft_consensus.cc:1685] finished
0709 13:19:50.324180 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.324406 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5397,"spinlock_wait_cycles":9491712,"thread_start_us":121825,"threads_started":1,"wal-append.queue_time_us":191830}
I20260709 13:19:50.326063 20357 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:50.327097 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.312949 16953 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
W20260709 13:19:50.328997 20346 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:19:50.330317 20350 log.cc:927] Time spent T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:50.331969 20302 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:50.338081 16850 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:50.339497 16957 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:50.341629 16958 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:50.341712 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.345340 16850 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:50.346561 20348 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:50.346675 20318 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:50.342612 20298 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.347612 20298 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.347987 20298 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.347918 20033 consensus_queue.cc:1059] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:50.349277 20345 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:50.349752 20345 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:50.312032 20354 log.cc:927] Time spent T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:19:50.351958 20345 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.312911 19890 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:50.354597 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.357609 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.298012 16878 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:19:50.347136 20348 raft_consensus.cc:697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:50.341558 20317 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.389247 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.372641 20321 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:19:50.392663 20306 consensus_queue.cc:1059] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:19:50.394021 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.394245 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.395248 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.395444 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.396471 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.396878 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:50.400439 16810 raft_consensus.cc:2376] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5. Re-sending same reply.
I20260709 13:19:50.406366 16807 raft_consensus.cc:2368] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8.
I20260709 13:19:50.406788 16952 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:50.408438 16803 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:50.414706 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.415091 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.415809 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.415246 16801 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:19:50.417249 16801 pending_rounds.cc:85] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 4
I20260709 13:19:50.417472 16801 pending_rounds.cc:107] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:19:50.417689 16801 raft_consensus.cc:2889] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.418707 16803 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:50.377471 20328 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:19:50.432421 20328 consensus_queue.cc:1243] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer 4b60b701acc7473e87e3e529a2a34689 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:19:50.432891 20328 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:50.433187 20328 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:50.433955 20328 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.435142 20328 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:50.435034 20348 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.419466 20345 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:50.436704 20345 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:50.438639 16850 leader_election.cc:336] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.522s (SENT)
I20260709 13:19:50.440117 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.440369 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.441030 16885 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:50.441092 16957 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:50.419879 16806 raft_consensus.cc:2393] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:50.420748 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.442116 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.442804 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:50.443275 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:50.443816 16878 raft_consensus.cc:1813] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Handling vote request from an unknown peer 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:50.444231 16878 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:50.425272 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:50.414165 20313 raft_consensus.cc:3055] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:50.440436 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:50.445057 16882 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:50.424566 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.446836 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:50.420369 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.449661 16850 leader_election.cc:400] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8.
I20260709 13:19:50.449954 16850 leader_election.cc:403] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:50.450383 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.448032 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:50.451601 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:50.383759 20285 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.454077 16957 raft_consensus.cc:2393] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:50.457523 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.458520 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.461030 16882 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:50.461989 16878 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:50.463449 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.466673 20286 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8.
I20260709 13:19:50.466464 19890 consensus_queue.cc:1059] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:50.448601 20313 raft_consensus.cc:740] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:50.469182 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:50.469868 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:50.469862 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.438983 20240 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.473315 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:50.474083 16803 raft_consensus.cc:2393] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:50.475898 16952 raft_consensus.cc:1240] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:50.477175 20281 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.469105 20313 consensus_queue.cc:260] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.477680 20281 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:50.478071 20313 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.478245 20281 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.479140 17520 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:50.481771 20280 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:50.482156 16956 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.448797 20357 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:50.484316 20357 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.486030 20240 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.489383 16881 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:19:50.492657 16956 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:50.493108 16956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 369) took 1008 ms. Trace:
I20260709 13:19:50.493371 16956 rpcz_store.cc:276] 0709 13:19:49.484339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.484736 (+   397us) service_pool.cc:224] Handling call
0709 13:19:50.481759 (+997023us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b580036a7d0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeeeff20aa 00007feeef074447 00007feeef08cfe7 00007feeef08e7de 00007feeef09a27c 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c
0709 13:19:50.493065 (+ 11306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539888512}
W20260709 13:19:50.496459 16850 leader_election.cc:336] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.783s (SENT)
I20260709 13:19:50.496979 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.502189 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:50.508628 16850 leader_election.cc:336] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.784s (SENT)
I20260709 13:19:50.509136 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:50.510360 16775 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:50.511619 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:50.532045 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.550359 16850 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:50.507419 20199 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.526224 20145 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.517822 20286 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:50.524451 20192 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:50.561683 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.542148 20345 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.545987 20280 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.554979 20145 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.557139 20199 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:50.569393 20363 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:19:50.556514 20358 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:19:50.590144 20308 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:50.571859 20345 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:50.592296 20132 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:50.600032 20308 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.600428 20132 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.602138 20308 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.602185 20199 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.602442 20132 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.603255 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1704) took 1097 ms. Trace:
I20260709 13:19:50.603627 16877 rpcz_store.cc:276] 0709 13:19:49.505528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.505657 (+   129us) service_pool.cc:224] Handling call
0709 13:19:49.520130 (+ 14473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.520534 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.520571 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.525345 (+  4774us) log.cc:844] Serialized 26 byte log entry
0709 13:19:50.326698 (+801353us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b18002ef000. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec360d1 00007feeef051a0f
0709 13:19:50.412951 (+ 86253us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:50.413255 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 13:19:50.413448 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.413519 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.602988 (+189469us) raft_consensus.cc:1685] finished
0709 13:19:50.603076 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.603199 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":115,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":4293,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4733,"spinlock_wait_cycles":23600768,"thread_start_us":86049,"threads_started":1,"wal-append.queue_time_us":992172}
I20260709 13:19:50.608124 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:50.610687 20298 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.572976 20145 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:50.619043 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 107502us
I20260709 13:19:50.619993 16775 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.648838 16805 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
W20260709 13:19:50.668706 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 48800.3us
I20260709 13:19:50.672222 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.673086 20289 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:50.674863 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 124607us
I20260709 13:19:50.592283 20317 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:50.678488 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.682277 16950 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:50.683195 20045 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.696023 19890 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:50.696594 19890 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.696985 16950 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:19:50.697165 20240 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.698515 19890 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.699115 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:50.700608 19895 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:50.704531 20329 log.cc:927] Time spent T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.796s	user 0.001s	sys 0.004s
I20260709 13:19:50.705924 17518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 748) took 1233 ms. Trace:
I20260709 13:19:50.616640 20277 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:50.620016 19962 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:50.715847 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.706259 17518 rpcz_store.cc:276] 0709 13:19:49.472970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.476268 (+  3298us) service_pool.cc:224] Handling call
0709 13:19:49.495210 (+ 18942us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:49.514830 (+ 19620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.514859 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:49.555429 (+ 40570us) log.cc:844] Serialized 78 byte log entry
0709 13:19:49.697127 (+141698us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:49.697164 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:49.697674 (+   510us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.699334 (+1001660us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:19:50.705607 (+  6273us) raft_consensus.cc:1685] finished
0709 13:19:50.705629 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.705850 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9523,"raft.queue_time_us":56202,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":29221,"spinlock_wait_cycles":10505472,"thread_start_us":136857,"threads_started":1,"wal-append.queue_time_us":254248}
I20260709 13:19:50.716923 16957 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:50.719825 16950 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 4.
I20260709 13:19:50.668087 19978 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.668891 20132 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:50.722949 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.723563 16805 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:50.724589 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:50.708688 20363 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:19:50.720619 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:50.728281 16922 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:50.726137 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.613505 20278 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.731580 16922 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:50.676649 20357 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.735292 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.739884 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.740995 16957 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:19:50.741359 16957 pending_rounds.cc:85] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 6
I20260709 13:19:50.741601 16957 pending_rounds.cc:107] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:19:50.741843 16957 raft_consensus.cc:2889] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:50.741694 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.717357 20228 raft_consensus.cc:2764] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:50.744247 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.750661 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.732326 20318 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:19:50.753620 20365 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:19:50.739735 19905 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.743948 20299 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:50.729588 19978 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:50.781880 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 50875us
I20260709 13:19:50.784186 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:50.784817 16810 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
W20260709 13:19:50.758199 20337 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.766s	user 0.003s	sys 0.000s
W20260709 13:19:50.758515 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 82037.1us
I20260709 13:19:50.761615 20033 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:50.713619 20285 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.765130 16952 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
W20260709 13:19:50.766706 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.769656 16807 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:50.735847 20203 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:19:50.740224 20240 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:50.733850 19890 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:50.714064 20317 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.723492 20277 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.726554 19962 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.825176 19962 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.792966 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.825683 20199 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:50.826174 20199 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.827546 19978 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:50.828016 20372 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:19:50.829849 20278 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:50.797051 20033 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.780931 20299 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:50.833721 20299 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:50.839167 20298 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.839255 20033 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.726938 20281 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.797778 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:50.764416 20312 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:50.805497 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:50.809324 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:50.842934 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 45227.5us
I20260709 13:19:50.793414 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:50.812968 20243 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:50.812538 20240 raft_consensus.cc:697] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:50.796309 20203 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:50.819130 20369 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:19:50.811298 20348 raft_consensus.cc:3055] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:50.857860 20348 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:50.858736 20348 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.828032 20199 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.841410 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1656) took 1712 ms. Trace:
I20260709 13:19:50.814195 20277 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.862566 20145 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.863759 16801 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:50.823580 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:50.866204 19962 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:50.866859 19962 raft_consensus.cc:697] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:19:50.795255 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.780005 20352 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:19:50.850035 20240 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.850654 20050 raft_consensus.cc:3055] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:19:50.853024 20281 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.853097 20203 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:50.883287 16808 raft_consensus.cc:2410] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:19:50.853494 19569 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.790239 19905 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:50.887306 19569 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.889086 19905 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.869915 16881 raft_consensus.cc:1240] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:19:50.871730 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:50.891217 19905 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:50.891773 19905 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.892180 16804 raft_consensus.cc:2376] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9. Re-sending same reply.
I20260709 13:19:50.871826 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:50.861950 16809 rpcz_store.cc:276] 0709 13:19:49.129014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:49.129473 (+   459us) service_pool.cc:224] Handling call
0709 13:19:49.157776 (+ 28303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:49.646159 (+488383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:49.646194 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:49.678807 (+ 32613us) log.cc:844] Serialized 26 byte log entry
0709 13:19:49.709183 (+ 30376us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:49.709218 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:50.841098 (+1131880us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54000d7fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:50.841142 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:50.841180 (+    38us) raft_consensus.cc:1685] finished
0709 13:19:50.841192 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:50.841358 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118905,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":278158080,"thread_start_us":383104,"threads_started":2,"wal-append.queue_time_us":154304,"wal-append.run_cpu_time_us":1508,"wal-append.run_wall_time_us":1006209}
I20260709 13:19:50.870391 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:50.877508 20145 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.889412 19569 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.897612 19804 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.898008 19804 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.898340 19804 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.899174 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:50.893854 19905 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:50.900300 20280 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:50.899956 20282 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:50.901875 20282 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:50.902235 20282 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.902590 20282 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:50.902323 20299 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.867849 19962 consensus_queue.cc:237] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.906415 20050 raft_consensus.cc:740] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:50.907411 20050 consensus_queue.cc:260] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.908776 20050 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:19:50.910498 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:50.911312 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:50.911857 20314 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.912475 16883 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:50.912413 20314 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:50.913336 16881 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
W20260709 13:19:50.913503 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 141101us
I20260709 13:19:50.914506 16876 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:19:50.920665 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:50.920706 19895 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:50.921566 20277 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.921927 20277 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.922220 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:50.922573 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:50.922878 17519 raft_consensus.cc:2393] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 7: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:50.924000 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:50.925025 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:50.925050 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:50.928568 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:50.929960 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:50.931047 17520 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:50.932013 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:50.932505 17519 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.904338 20299 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.920217 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:50.935597 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:50.944185 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:50.945328 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:50.945603 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:50.946064 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:50.946475 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689
W20260709 13:19:50.946475 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 113123us
I20260709 13:19:50.947846 20278 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.947996 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.948400 20278 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:50.948836 20278 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.949245 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.949966 20192 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:50.950376 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.946620 20384 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:50.947811 16924 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:50.952105 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:50.952497 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:50.962951 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:50.963184 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:50.965785 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:50.966396 17519 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:50.967634 20313 raft_consensus.cc:3055] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:50.922256 20277 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:50.969830 20282 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.956017 20033 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:19:50.955444 20145 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:19:50.955454 20286 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:50.952188 20199 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:50.971853 20251 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:50.972275 19791 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:50.973157 19978 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:50.981932 20317 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:50.982273 19804 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:50.987861 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:50.991971 20313 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:51.006443 20299 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:51.026604 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.002103 20358 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:51.025676 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.027809 20284 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:51.046327 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:51.046983 16953 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.012274 20251 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.050050 20251 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:51.037844 16850 leader_election.cc:336] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.797s (SENT)
I20260709 13:19:51.039121 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.035530 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.011170 19791 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.056885 16807 raft_consensus.cc:1240] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 4. Current term is 5. Ops: []
I20260709 13:19:51.059108 16807 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:51.060050 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:51.060667 16802 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:51.062068 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:51.065371 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:51.066113 16804 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:51.067517 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:51.068589 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:51.069094 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:51.069696 16803 raft_consensus.cc:2393] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:51.069875 16802 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:51.048436 20192 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.073614 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:51.055629 19791 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.075942 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.083801 16775 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:51.089619 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:51.097507 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 142671us
I20260709 13:19:51.106278 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:51.084771 20390 log.cc:927] Time spent T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:19:51.110972 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:51.112318 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.118780 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:51.123243 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:51.123939 16957 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.125555 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.126443 16881 raft_consensus.cc:2410] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:51.126946 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.127974 16950 raft_consensus.cc:2410] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:19:51.150480 16953 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:51.153535 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.088707 20145 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:51.160701 16884 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:51.165009 16958 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:19:51.110445 19569 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:51.169723 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.172816 16953 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:19:51.206204 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 191377us
I20260709 13:19:51.209940 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.210940 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.211591 16883 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:51.155620 20317 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.151300 20289 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:51.219545 16881 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:51.220666 16957 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:51.241180 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:51.241976 16802 raft_consensus.cc:2393] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:51.242363 16803 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:51.221681 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:51.157500 20312 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:51.169082 20373 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:51.206223 20298 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:51.259559 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:51.209152 20262 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:51.267786 16810 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:51.168340 20203 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:51.269510 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 171279us
I20260709 13:19:51.146618 20313 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.271314 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.253109 20386 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:51.217692 20309 consensus_queue.cc:1059] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:19:51.262238 20240 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.243199 20394 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:51.256659 20284 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:51.253590 20250 consensus_queue.cc:1059] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:19:51.284605 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 131161us
I20260709 13:19:51.264065 20282 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.292258 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.286724 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:51.242241 20317 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:51.297816 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 86741.2us
I20260709 13:19:51.288620 20386 raft_consensus.cc:697] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:51.302428 16775 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:51.290511 19804 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.307296 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.314760 16850 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.315691 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.316067 20358 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:51.316581 20145 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:51.316577 20358 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:51.317344 20358 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.317876 20145 raft_consensus.cc:697] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:51.318545 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.318895 20145 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.320348 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.272907 20262 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.328620 19905 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:51.255651 20289 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.307251 19962 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:51.260041 20312 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.264966 20373 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.340351 19905 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.291121 20240 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.340485 16850 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:51.332818 20282 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:51.305204 20050 consensus_queue.cc:1059] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:19:51.335747 20407 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:51.311856 20394 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:19:51.352999 19905 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:51.345376 20201 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.354422 20281 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.383538 20240 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.369146 20228 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:51.375311 20412 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:51.366460 20282 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:51.403214 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 157484us
I20260709 13:19:51.421504 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:51.415454 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:51.371868 20414 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:51.460191 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 119951us
W20260709 13:19:51.464681 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 95440.4us
W20260709 13:19:51.467721 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 170341us
I20260709 13:19:51.469512 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.388578 20228 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:51.360749 20284 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.455637 20282 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:51.464389 20145 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.473981 20317 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.455165 20407 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:51.466311 20050 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:51.486089 20050 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.486102 20407 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.488838 20407 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:51.489431 20407 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:51.486668 20050 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:51.464262 20203 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:51.389108 20281 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.469775 20424 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:51.454344 20412 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.501919 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.505064 16884 raft_consensus.cc:2410] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:19:51.389544 20201 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.479398 20414 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:51.480305 20409 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:51.513098 20426 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.515040 20420 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:51.515983 19791 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.517638 20422 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:51.480443 20314 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.529111 19791 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:51.504968 20394 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:51.475384 20309 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:19:51.504295 20402 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
W20260709 13:19:51.558171 20397 log.cc:927] Time spent T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:19:51.561537 20420 raft_consensus.cc:697] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:51.522192 20426 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:51.579850 20278 consensus_meta.cc:287] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.002s
I20260709 13:19:51.580242 20278 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.581669 20426 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:51.582234 20278 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:51.521495 20299 raft_consensus.cc:697] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:51.579326 20420 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.583333 20299 consensus_queue.cc:237] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:51.585632 20277 consensus_meta.cc:287] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.000s
I20260709 13:19:51.529247 20358 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.560889 20423 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:51.574918 20192 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:51.594838 16808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 1864) took 1174 ms. Trace:
I20260709 13:19:51.595234 16808 rpcz_store.cc:276] 0709 13:19:50.420339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.420477 (+   138us) service_pool.cc:224] Handling call
0709 13:19:51.594609 (+1174132us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b5400266454. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:51.594756 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012959616}
I20260709 13:19:51.460973 20386 consensus_queue.cc:237] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.575176 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:51.578099 20411 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:19:51.602288 16806 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:19:51.602620 16806 pending_rounds.cc:85] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 5
I20260709 13:19:51.602823 16806 pending_rounds.cc:107] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:19:51.603035 16806 raft_consensus.cc:2889] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:51.499904 20145 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.605657 20423 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.606607 20201 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:51.589841 20416 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:19:51.608289 20423 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:51.591163 20358 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:51.611333 20251 consensus_meta.cc:287] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.004s
I20260709 13:19:51.620208 20251 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.612564 20050 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:19:51.614092 20404 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.267s	user 0.000s	sys 0.004s
I20260709 13:19:51.614182 20312 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.614724 20373 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:51.614964 20262 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:51.616070 20289 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.586079 20277 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.522856 20228 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.619307 20145 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:51.619761 20403 log.cc:927] Time spent T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:19:51.613577 20281 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.691793 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:51.630347 20050 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:51.630841 20400 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:19:51.703531 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:51.638053 20251 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:51.642668 20313 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.646003 20423 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.651062 19905 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.653929 20282 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.576630 20422 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.659348 16958 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:51.660521 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.710839 16950 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:51.665132 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.668418 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.670591 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:51.688139 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.694139 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:51.694864 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 227332us
I20260709 13:19:51.631994 20412 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:51.695068 17493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.024s	sys 0.029s
I20260709 13:19:51.706702 17518 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:51.690994 20317 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.749406 16810 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:51.765261 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 1868) took 1342 ms. Trace:
I20260709 13:19:51.711334 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:51.794284 17493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.024s	sys 0.036s
I20260709 13:19:51.796224 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:51.796844 16803 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:51.791911 16881 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:51.793329 16806 rpcz_store.cc:276] 0709 13:19:50.422669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.471325 (+ 48656us) service_pool.cc:224] Handling call
0709 13:19:51.601955 (+1130630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.603388 (+  1433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:51.765039 (+161651us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400266450. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:51.765198 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2532654464}
I20260709 13:19:51.800061 17519 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:19:51.800415 17519 pending_rounds.cc:85] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 6
I20260709 13:19:51.800618 17519 pending_rounds.cc:107] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:51.800822 17519 raft_consensus.cc:2889] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:51.794283 16808 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:51.574570 20394 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.804913 17519 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:51.760360 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:51.709837 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:51.806365 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 96586.7us
I20260709 13:19:51.807394 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.810163 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:51.810900 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:51.767740 20422 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.794874 20312 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.748449 20145 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:51.872350 20417 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:51.710393 20281 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:51.711772 20433 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:51.884044 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 76741.2us
I20260709 13:19:51.776859 19932 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:19:51.884992 20145 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.901118 20433 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.902546 20145 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:51.801190 20317 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.903151 20433 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.903990 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:51.904623 20317 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.905018 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:51.905156 16803 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:19:51.906000 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:51.906284 20317 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:51.907827 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.908020 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:51.908740 17523 raft_consensus.cc:2368] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:51.908694 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.909195 16959 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:51.909713 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:51.910691 16879 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:51.911473 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.912089 16881 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:51.912314 16956 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:19:51.916577 19905 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.913151 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:51.917948 20417 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:51.920287 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:51.920671 20394 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:51.874986 20284 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:51.921973 20284 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:51.923178 20317 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:51.923623 20317 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.705399 20423 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:51.808655 20289 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:51.904711 17524 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEARNER]: Advancing to term 10
I20260709 13:19:51.879705 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:51.948213 17526 raft_consensus.cc:2368] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9.
I20260709 13:19:51.925268 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:51.949291 16805 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:51.927291 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:51.950220 16952 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.931089 17519 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:51.952132 16954 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:51.931139 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:51.937732 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:51.954098 16808 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:51.939690 16922 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:51.954545 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:51.955840 19791 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:51.956951 19791 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:51.958794 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.924036 20317 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:51.961861 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:51.962455 16958 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:19:51.963486 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:51.964141 16959 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:51.965029 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:51.965139 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:51.965618 16806 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:51.968178 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.968809 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:51.969398 16810 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:51.968312 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.984062 16877 raft_consensus.cc:2410] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:19:51.985215 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:51.985842 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:51.988660 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.998622 16883 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:19:51.989578 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:51.999507 16882 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:19:51.936513 20394 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.936733 19962 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.991735 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:52.002909 16803 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:51.959339 16954 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:52.000836 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:52.004002 16882 raft_consensus.cc:2393] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:51.883970 20312 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:52.009028 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:51.999310 16922 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:52.007323 16805 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:52.017642 16922 leader_election.cc:400] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:52.018051 16922 leader_election.cc:403] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:19:52.001371 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:51.958086 20282 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:51.924698 20281 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:52.038218 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:52.028515 16808 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:19:52.041344 16959 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 6.
I20260709 13:19:52.033169 16952 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:19:52.033414 16922 leader_election.cc:400] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9.
I20260709 13:19:52.044148 16922 leader_election.cc:403] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:19:52.046545 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.045764 16922 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:52.049149 16805 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:52.054677 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:52.054792 16885 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:52.055289 16882 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:52.064152 16959 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:51.958235 19932 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:19:52.070312 16882 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:51.970448 20412 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:19:52.008229 20284 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:52.077885 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:52.021770 20289 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:52.029538 20299 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:52.024223 20430 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:52.024178 20192 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:19:52.100219 16803 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:52.075834 20386 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:52.048130 20424 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:52.064951 20407 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9.
I20260709 13:19:52.106351 17524 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:19:52.071835 20384 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:52.028609 20394 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:52.076059 20250 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:52.034322 19962 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.106839 17524 pending_rounds.cc:85] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 6
I20260709 13:19:52.092527 20430 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:52.116878 17524 pending_rounds.cc:107] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:19:52.097096 20277 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:52.100373 20433 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.119031 17524 raft_consensus.cc:2889] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.088634 20439 consensus_queue.cc:1059] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:19:52.109333 20250 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.109115 20384 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.112645 20386 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:52.098050 20289 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.121078 20430 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:52.129875 20250 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:52.151250 20441 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:52.133006 20384 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.126444 20433 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:52.161334 20445 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:19:52.154493 20440 log.cc:927] Time spent T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:19:52.173866 20433 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:52.176632 19962 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:52.177326 20423 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:52.177052 20386 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:19:52.180706 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.180831 20289 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:52.198369 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 479) took 1503 ms. Trace:
I20260709 13:19:52.198900 16801 rpcz_store.cc:276] 0709 13:19:50.694982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.695214 (+   232us) service_pool.cc:224] Handling call
0709 13:19:50.695620 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:50.864094 (+168474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.198093 (+1333999us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54003e76d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:52.198301 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386166656}
I20260709 13:19:52.186980 20312 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:52.189281 20281 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:52.211376 20306 raft_consensus.cc:476] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 13:19:52.212713 19962 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:52.230329 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 210320us
I20260709 13:19:52.227169 20093 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.232686 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:52.234248 19895 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:19:52.228585 19962 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.240525 20458 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:52.240964 20458 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.241294 20458 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:52.243939 20306 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.244616 20306 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.246817 20306 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:52.246934 20394 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:52.233147 20410 consensus_queue.cc:1059] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:19:52.235805 20093 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:52.240135 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:52.256208 16803 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:52.250599 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:52.256840 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:52.260931 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:52.271242 17523 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:52.272392 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.261329 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.261859 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:52.273221 16959 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:52.261907 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.253814 20277 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:52.274092 20277 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.274212 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.274446 20277 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:52.274993 16959 raft_consensus.cc:2393] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:52.247268 20317 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:52.265870 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:52.277268 20254 raft_consensus.cc:3055] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:52.277676 20254 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:52.278687 20317 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:52.278506 20254 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.261392 20299 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:19:52.254199 20212 raft_consensus.cc:3055] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:52.280463 20212 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:52.281211 20212 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:52.282364 20212 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:52.254673 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:52.284469 16801 raft_consensus.cc:2368] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:52.269953 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:52.261186 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:52.255321 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:52.286895 17522 raft_consensus.cc:2393] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:52.261629 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.259316 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.286329 17519 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:52.259066 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:52.275552 16952 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:19:52.259974 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:52.291712 16809 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 10: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:52.262461 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:52.295873 19905 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:52.248121 20410 raft_consensus.cc:3055] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:52.296566 20410 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:52.297396 20410 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.298214 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:52.298954 16809 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:52.304025 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.261013 20228 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:52.305935 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:52.294909 20313 consensus_meta.cc:287] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.006s
I20260709 13:19:52.303020 20407 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.308357 20093 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:52.308959 20288 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:52.309983 16802 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:52.319481 20407 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:52.310322 20413 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.957s	user 0.000s	sys 0.002s
I20260709 13:19:52.257571 19962 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:52.318356 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:52.322962 16955 raft_consensus.cc:1275] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:52.292090 20455 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:52.348356 16802 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:52.303452 20317 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.353609 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.354453 16955 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:52.357357 16876 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:19:52.358697 16880 raft_consensus.cc:1240] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:52.281790 20277 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.364233 16955 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:19:52.362200 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 48812.9us
I20260709 13:19:52.368604 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:52.369503 16955 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:52.374646 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:52.249578 20458 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.373559 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:52.403908 16803 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:52.317399 20410 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:52.387267 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:52.405321 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:52.405936 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.406646 16951 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:52.406766 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.408800 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.409572 16879 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:52.420869 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:52.421659 16884 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:52.434746 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:52.435521 16881 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:52.437254 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.321441 20201 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:19:52.445195 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:52.459432 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:52.443993 16773 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:52.475100 16958 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:52.489172 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:52.492398 16884 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:19:52.497572 16850 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:52.499279 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:52.500021 16951 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 4.
I20260709 13:19:52.428480 20386 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:19:52.510766 16848 connection.cc:256] RPC call timeout handler was delayed by -1.2058746420000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:19:52.511371 16848 connection.cc:256] RPC call timeout handler was delayed by -1.1677375369999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 13:19:52.380481 20317 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:52.442559 20407 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:52.523165 16879 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:52.519449 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:52.431957 20262 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:19:52.547909 17522 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:52.526206 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:52.551262 16884 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:52.552912 17527 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:19:52.515540 20438 log.cc:927] Time spent T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:19:52.513203 20286 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:52.600404 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:52.601529 16809 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:19:52.603307 16809 pending_rounds.cc:85] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 3
I20260709 13:19:52.603598 16809 pending_rounds.cc:107] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:19:52.603892 16809 raft_consensus.cc:2889] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.506484 20045 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:19:52.549307 20357 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:52.543882 20288 raft_consensus.cc:697] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:52.517807 20192 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:19:52.523798 20050 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:19:52.602211 20286 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.520885 20386 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.622248 20455 raft_consensus.cc:697] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:52.640291 19905 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:52.678894 20286 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:52.692143 19905 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:52.714639 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:52.667522 20250 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.798645 16881 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:52.790161 19905 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:52.829211 20277 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:52.848446 20467 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:52.849037 20458 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:52.868372 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 332555us
I20260709 13:19:52.909461 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:52.864480 20384 consensus_meta.cc:287] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.696s	user 0.011s	sys 0.001s
I20260709 13:19:52.862900 20192 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.826895 20288 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.866113 20421 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:52.868918 20317 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:52.879732 20093 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:52.854399 20455 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:52.928491 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:52.918308 20464 log.cc:927] Time spent T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
W20260709 13:19:52.921747 20460 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.321s	user 0.000s	sys 0.002s
W20260709 13:19:52.945592 20410 consensus_meta.cc:287] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.002s
W20260709 13:19:52.946249 20228 consensus_meta.cc:287] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.638s	user 0.004s	sys 0.005s
I20260709 13:19:52.946401 17523 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:19:52.946830 17523 pending_rounds.cc:85] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 7
I20260709 13:19:52.947062 17523 pending_rounds.cc:107] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:19:52.947322 17523 raft_consensus.cc:2889] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:52.948005 20250 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:52.949855 20386 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:52.951303 20430 consensus_meta.cc:287] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.796s	user 0.003s	sys 0.008s
I20260709 13:19:52.951804 20430 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.954056 20430 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:52.928120 20469 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:19:52.955590 17522 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:52.931058 20463 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:19:52.922264 20192 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:52.926218 20421 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:52.946249 20410 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:52.974642 20421 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:52.971990 20286 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:52.935352 20093 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.009444 20406 raft_consensus.cc:3055] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:53.009907 20406 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:53.010764 20406 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.013283 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 954) took 1933 ms. Trace:
I20260709 13:19:52.915879 20384 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.034591 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:53.046555 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.065311 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 184063us
I20260709 13:19:53.065541 20384 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.067001 20093 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:53.069866 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 625927us
I20260709 13:19:53.070516 16773 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:53.072798 20486 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:53.074256 20381 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:53.075760 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:53.014575 17520 rpcz_store.cc:276] 0709 13:19:51.079960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.080130 (+   170us) service_pool.cc:224] Handling call
0709 13:19:51.080482 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:51.263521 (+183039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.263564 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:52.281901 (+1018337us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b2c000d0c08. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:19:52.282362 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:19:52.381399 (+ 99037us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:52.381436 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:52.381497 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:53.001481 (+619984us) raft_consensus.cc:1685] finished
0709 13:19:53.001517 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.013217 (+ 11700us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127188,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":33057,"spinlock_wait_cycles":2745600,"thread_start_us":274665,"threads_started":2,"wal-append.queue_time_us":267544}
W20260709 13:19:53.078974 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 559554us
I20260709 13:19:53.077419 16848 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:53.079520 20373 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.077600 20281 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:53.080165 20281 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:53.080058 20373 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.080578 20281 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:53.081116 20394 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:53.081674 20394 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.074662 20381 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:53.083156 20381 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.077399 20357 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.083969 20357 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.085846 20357 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:53.086290 19962 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:53.086807 19962 raft_consensus.cc:697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:53.087638 19962 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.088207 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:53.089015 20373 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.089358 20394 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.090651 20486 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:53.092903 20462 log.cc:927] Time spent T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:19:53.094826 20410 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.094573 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:53.095490 20474 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.238s	user 0.000s	sys 0.003s
I20260709 13:19:53.095991 20410 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.099057 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:53.099647 16805 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
W20260709 13:19:53.099479 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:53.101037 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.112972 16924 leader_election.cc:400] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 5 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6.
I20260709 13:19:53.113863 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:53.071254 19905 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.112536 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:53.117067 20250 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.119807 20262 consensus_queue.cc:1059] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:53.111516 19978 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:53.134207 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:53.134793 16958 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.126538 20385 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:53.137123 19978 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.115317 20410 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:19:53.139989 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.124832 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1681) took 1909 ms. Trace:
I20260709 13:19:53.140559 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:53.141108 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.141710 20410 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.142261 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.115962 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:53.126775 17518 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44626 (request call id 756) took 2196 ms (client timeout 2927 ms). Trace:
W20260709 13:19:53.123131 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 45808.9us
W20260709 13:19:53.145345 17518 rpcz_store.cc:269] 0709 13:19:50.926958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.927061 (+   103us) service_pool.cc:224] Handling call
0709 13:19:53.122706 (+2195645us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54005b4fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:53.122826 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748692736}
I20260709 13:19:53.145699 16848 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:53.140544 16804 rpcz_store.cc:276] 0709 13:19:51.215191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.217503 (+  2312us) service_pool.cc:224] Handling call
0709 13:19:51.217759 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.224112 (+  6353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:51.224157 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:51.224194 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:51.224221 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.124630 (+1900409us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b54000992d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:53.124675 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:53.124782 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14093696}
I20260709 13:19:53.076565 20406 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:53.148480 16958 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:53.149969 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:53.157383 20312 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.158078 20312 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.161149 20312 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.171401 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:53.172192 16805 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.139786 19978 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:53.133919 20486 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:53.174399 17527 raft_consensus.cc:2393] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:53.175145 16848 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:53.176633 16848 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:53.179184 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:53.192677 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 62219us
I20260709 13:19:53.152021 20373 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.196134 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:53.196177 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:53.196928 16882 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:19:53.197011 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:53.198822 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:53.199594 16958 raft_consensus.cc:2393] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:53.192297 20093 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:53.181203 20493 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:53.201383 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:53.201934 16958 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:53.170836 20228 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:53.204027 20228 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:53.204533 20228 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:53.203775 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.194506 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:53.209971 16848 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:53.211074 16880 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:53.211244 16958 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:19:53.170675 20384 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.221477 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.229676 16882 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:53.235296 16877 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:19:53.180783 20486 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:53.181280 20386 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.173659 20435 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:19:53.182330 20281 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.250240 20286 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:53.254212 19978 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:53.226308 20373 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.255496 20281 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:53.225263 20312 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:53.256171 20312 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.240454 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:53.184753 20385 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:19:53.237936 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 84729.8us
I20260709 13:19:53.249358 16805 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:19:53.193701 20192 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.217183 20321 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:53.217360 20212 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:53.266232 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:53.238689 20494 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.267186 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:53.256570 20373 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:53.225482 20428 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:53.244027 20486 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:53.257628 20420 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:53.277851 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:53.250174 20317 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:53.235880 20384 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.274494 20192 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.277338 20455 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:53.263804 20386 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.320325 20192 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.270217 20286 consensus_queue.cc:1059] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:19:53.316259 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 43963.2us
I20260709 13:19:53.269156 20493 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:19:53.279016 20321 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.280882 20212 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.292042 20428 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.353881 20192 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.354480 20428 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.356256 20250 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:53.358547 20212 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:53.359997 19905 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.362053 20384 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.340852 20455 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:53.352371 20312 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.364610 20455 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.370121 16958 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:53.302702 20317 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.374280 20317 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.376221 20381 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.378979 20381 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:53.390744 20386 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.394883 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06e6de173e42433e8df1572e54437e03"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:53.395550 16953 raft_consensus.cc:606] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:53.397208 20321 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:53.400710 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.401316 16950 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:19:53.402272 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.402542 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.404042 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.405766 20254 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:53.410729 20505 raft_consensus.cc:993] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:19:53.411286 20505 raft_consensus.cc:1081] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:19:53.417317 20228 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.420938 20228 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:53.426214 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:53.433111 16955 raft_consensus.cc:3055] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:53.433024 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:53.460994 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 222164us
I20260709 13:19:53.436391 16950 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:19:53.461267 16955 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:53.462198 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.462029 16955 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:53.463197 16955 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.437181 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:53.436911 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:53.437846 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:53.439225 20351 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:53.439734 20384 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.440693 20328 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:53.446875 20457 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:53.447837 20321 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:53.448786 20381 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.453493 20486 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.460314 20422 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:53.436911 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.539948 16957 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:53.465705 16956 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:53.465934 17527 raft_consensus.cc:2393] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:53.540822 20486 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.460572 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:53.542119 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 81638.4us
I20260709 13:19:53.543133 16775 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:53.544540 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:53.476562 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 223522us
I20260709 13:19:53.545950 16848 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:53.477229 16955 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
W20260709 13:19:53.481814 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 244698us
W20260709 13:19:53.483399 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.547896 16955 pending_rounds.cc:85] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 6
I20260709 13:19:53.548266 16955 pending_rounds.cc:107] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:19:53.548553 16955 raft_consensus.cc:2889] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:53.550040 20394 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:53.550738 20199 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:53.551645 20394 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:53.551884 20312 consensus_queue.cc:1059] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:19:53.557885 20312 raft_consensus.cc:3055] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:53.558288 20312 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:53.552058 20500 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:53.539667 20422 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.563383 20422 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:53.549922 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:53.567900 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:53.569218 20493 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:53.569886 20493 raft_consensus.cc:697] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:53.570914 20493 consensus_queue.cc:237] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.580046 20394 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.580699 20394 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.583508 20394 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.559193 20312 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.585289 20312 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:53.555970 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:53.590781 20500 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:53.591257 20500 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:53.591742 20500 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:53.600410 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:53.601200 16877 raft_consensus.cc:2393] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 7: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:53.604032 20394 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:53.608450 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:53.614711 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:53.618661 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.618402 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:53.641866 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:53.642513 16877 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:53.642938 16803 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:53.643391 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:53.644071 16882 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:53.644707 16803 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:53.642679 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:53.647375 16803 raft_consensus.cc:1275] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:19:53.475957 20509 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:53.620977 20262 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:19:53.652588 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.667198 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:53.675166 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:53.679733 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.680466 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:53.496236 20384 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.681594 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:53.682843 16953 raft_consensus.cc:606] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:53.698117 16953 raft_consensus.cc:614] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:53.652182 20439 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:53.641459 20288 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.751538 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:53.754166 16951 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:53.750339 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:53.755579 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:53.760375 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:53.476074 20351 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.767832 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:53.761031 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.766439 16806 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:53.768596 16882 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:53.767223 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:53.768397 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:53.621224 20321 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:53.617643 20381 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.537842 20328 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.665457 20470 consensus_queue.cc:1059] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260709 13:19:53.607756 20457 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.847157 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:53.964570 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:53.965382 16802 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
I20260709 13:19:53.674242 20509 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:53.991314 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:53.785521 20508 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.991765 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:53.991994 20428 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:54.007210 20428 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.009757 20428 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:54.012260 20422 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:54.012956 20321 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:54.012781 20422 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:54.014899 20422 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:54.021124 20384 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.992502 20250 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:54.022696 20145 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:54.023007 20250 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.023263 20145 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:54.025094 20250 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:54.037020 20381 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:54.040159 20145 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.991577 20457 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.800516 20317 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:53.785650 20228 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:53.785305 20511 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:54.001766 16882 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:54.042160 20351 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:53.993857 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:54.071238 16924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.018s	sys 0.050s
W20260709 13:19:54.130805 16924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.018s	sys 0.051s
W20260709 13:19:54.131206 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 788450us
I20260709 13:19:53.766705 20288 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.106745 20455 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:54.087483 20508 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:54.107831 20312 consensus_meta.cc:287] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.004s
I20260709 13:19:54.113041 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:54.132818 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:54.130852 16880 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:54.134259 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:54.099368 20495 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
I20260709 13:19:54.132002 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:54.136301 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:54.144692 16808 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:54.146657 20203 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:54.146865 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.146788 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:54.147168 20203 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:54.147606 20203 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:54.147565 16806 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:54.150748 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:54.153466 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:54.148631 20455 raft_consensus.cc:697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:54.156374 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:54.157644 16805 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.019s	sys 0.009s
W20260709 13:19:54.158015 16805 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.019s	sys 0.009s
I20260709 13:19:54.158808 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:54.178732 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:54.147961 20212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.050s	sys 0.078s
I20260709 13:19:54.179557 16810 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:19:54.188314 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:54.156185 19978 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.032s	sys 0.057s
I20260709 13:19:54.136061 20228 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.201270 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:54.211768 16954 raft_consensus.cc:2410] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:19:54.188369 20212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.051s	sys 0.078s
I20260709 13:19:54.230638 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:54.231225 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:54.232065 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:54.234006 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:54.235416 20351 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:19:54.235630 20518 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:19:54.236562 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 960) took 1979 ms. Trace:
I20260709 13:19:54.141363 20511 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:54.464808 16775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.002s	sys 0.005s
I20260709 13:19:54.246834 20328 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:54.700706 16775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.004s	sys 0.006s
I20260709 13:19:54.284264 20312 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:54.702116 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 933691us
I20260709 13:19:54.702214 20312 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:19:54.676991 20203 consensus_meta.cc:287] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.003s
I20260709 13:19:54.703135 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:54.245906 17492 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.015s	sys 0.039s
W20260709 13:19:54.703999 17492 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.030s	sys 0.067s
I20260709 13:19:54.703433 20203 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:54.704509 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 1.06181e+06us
I20260709 13:19:54.705793 20203 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:54.706061 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:54.270100 20424 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.706732 20424 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.707654 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:54.707811 20514 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:54.708376 20514 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:54.708752 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 476749us
I20260709 13:19:54.709272 17527 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEARNER]: Advancing to term 11
I20260709 13:19:54.710638 20514 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:54.472546 20522 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:19:54.268225 20455 consensus_queue.cc:237] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:54.715742 20505 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.008s	sys 0.008s
W20260709 13:19:54.716321 20505 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.009s	sys 0.009s
I20260709 13:19:54.717213 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:54.717469 17527 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:19:54.717913 17527 pending_rounds.cc:85] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 6
I20260709 13:19:54.717974 16951 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:54.718312 17527 pending_rounds.cc:107] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:19:54.718786 16951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 2060) took 1283 ms. Trace:
I20260709 13:19:54.718839 17527 raft_consensus.cc:2889] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:54.719352 16951 rpcz_store.cc:276] 0709 13:19:53.435403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.189534 (+754131us) service_pool.cc:224] Handling call
0709 13:19:54.718720 (+529186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:19:54.718165 16924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.003s	sys 0.014s
W20260709 13:19:54.720423 16924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.004s	sys 0.014s
W20260709 13:19:54.256150 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.720865 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 574894us
I20260709 13:19:54.722254 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:54.235996 20351 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:54.723243 20351 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:54.723733 16924 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:19:54.266917 19905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.034s	sys 0.052s
W20260709 13:19:54.724869 19905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.152s	user 0.041s	sys 0.083s
I20260709 13:19:54.726218 20281 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.726678 20281 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:54.210445 19978 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.033s	sys 0.057s
I20260709 13:19:54.243839 19932 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:19:54.464618 16773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.007s	sys 0.001s
W20260709 13:19:54.730449 16773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.008s	sys 0.002s
I20260709 13:19:54.730240 20281 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:54.464926 20421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.003s	sys 0.004s
W20260709 13:19:54.731513 20421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.004s	sys 0.006s
I20260709 13:19:54.247326 20509 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:54.740500 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 1900) took 1128 ms. Trace:
W20260709 13:19:54.485203 17490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.009s	sys 0.009s
W20260709 13:19:54.754262 17490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.011s	sys 0.016s
W20260709 13:19:54.754331 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.293247 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.720546 17523 rpcz_store.cc:276] 0709 13:19:52.256945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.271962 (+ 15017us) service_pool.cc:224] Handling call
0709 13:19:52.272194 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.947752 (+675558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.236333 (+1288581us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54002ca1d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:54.236504 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549681920}
I20260709 13:19:54.757261 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:54.743691 16956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.002s	sys 0.005s
W20260709 13:19:54.758734 16956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.002s	sys 0.005s
I20260709 13:19:54.292064 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1692) took 1989 ms. Trace:
I20260709 13:19:54.743891 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:54.759694 16809 rpcz_store.cc:276] 0709 13:19:52.303060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.303204 (+   144us) service_pool.cc:224] Handling call
0709 13:19:52.304414 (+  1210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.604399 (+299985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.291802 (+1687403us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400265f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:54.292005 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682412800}
I20260709 13:19:54.760946 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:54.761618 16809 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:19:54.680897 17493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.003s	sys 0.023s
W20260709 13:19:54.762181 17493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.003s	sys 0.024s
I20260709 13:19:54.236577 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:54.744294 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:54.763443 17526 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:54.746326 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:54.746490 17524 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:19:54.699744 20288 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:54.748297 20457 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:54.589308 16958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 400) took 1371 ms. Trace:
W20260709 13:19:54.772308 16803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.000s	sys 0.012s
I20260709 13:19:54.750274 20423 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:54.750499 20534 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:54.247973 16952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 2097) took 1121 ms. Trace:
W20260709 13:19:54.752334 16805 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.004s	sys 0.008s
W20260709 13:19:54.780637 16805 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.004s	sys 0.008s
W20260709 13:19:54.752671 16848 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.001s	sys 0.011s
W20260709 13:19:54.781076 16848 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.001s	sys 0.011s
I20260709 13:19:54.753219 16801 rpcz_store.cc:276] 0709 13:19:53.612532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.612677 (+   145us) service_pool.cc:224] Handling call
0709 13:19:53.649828 (+ 37151us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:53.653718 (+  3890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.653763 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.202643 (+548880us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b48000801d8. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef3fbfaa1 00007feef3fb6b37 00007feef3fb69ca 00007feef40ae26f 00007feef40adf37 00007feef40c255c 00007feef40c2508 00007feef40c2488 00007feef40c2443 00007feef40c16ec 00007feef2feba96
0709 13:19:54.353527 (+150884us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b2c000264b8. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:19:54.363470 (+  9943us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.740058 (+376588us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:54.740112 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.740212 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.740265 (+    53us) raft_consensus.cc:1685] finished
0709 13:19:54.740281 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.740435 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3511,"raft.queue_time_us":4145,"raft.run_cpu_time_us":8145,"raft.run_wall_time_us":538800,"spinlock_wait_cycles":28834304,"thread_start_us":376139,"threads_started":1,"wal-append.queue_time_us":355830}
I20260709 13:19:54.782167 16809 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:19:54.770627 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 46981.1us
I20260709 13:19:54.771929 20540 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:54.773164 16803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.000s	sys 0.013s
I20260709 13:19:54.784263 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:54.304109 20254 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.014s	sys 0.013s
W20260709 13:19:54.774168 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:54.772816 16958 rpcz_store.cc:276] 0709 13:19:53.217727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.217884 (+   157us) service_pool.cc:224] Handling call
0709 13:19:53.218150 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:53.370597 (+152447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.588965 (+1218368us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54002080d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:54.589232 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348921728}
I20260709 13:19:54.698796 20508 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:54.778050 16810 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.016s	sys 0.029s
I20260709 13:19:54.742552 20505 raft_consensus.cc:2764] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:19:54.755475 20524 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:54.200137 20500 consensus_meta.cc:287] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.000s
I20260709 13:19:54.779291 16952 rpcz_store.cc:276] 0709 13:19:53.126977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.128621 (+  1644us) service_pool.cc:224] Handling call
0709 13:19:53.128878 (+   257us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:53.135765 (+  6887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.135792 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:53.136345 (+   553us) log.cc:844] Serialized 52 byte log entry
0709 13:19:53.311182 (+174837us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:53.681134 (+369952us) log.cc:844] Serialized 14 byte log entry
0709 13:19:53.682725 (+  1591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:53.682819 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.247751 (+564932us) raft_consensus.cc:1685] finished
0709 13:19:54.247770 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.247910 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11413,"prepare.queue_time_us":843633,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":22470,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":57275,"thread_start_us":505572,"threads_started":2,"wal-append.queue_time_us":503360}
W20260709 13:19:54.773368 20536 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:19:54.767777 20203 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:54.787601 16810 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.016s	sys 0.029s
W20260709 13:19:54.790584 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 87523.4us
I20260709 13:19:54.793776 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:54.795089 16801 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:19:54.785797 20254 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.014s	sys 0.016s
I20260709 13:19:54.796813 20328 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:54.786491 20424 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:54.778846 20045 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:54.797184 20328 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:54.793020 20534 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.787317 20530 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:54.799072 20288 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.778543 20457 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:54.800763 19932 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.819988 19932 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:54.822608 19932 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:54.809597 20394 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:54.788460 20540 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.802853 20421 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.800137 20531 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:54.804440 20328 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:54.832383 16803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 1911) took 1155 ms. Trace:
I20260709 13:19:54.794047 20500 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:54.837364 16803 rpcz_store.cc:276] 0709 13:19:53.676633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.677071 (+   438us) service_pool.cc:224] Handling call
0709 13:19:53.677343 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:53.678489 (+  1146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:53.678517 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:53.679016 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.784978 (+1105962us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:54.792010 (+  7032us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.801091 (+  9081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.801188 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.832146 (+ 30958us) raft_consensus.cc:1685] finished
0709 13:19:54.832170 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.832316 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9462,"prepare.queue_time_us":6985,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":1527,"raft.queue_time_us":10721,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":70831,"spinlock_wait_cycles":4272512,"thread_start_us":1014854,"threads_started":1,"wal-append.queue_time_us":1057964}
I20260709 13:19:54.799598 20203 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:54.840423 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.843071 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 56069.5us
I20260709 13:19:54.806097 20045 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.845515 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:54.847352 16952 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:19:54.850634 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:54.853042 16806 raft_consensus.cc:2410] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:54.800153 20524 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.855154 16956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 2108) took 1280 ms. Trace:
I20260709 13:19:54.856827 16956 rpcz_store.cc:276] 0709 13:19:53.574404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.205801 (+631397us) service_pool.cc:224] Handling call
0709 13:19:54.206140 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.206458 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:19:54.206894 (+   436us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.854774 (+647880us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.854827 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:54.854865 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.854921 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.855106 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31110,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":12464,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":647512,"threads_started":2,"wal-append.queue_time_us":536921}
I20260709 13:19:54.832659 20321 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 13:19:54.864521 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 71701.7us
I20260709 13:19:54.864671 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:54.844302 20508 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:54.824576 20534 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.842728 20351 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:54.824716 20530 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:54.855417 20446 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 2.644s	user 0.011s	sys 0.024s
I20260709 13:19:54.868608 16952 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:54.839167 20421 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.871826 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:54.870714 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:54.872690 16850 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.598s (SENT) [suppressed 18 similar messages]
I20260709 13:19:54.873108 16951 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:54.830232 20288 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.872159 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:19:54.869498 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 75791.8us
I20260709 13:19:54.874540 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 1921) took 1188 ms. Trace:
I20260709 13:19:54.876024 16810 rpcz_store.cc:276] 0709 13:19:53.686584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.232221 (+545637us) service_pool.cc:224] Handling call
0709 13:19:54.232516 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.232702 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:19:54.793551 (+560849us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.874234 (+ 80683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.874283 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:19:54.874327 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.874385 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.874480 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6050,"prepare.queue_time_us":193874,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":7529,"thread_start_us":634685,"threads_started":2}
I20260709 13:19:54.877298 16951 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:54.876770 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:54.885349 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:54.841174 20531 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.892454 16805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 1901) took 1279 ms. Trace:
I20260709 13:19:54.893473 16805 rpcz_store.cc:276] 0709 13:19:53.613002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.613126 (+   124us) service_pool.cc:224] Handling call
0709 13:19:53.647745 (+ 34619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:53.648082 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:54.158589 (+510507us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.791382 (+632793us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:54.792450 (+  1068us) log.cc:844] Serialized 26 byte log entry
0709 13:19:54.792563 (+   113us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:54.792731 (+   168us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.801321 (+  8590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.801386 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:54.892271 (+ 90885us) raft_consensus.cc:1685] finished
0709 13:19:54.892291 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:54.892401 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18713,"prepare.queue_time_us":722202,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":2803,"raft.queue_time_us":36692,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":6690,"spinlock_wait_cycles":5091328,"thread_start_us":1128710,"threads_started":2,"wal-append.queue_time_us":556251}
I20260709 13:19:54.907996 20351 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:54.891768 20312 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:54.877223 20543 consensus_queue.cc:1059] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:19:54.925010 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:54.926524 16951 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:54.873843 20508 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:54.929365 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:54.911537 20548 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:54.910326 20544 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:19:54.914984 20203 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:54.958748 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 544) took 2425 ms. Trace:
I20260709 13:19:54.978859 16951 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:54.933979 16956 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:54.938333 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 66360us
I20260709 13:19:54.916421 20534 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:54.979590 17522 rpcz_store.cc:276] 0709 13:19:52.533331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.596254 (+ 62923us) service_pool.cc:224] Handling call
0709 13:19:52.596647 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:52.968320 (+371673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:54.958426 (+1990106us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540055f354. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:54.958656 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":824920448}
I20260709 13:19:54.921360 20524 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:54.922581 20531 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:54.993558 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:54.915107 20530 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:54.915288 20547 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:54.954278 20540 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:55.025801 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:54.948493 20542 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:19:55.079885 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 86389.5us
I20260709 13:19:55.069940 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:55.040619 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:55.082837 16924 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:54.955188 20288 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:54.931895 20545 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.080322 20533 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:54.983067 20254 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:54.956893 20511 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.084393 20045 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:54.995275 20548 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:55.085381 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 44854.6us
I20260709 13:19:54.952781 20421 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:54.982079 20286 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.949417 20500 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.083508 16951 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:55.090083 16802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 1904) took 1475 ms. Trace:
I20260709 13:19:55.087913 19932 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:55.072336 20394 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.087152 20351 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:55.118206 20351 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.121075 20351 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.086794 20533 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.081995 20203 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.080225 20508 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.066803 20547 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.116715 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 1917) took 1430 ms. Trace:
I20260709 13:19:55.126356 16806 rpcz_store.cc:276] 0709 13:19:53.685518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:54.150514 (+464996us) service_pool.cc:224] Handling call
0709 13:19:55.115487 (+964973us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54002a7954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:55.115610 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604082432}
I20260709 13:19:55.110149 20328 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.116802 19932 raft_consensus.cc:697] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:55.110900 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:55.098191 20201 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.128420 20508 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:55.128437 16924 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:55.114059 16802 rpcz_store.cc:276] 0709 13:19:53.614268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.614395 (+   127us) service_pool.cc:224] Handling call
0709 13:19:55.089956 (+1475561us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54001667d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:55.090038 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804569856}
I20260709 13:19:55.117553 20286 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.136969 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:55.127905 20547 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:55.141223 20203 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:55.141705 20203 raft_consensus.cc:697] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:55.141988 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:55.142421 20286 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.142504 20203 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.143121 20286 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:55.093062 20554 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:55.143750 20421 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:55.143949 20358 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:55.115923 20548 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.149004 20505 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:55.168002 20505 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.126472 20492 raft_consensus.cc:3055] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:55.165627 20485 consensus_queue.cc:1059] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:19:55.166122 16924 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:55.144104 19932 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.173393 20500 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.173947 20500 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.176757 16953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50296 (request call id 21) took 1750 ms. Trace:
I20260709 13:19:55.177124 16953 rpcz_store.cc:276] 0709 13:19:53.425923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.426067 (+   144us) service_pool.cc:224] Handling call
0709 13:19:55.176564 (+1750497us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54003971d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef090853 00007feef405e60a 00007feeed5e47d4 00007feeed5e4762 00007feeed5e4691 00007feeed5e460c 00007feeed5e38c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:55.176676 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510178560}
I20260709 13:19:55.092643 20254 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.178294 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:55.147787 20493 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.568s	user 0.023s	sys 0.026s
I20260709 13:19:55.180768 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:55.182753 16809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06e6de173e42433e8df1572e54437e03"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:19:55.182976 16802 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:55.144119 20286 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.183393 16809 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:55.137174 20351 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:55.125427 20394 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.196141 16801 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:55.196738 20394 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.191792 20050 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:55.197216 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:55.198146 16801 raft_consensus.cc:2393] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:55.197860 20050 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.198881 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:55.199523 20328 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.189046 20500 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.188480 16809 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.199936 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 1903) took 1586 ms. Trace:
I20260709 13:19:55.200281 16804 rpcz_store.cc:276] 0709 13:19:53.613949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.614094 (+   145us) service_pool.cc:224] Handling call
0709 13:19:53.614447 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:54.130041 (+515594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:54.130085 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.130140 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:19:54.130183 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.199741 (+1069558us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400267854. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:55.199782 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.199887 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185126272}
I20260709 13:19:55.201025 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:55.201507 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:55.202521 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:55.202973 16804 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.189539 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:55.192412 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:55.204241 16802 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.204470 20050 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.191574 20286 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.206192 20547 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.207221 16803 raft_consensus.cc:1240] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:19:55.193253 16806 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:19:55.208412 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:55.191763 20508 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:19:55.208923 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:55.208923 16806 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:19:55.209975 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:55.204483 16880 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:55.210541 16803 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:55.127595 20534 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:19:55.201592 16953 raft_consensus.cc:606] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:55.194120 20533 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.182346 20262 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:19:55.165917 20358 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:55.214811 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:55.224141 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:55.188493 20493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.604s	user 0.027s	sys 0.027s
I20260709 13:19:55.199456 16801 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:55.216333 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:55.217361 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:55.217558 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:55.217833 16802 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:19:55.218492 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:55.229836 16878 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:55.204223 20348 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:55.213315 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:55.231527 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:55.223533 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 338246us
I20260709 13:19:55.234114 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:55.214994 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:55.224721 16877 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:55.170441 20492 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:55.235590 16804 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:55.222862 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:55.221700 16809 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.237018 16924 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:55.237933 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:55.228797 16885 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:55.192137 20351 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:55.243584 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:55.240566 16803 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:55.144325 20201 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.225653 20358 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:55.204190 20254 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.245541 16809 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.231456 20526 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.244031 20351 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:55.243084 20542 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:55.226016 19791 consensus_queue.cc:1059] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:19:55.241044 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 98248us
I20260709 13:19:55.240415 20328 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:55.224458 20508 consensus_queue.cc:1059] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:19:55.246101 16924 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:55.242839 20262 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:55.269529 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:55.270289 16953 raft_consensus.cc:606] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:55.270677 16953 raft_consensus.cc:614] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:55.245990 20554 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:55.249366 20317 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:55.256769 20045 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:55.263622 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:55.276038 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:55.266742 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:19:55.281008 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.283725 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:55.284126 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:55.285189 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:55.285550 16775 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:55.287214 20045 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.291464 20045 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.288770 20540 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:55.275864 20554 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.269140 20262 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:55.282999 19932 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.295634 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:55.282797 20493 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:55.260888 20526 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.272437 20328 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.323099 20328 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.294418 20312 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:55.292249 20559 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:55.324069 20559 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:55.293211 20250 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:55.324864 20250 raft_consensus.cc:697] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:55.325814 20547 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.325676 20250 consensus_queue.cc:237] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.313035 19791 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:55.320186 20557 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:55.324402 20559 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.328280 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:55.293301 20424 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:55.294708 20530 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:55.293951 20540 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.307999 20262 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.315196 19932 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.319129 20286 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.295887 20508 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:55.296379 20317 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.302039 20554 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:55.338579 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 53088.3us
I20260709 13:19:55.313064 20493 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.339541 16924 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:55.286645 20492 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.344743 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:55.335829 20530 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.367635 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:55.369596 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:55.374385 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:55.337013 20540 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:55.379173 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:55.376458 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:55.380286 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:55.381021 16877 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:55.352295 20286 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.348419 20543 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:55.341849 20424 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:55.350534 20493 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.344249 20508 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:55.377261 20317 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:55.352730 20545 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:55.378305 20530 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:55.385319 20492 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.402963 20312 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:55.404933 16808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 1918) took 1719 ms (client timeout 1652 ms). Trace:
W20260709 13:19:55.405536 16808 rpcz_store.cc:269] 0709 13:19:53.685792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:53.750059 (+ 64267us) service_pool.cc:224] Handling call
0709 13:19:55.404757 (+1654698us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54003e7bd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:55.404868 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896558464}
I20260709 13:19:55.406668 16959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 395) took 2993 ms. Trace:
I20260709 13:19:55.391062 20543 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:55.407020 16959 rpcz_store.cc:276] 0709 13:19:52.405879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.405983 (+   104us) service_pool.cc:224] Handling call
0709 13:19:52.442603 (+ 36620us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:52.471802 (+ 29199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:52.471831 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:55.088998 (+2617167us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b2c0012df38. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:19:55.092465 (+  3467us) log.cc:844] Serialized 52 byte log entry
0709 13:19:55.148858 (+ 56393us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:19:55.148891 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.159049 (+ 10158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:55.392194 (+233145us) raft_consensus.cc:1685] finished
0709 13:19:55.392215 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.399295 (+  7080us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8892,"raft.queue_time_us":42298,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":32037248,"thread_start_us":55725,"threads_started":1,"wal-append.queue_time_us":142727}
I20260709 13:19:55.394209 20508 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.403538 20312 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:55.397607 20545 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.379873 20560 consensus_queue.cc:1059] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:19:55.423259 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 43775.7us
I20260709 13:19:55.405179 20201 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.434128 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:55.435176 16959 raft_consensus.cc:2393] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:55.428248 20424 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.442950 20540 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.449905 20312 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.453694 20312 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.452105 20540 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.395432 20567 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:19:55.456857 19932 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.460155 20526 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:55.461699 20351 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.421329 20543 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:55.450300 20548 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.470274 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:55.471422 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:55.472095 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:55.426157 20545 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:55.508144 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:55.508473 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:55.508740 16955 raft_consensus.cc:1813] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Handling vote request from an unknown peer 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:55.509282 16955 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:19:55.515758 16952 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
W20260709 13:19:55.516776 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 163038us
I20260709 13:19:55.520110 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:55.498335 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 69233.3us
I20260709 13:19:55.520666 16803 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:55.539970 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:55.585259 16879 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:55.586314 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:55.587322 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 47448.1us
I20260709 13:19:55.588490 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:55.589447 16775 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:55.503024 20351 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.593173 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:55.600203 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:55.439589 20262 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.616215 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:55.512864 20567 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:55.606513 16803 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:55.509980 20511 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.102s
I20260709 13:19:55.636621 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:55.673200 16954 raft_consensus.cc:2393] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 7: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:55.623484 20321 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.600340 20500 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:55.600201 20328 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:55.600013 20281 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:55.609473 20286 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:55.639284 16883 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:55.618868 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:55.771064 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:55.799651 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:55.662397 20348 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:55.633613 20573 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:55.636034 20567 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.765132 20433 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.761036 20286 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:55.788533 20500 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.803285 20328 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:55.829497 20569 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 13:19:55.829646 20567 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.814734 20573 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:55.828531 20286 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:55.823588 20348 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:55.831423 20093 raft_consensus.cc:3055] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:55.836725 20548 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.828049 20433 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:55.862314 20358 consensus_meta.cc:287] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.003s
I20260709 13:19:55.853468 20573 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:55.856869 20093 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:55.832885 20500 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.839609 20554 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.806931 20572 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:19:55.857837 20348 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.858894 20493 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:55.874013 20559 consensus_meta.cc:287] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.533s	user 0.003s	sys 0.006s
I20260709 13:19:55.877246 20509 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:19:55.882897 20574 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:55.883560 20554 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.894979 20543 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.879729 20559 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.897140 20544 raft_consensus.cc:3055] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:55.897153 20543 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:55.897653 20544 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:55.898454 20544 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.899575 20544 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:55.897379 20559 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.900614 20545 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:55.902117 20545 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:55.903541 20573 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:55.905236 20573 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.947594 16807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1678) took 4733 ms. Trace:
I20260709 13:19:55.948711 16807 rpcz_store.cc:276] 0709 13:19:51.214263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:51.215957 (+  1694us) service_pool.cc:224] Handling call
0709 13:19:51.216295 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:51.370611 (+154316us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:19:51.385309 (+ 14698us) log.cc:844] Serialized 14 byte log entry
0709 13:19:54.096299 (+2710990us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b18003a82e0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeeec3e4bc 00007feeebf8c48b 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec3623a
0709 13:19:54.096527 (+   228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:54.096574 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:19:54.096616 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.946861 (+1850245us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540018a1d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:19:55.947017 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:55.947333 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9705,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":3758,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":19598,"spinlock_wait_cycles":364587136,"thread_start_us":83815,"threads_started":1,"wal-append.queue_time_us":132855,"wal-append.run_cpu_time_us":1561,"wal-append.run_wall_time_us":1041238}
I20260709 13:19:55.984669 16881 raft_consensus.cc:2393] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:55.985564 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 369313us
I20260709 13:19:55.993764 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:56.004503 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:56.007376 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:56.009760 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.010675 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:56.011272 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:56.012727 16879 raft_consensus.cc:2393] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 7: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:56.009728 16878 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:56.017186 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.018232 16880 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:56.019492 16878 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:56.023267 16924 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:56.023877 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.025198 16882 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:56.026386 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.028263 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.029335 16877 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.030279 16956 raft_consensus.cc:2410] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:19:56.031602 20250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.009s	sys 0.005s
W20260709 13:19:56.032243 20250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.009s	sys 0.005s
I20260709 13:19:56.037926 20093 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.040264 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:56.041146 16879 raft_consensus.cc:1813] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Handling vote request from an unknown peer 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:56.041836 16879 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:56.042748 20317 consensus_meta.cc:287] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.645s	user 0.012s	sys 0.005s
I20260709 13:19:56.042837 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:56.043512 20317 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:56.044435 20262 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:56.045994 20250 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:56.046068 20317 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.046757 20250 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.046921 20317 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.048025 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.048904 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.050889 20348 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.871253 20358 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.054630 20500 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:56.054948 20493 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:55.886453 20509 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:56.058172 20533 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:56.061816 20512 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:56.062018 20571 consensus_queue.cc:1059] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:19:56.063084 20534 consensus_queue.cc:1059] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:19:56.107924 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:19:56.112514 16851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.002s	sys 0.002s
W20260709 13:19:56.112931 16851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.003s	sys 0.002s
I20260709 13:19:56.116460 20571 raft_consensus.cc:3055] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:56.117024 20571 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:56.116524 20509 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.118142 20509 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:56.118384 20567 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.119264 20534 raft_consensus.cc:3055] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:56.119882 20534 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:56.121059 20534 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.123112 20534 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.129402 20543 raft_consensus.cc:993] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
W20260709 13:19:56.116551 16883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 508) took 3742 ms (client timeout 1659 ms). Trace:
W20260709 13:19:56.134027 16885 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.008s	sys 0.009s
W20260709 13:19:56.134591 16885 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.008s	sys 0.009s
I20260709 13:19:56.106357 20471 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.137818 20471 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:56.132474 16883 rpcz_store.cc:269] 0709 13:19:52.374198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.374347 (+   149us) service_pool.cc:224] Handling call
0709 13:19:56.116112 (+3741765us) spinlock_profiling.cc:243] Waited 3.26 s on lock 0x7b54001478d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:19:56.116309 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7506035968}
I20260709 13:19:56.144397 20593 raft_consensus.cc:1081] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:19:56.127594 20512 raft_consensus.cc:697] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:56.148797 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 529912us
I20260709 13:19:56.149991 20250 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:56.118328 20571 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.158062 20471 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:56.158475 19978 raft_consensus.cc:3055] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:56.158618 20358 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:56.158954 19978 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:56.168637 16807 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:19:56.148979 16879 raft_consensus.cc:1240] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:56.149088 20512 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.149859 16775 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:56.158162 16809 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:56.172796 16883 raft_consensus.cc:3055] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:56.172932 20228 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:56.173244 16883 raft_consensus.cc:740] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:56.119314 20567 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.174523 16883 consensus_queue.cc:260] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.187415 16883 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.196697 20428 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:56.197240 20428 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:56.198630 20428 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:56.200109 20508 consensus_meta.cc:287] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.774s	user 0.008s	sys 0.004s
I20260709 13:19:56.200568 20508 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.201313 20437 raft_consensus.cc:3055] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:56.201702 20437 raft_consensus.cc:740] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:56.202704 20437 consensus_queue.cc:260] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.204283 16958 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:56.205540 20561 raft_consensus.cc:3055] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:56.205968 20457 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:56.206051 20561 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:56.207964 20588 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:56.207628 20561 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.208511 20588 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.209133 20588 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:56.209154 20561 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.210886 20505 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:56.213016 20566 log.cc:927] Time spent T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.762s	user 0.005s	sys 0.000s
I20260709 13:19:56.215422 20571 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:56.217523 20317 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:19:56.220806 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.225287 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1753) took 1006 ms. Trace:
I20260709 13:19:56.225574 20433 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:56.225708 16876 rpcz_store.cc:276] 0709 13:19:55.219182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.239317 (+ 20135us) service_pool.cc:224] Handling call
0709 13:19:55.239586 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:55.239902 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:55.239928 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:55.243132 (+  3204us) log.cc:844] Serialized 26 byte log entry
0709 13:19:55.351181 (+108049us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:19:55.351219 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:55.351311 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:56.212414 (+861103us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b240010d8b8. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebe2f9c4 00007feeebe2dacb 00007feeebfe8dc9 00007feeebfe8a55 00007feeebfe809d 00007feeeec1a10e 00007feeeec3188c 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221
0709 13:19:56.224839 (+ 12425us) raft_consensus.cc:1685] finished
0709 13:19:56.224858 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.225118 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186,"raft.queue_time_us":946,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":3241,"spinlock_wait_cycles":24022784,"thread_start_us":77149,"threads_started":1,"wal-append.queue_time_us":146220}
I20260709 13:19:56.227900 16956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:56.228698 16956 raft_consensus.cc:606] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:56.229079 16956 raft_consensus.cc:614] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:56.195233 16877 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
W20260709 13:19:56.208528 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.234237 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 84558.2us
I20260709 13:19:56.240988 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.251627 20428 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:56.243263 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:56.243665 20567 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:56.247247 20475 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:56.255543 20475 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.258206 20475 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:56.247879 20437 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:56.260401 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.261001 16879 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.264127 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:56.264928 16881 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:56.266767 16704 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51366 (request call id 187) took 9294 ms. Trace:
I20260709 13:19:56.272605 16878 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:56.276655 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:56.289162 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:56.291226 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:56.292541 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:56.281742 20492 consensus_meta.cc:287] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.870s	user 0.011s	sys 0.005s
I20260709 13:19:56.284420 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:56.285136 16884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:19:56.297137 16884 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:56.297508 16884 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:56.302331 16879 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:56.287118 19978 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.314126 16883 raft_consensus.cc:1275] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:56.267199 16704 rpcz_store.cc:276] 0709 13:19:46.978227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:46.983610 (+  5383us) service_pool.cc:224] Handling call
0709 13:19:56.265947 (+9282337us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:50.235864 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:50.277309 (+ 41445us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:50.277342 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:19:50.277359 (+    17us) tablet.cc:662] Decoding operations
0709 13:19:50.278257 (+   898us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:50.278313 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:50.278342 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:19:50.279039 (+   697us) tablet.cc:701] Row locks acquired
0709 13:19:50.279059 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:50.279206 (+   147us) write_op.cc:270] Start()
0709 13:19:50.279317 (+   111us) write_op.cc:276] Timestamp: P: 1783603190279146 usec, L: 0
0709 13:19:50.279335 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:19:50.353428 (+ 74093us) log.cc:844] Serialized 3608 byte log entry
0709 13:19:50.840157 (+486729us) op_driver.cc:464] REPLICATION: finished
0709 13:19:51.087788 (+247631us) write_op.cc:301] APPLY: starting
0709 13:19:51.091952 (+  4164us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:51.173676 (+ 81724us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:51.239900 (+ 66224us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:51.353161 (+113261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:51.383481 (+ 30320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:19:51.383535 (+    54us) write_op.cc:312] APPLY: finished
0709 13:19:51.383826 (+   291us) log.cc:844] Serialized 71 byte log entry
0709 13:19:51.416386 (+ 32560us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:51.460140 (+ 43754us) write_op.cc:454] Released schema lock
0709 13:19:51.464652 (+  4512us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:51.484539 (+ 19887us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:51.484581 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1216203,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":227878,"apply.run_cpu_time_us":4412,"apply.run_wall_time_us":397516,"num_ops":9,"prepare.queue_time_us":209759,"prepare.run_cpu_time_us":33976,"prepare.run_wall_time_us":279503,"raft.queue_time_us":258415,"raft.run_cpu_time_us":6764,"raft.run_wall_time_us":163266,"replication_time_us":560686,"thread_start_us":533911,"threads_started":4,"wal-append.queue_time_us":211175,"wal-append.run_cpu_time_us":26039,"wal-append.run_wall_time_us":1932725}]]}
I20260709 13:19:56.250057 20508 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:56.313833 20093 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:56.229839 20286 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.338683 19978 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:56.355837 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 64754.2us
I20260709 13:19:56.358043 16810 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:56.355036 16884 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.362046 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:56.362646 20421 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:19:56.371721 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.372231 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.371533 16708 catalog_manager.cc:5697] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 5 to 7, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 7 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:56.372642 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.373150 20530 consensus_meta.cc:287] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.926s	user 0.018s	sys 0.000s
I20260709 13:19:56.373593 20530 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.374238 16708 catalog_manager.cc:5697] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 6 to 7, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:56.377609 16775 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:56.379081 16775 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:56.379853 20317 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:56.379902 20511 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:56.381546 20351 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:19:56.383977 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.384388 16924 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:56.385689 20568 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:56.386256 20568 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:56.387730 20317 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:56.388906 20286 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:56.389963 16952 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:56.391036 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:56.391777 16805 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:56.392717 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.394790 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.395148 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.395447 16810 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:56.395823 16809 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:56.405457 16884 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:56.404683 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:56.407482 16805 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:19:56.408288 16807 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:56.409768 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.409885 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:56.410161 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.411037 16924 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:56.411156 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.411864 20437 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.412352 20437 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.412791 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.413532 16956 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:56.414459 20437 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:56.414914 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.416059 19791 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:56.416694 20534 consensus_queue.cc:1059] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:56.416606 19791 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.416831 20203 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:56.417544 20203 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:56.417644 20534 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:56.418010 20203 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.418291 20534 raft_consensus.cc:697] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:56.416888 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.408839 16708 catalog_manager.cc:5697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:56.418957 19791 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:56.425401 20544 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:56.425861 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.425590 20534 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.428097 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.428910 16952 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:56.442024 16958 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:56.440665 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1756) took 1074 ms. Trace:
I20260709 13:19:56.446838 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.419342 20530 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:56.387322 20568 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.448071 16708 catalog_manager.cc:5697] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:56.452183 16810 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:56.456027 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:56.456254 16959 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:56.457016 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.460110 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.460737 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.463613 16803 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:56.462491 16950 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:56.465492 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.466682 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.467402 16953 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 6: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:56.468066 16956 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:56.471181 16807 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:56.472579 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.477353 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.443879 16885 rpcz_store.cc:276] 0709 13:19:55.349499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:55.349648 (+   149us) service_pool.cc:224] Handling call
0709 13:19:55.349913 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:55.350111 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:19:56.135174 (+785063us) log.cc:844] Serialized 14 byte log entry
0709 13:19:56.353902 (+218728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:56.356705 (+  2803us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:56.362366 (+  5661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:56.399979 (+ 37613us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:56.423496 (+ 23517us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13993,"prepare.queue_time_us":398566,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":11943,"raft.queue_time_us":13828,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":8263,"thread_start_us":945879,"threads_started":2,"wal-append.queue_time_us":268674}
I20260709 13:19:56.464079 20308 raft_consensus.cc:3055] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:56.484884 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.485246 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.491232 16953 raft_consensus.cc:2410] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:19:56.493541 16809 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:56.500058 16952 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:56.492514 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.484000 20308 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:56.510496 20308 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.510823 20544 consensus_queue.cc:1059] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:56.511541 20308 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:56.512179 20512 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:56.512778 20512 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.514917 20512 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:56.524068 16810 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:56.537251 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.538136 16802 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:56.545433 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:56.546311 16806 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 6: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:56.547060 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.547814 16804 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:56.556591 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:56.557686 16801 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:56.558473 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:56.570271 20599 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.185s	user 0.000s	sys 0.002s
I20260709 13:19:56.577013 20424 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:56.577466 20424 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:56.578401 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.579526 20492 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:56.579828 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:56.580186 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 83385.8us
I20260709 13:19:56.580564 16803 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:56.582600 20571 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:56.583153 20571 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.585187 20571 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:56.586755 16885 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:19:56.580186 20492 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.588042 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:56.588078 16807 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:56.590113 20492 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:56.591081 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.591655 16808 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:19:56.592526 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.593113 16808 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:56.593837 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.594812 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.599114 19978 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:56.599808 19978 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.602190 19978 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:56.508803 16958 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:19:56.603811 16802 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:56.604799 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.605355 16804 raft_consensus.cc:1240] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:56.606106 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.606299 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.606472 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.606882 16803 raft_consensus.cc:2393] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:56.607366 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:56.607959 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:56.607201 16804 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 5.
W20260709 13:19:56.608610 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.610175 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.604950 20203 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.614521 20203 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:56.608039 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:56.615454 16806 raft_consensus.cc:2393] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:56.616251 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.616711 16950 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
W20260709 13:19:56.616958 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.619637 16806 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:56.608074 16809 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:56.621388 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:56.605551 16802 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:56.623018 16809 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:19:56.623420 20588 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.624017 16802 raft_consensus.cc:1275] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:56.609308 16801 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:56.625603 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:56.626714 16809 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:56.628180 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.628888 16804 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 5.
I20260709 13:19:56.629359 20588 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:56.630816 16708 catalog_manager.cc:5697] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:56.632826 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.633934 19895 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:56.634285 20595 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:56.634519 19895 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.634833 20595 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.636754 19895 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:56.637408 20595 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:56.637904 20424 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:56.639346 20424 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:56.634310 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.640633 20475 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:56.642503 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.643143 16953 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.644140 20475 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:56.645824 20475 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:56.646109 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.647701 16951 raft_consensus.cc:2410] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:56.648224 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.647559 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.609126 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:19:56.655071 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.633145 16708 catalog_manager.cc:5697] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 5 to 7, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 7 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.657752 16956 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:19:56.663205 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.663257 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:56.672955 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.681110 16953 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:56.687371 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.687976 16877 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.665251 19978 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:19:56.693209 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.716293 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.713166 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:19:56.701541 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.766285 16877 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:56.767266 16950 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:56.730453 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:19:56.755534 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.740272 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 49015.7us
I20260709 13:19:56.678998 19791 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:56.744519 16708 catalog_manager.cc:5697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
W20260709 13:19:56.734561 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 64850.8us
I20260709 13:19:56.777817 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.778959 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:56.693567 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.782950 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:56.693991 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.784021 17520 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:56.784137 16959 raft_consensus.cc:3055] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:56.779749 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:56.785712 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.785025 16959 raft_consensus.cc:740] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:56.779907 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.791400 16956 raft_consensus.cc:2393] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:56.713790 20593 raft_consensus.cc:3055] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:56.796325 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:56.797076 16953 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:56.797828 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.798877 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.799831 16955 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:56.800154 16878 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:56.800554 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.801153 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.801232 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:56.801959 16878 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:56.808739 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:56.809402 16880 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:56.813683 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:56.816514 19895 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:56.816596 20595 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:56.816984 19895 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.817363 19895 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:56.819921 20286 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:56.820310 20286 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:56.820667 20286 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:56.822290 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.780720 19791 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.815506 16850 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:56.832218 17520 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:19:56.861524 16955 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
W20260709 13:19:56.861939 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.892746 16884 raft_consensus.cc:1240] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:56.872112 16951 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:56.873320 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:56.904132 16950 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:56.860744 16805 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:19:56.904929 16958 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:56.859869 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:56.933467 16953 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:56.834903 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.847121 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:56.782706 20568 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.922013 16956 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: []
W20260709 13:19:56.843751 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.939081 19978 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:56.863492 16803 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:56.876029 16959 consensus_queue.cc:260] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:56.948426 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:56.950680 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 77454.5us
I20260709 13:19:56.952212 19978 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:56.873533 20386 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:56.958614 19978 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:56.960685 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 189653us
I20260709 13:19:56.829437 20593 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:56.964571 16773 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:56.967823 19905 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:56.968359 19905 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:56.968773 19905 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:19:56.972316 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:56.973101 20424 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:56.973829 20424 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:56.976452 20424 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:56.977046 16954 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:56.985679 16959 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:56.961870 20386 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.993039 16924 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:56.990000 19791 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:56.993923 20386 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.011900 16952 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
W20260709 13:19:57.015241 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 57254.8us
I20260709 13:19:57.016466 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:57.002207 20607 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:19:57.014518 16848 leader_election.cc:336] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.662s (SENT)
I20260709 13:19:56.963114 20568 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.030714 16848 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:57.031509 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:57.022682 19791 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:57.040014 20572 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:57.042595 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:57.028558 20428 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:57.041474 20421 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:57.043581 20534 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:57.065349 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 250482us
I20260709 13:19:57.049331 20428 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:19:57.069008 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 54547.5us
W20260709 13:19:57.073170 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.051817 19791 raft_consensus.cc:697] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:57.073840 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 57457.8us
I20260709 13:19:57.066038 20534 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:57.078348 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.063910 19895 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.079843 20308 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:19:57.079666 20581 consensus_queue.cc:1059] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:19:57.071539 20428 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.072595 20203 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:57.041445 20593 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.085490 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.077704 20534 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.095320 20421 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.097769 19905 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.099992 19905 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:57.101814 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.103022 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.108045 20308 consensus_queue.cc:1059] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:57.108584 20475 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.109094 20595 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:57.109416 20475 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:57.111331 20437 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:57.113999 20424 raft_consensus.cc:3055] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:57.114380 20424 raft_consensus.cc:740] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:57.115787 20437 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:57.116633 20437 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.117729 20437 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:57.120230 20610 log.cc:927] Time spent T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:19:57.115186 20424 consensus_queue.cc:260] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.121236 20424 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:57.125737 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.130127 20608 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.132s	user 0.002s	sys 0.002s
W20260709 13:19:57.140400 16848 leader_election.cc:336] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.753s (SENT)
I20260709 13:19:57.093075 20593 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:57.144188 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 62248.1us
I20260709 13:19:57.145147 16850 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.147984 16848 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:57.151117 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 188567us
I20260709 13:19:57.159444 20588 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:57.150758 19905 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.161402 16850 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:57.149503 19895 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:57.159817 20532 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.165761 20588 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.168797 20588 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:57.171790 20589 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:57.173516 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:57.176759 20532 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:57.177075 20589 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:57.177201 20532 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.148650 20421 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:57.177577 20532 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:57.188750 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 50900.7us
I20260709 13:19:57.157459 19791 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.170948 20286 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:57.216886 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.182780 19905 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:19:57.241274 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.249382 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.238778 20568 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:57.238085 19905 raft_consensus.cc:697] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:19:57.259701 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 86278.2us
I20260709 13:19:57.262133 20428 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.266882 20286 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:57.277796 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 172941us
I20260709 13:19:57.271571 16959 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
W20260709 13:19:57.302233 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.301613 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:57.303962 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 261451us
I20260709 13:19:57.306701 19905 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.310385 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.311117 17520 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:57.317581 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.320003 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.320111 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:57.322347 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.322957 17522 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:57.324155 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.324770 17523 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:57.325749 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.327098 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:57.329993 17525 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:57.330716 20475 consensus_queue.cc:1059] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:57.331141 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:57.332162 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.333395 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:57.334877 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.335475 17527 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:57.336378 17524 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.341890 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.342482 17523 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:57.339942 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.344723 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.345350 16924 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
W20260709 13:19:57.346602 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.348121 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.348462 17527 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:57.347064 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:57.349864 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:57.352535 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:57.353340 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.338550 20568 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.357275 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 75989.2us
I20260709 13:19:57.253911 20589 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.361987 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:57.359859 20286 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:57.363615 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:57.364027 20286 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.364234 20428 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:57.364483 20286 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.364771 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:57.364190 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.350428 20581 consensus_queue.cc:1059] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:19:57.366158 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.366804 17518 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:19:57.367174 17518 pending_rounds.cc:85] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 6
I20260709 13:19:57.367393 17518 pending_rounds.cc:107] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:19:57.367270 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.383920 17518 raft_consensus.cc:2889] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:57.378036 16876 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:57.373428 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:57.364293 16806 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:57.372989 16877 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:57.375015 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:57.375705 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.351545 20572 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:19:57.374750 20492 raft_consensus.cc:3055] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:57.398847 20492 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:57.399541 20572 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:57.400067 20572 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:57.399803 20492 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.378976 20616 raft_consensus.cc:3055] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:57.400859 20616 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:57.401273 20492 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.387785 19791 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:57.401793 19791 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:57.402349 19791 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:57.401736 20616 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.403286 20616 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.353994 20543 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:57.403972 20543 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:57.367527 20534 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.404397 20543 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.405884 20534 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:57.367849 20625 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:57.412559 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 45349.4us
I20260709 13:19:57.413314 16775 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.413403 20532 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.414098 20627 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:57.414806 20627 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:57.397557 17524 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:57.368767 20581 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:57.423830 20581 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:57.343981 20203 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:19:57.430080 20581 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:57.398187 16848 leader_election.cc:336] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.841s (SENT)
I20260709 13:19:57.431293 20581 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.431597 16848 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.359972 20624 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.434790 20624 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.435366 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:57.436966 20624 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:57.424208 20308 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:57.437593 20428 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:57.438707 16885 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:19:57.437620 20308 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:57.398593 16883 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:19:57.416518 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 57762.7us
I20260709 13:19:57.367739 20568 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.368052 20394 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:57.380096 20620 consensus_queue.cc:1059] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
W20260709 13:19:57.422600 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 47057.8us
I20260709 13:19:57.420130 20386 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.429731 17523 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:57.439917 16880 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:19:57.443746 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.417557 20543 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.446776 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.425994 20534 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.449492 16810 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:19:57.449730 16803 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:19:57.450966 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:57.451036 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:57.461447 16802 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.451706 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:57.462393 20620 consensus_queue.cc:1243] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:19:57.454743 17524 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:57.463907 16773 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:57.464269 16806 raft_consensus.cc:2393] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 10: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:57.464891 20625 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:57.465253 20625 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.465551 20625 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.452124 20428 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:57.460271 20203 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.441265 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.472419 20568 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:57.488744 17492 connection.cc:256] RPC call timeout handler was delayed by -1.1835480619999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
I20260709 13:19:57.490132 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.490743 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.491266 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.491523 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.492273 17527 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:19:57.473506 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.407358 20572 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.442739 20308 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:57.492408 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.493842 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.494650 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:57.496311 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 55148.4us
I20260709 13:19:57.486377 16850 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:57.497726 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:57.498628 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:57.486189 20203 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.474591 16876 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:57.496384 20568 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:57.476665 16802 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
W20260709 13:19:57.501551 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.501930 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.502260 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.502507 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:57.503434 17527 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:19:57.506709 20628 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:57.506805 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.507160 20628 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:57.507560 20628 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:57.505966 19978 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.508337 19978 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.510268 19978 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:57.504346 20589 consensus_queue.cc:1059] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:19:57.511866 20589 raft_consensus.cc:3055] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:57.512195 20589 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:57.512943 20589 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.514089 20589 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:57.519069 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.519312 20428 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:57.514739 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.517197 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.515288 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.516793 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.520756 20203 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:57.516846 20572 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:57.518088 20308 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.515136 19905 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:57.524681 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:57.528071 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.501281 20532 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:57.504545 20421 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:57.536235 17525 raft_consensus.cc:3055] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:57.539127 17525 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:57.506222 20534 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.542249 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.543651 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.536080 20286 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.528483 20593 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:57.544068 16924 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:57.544250 17527 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:57.551458 20421 raft_consensus.cc:697] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:57.552944 20286 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:57.553104 20534 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:57.538493 19905 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:57.541149 20625 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.554036 17525 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.568082 17525 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:57.568264 20421 consensus_queue.cc:237] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.568572 19905 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.569767 19905 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:57.569849 20625 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:57.569759 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:57.536497 20428 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:57.571897 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.572698 20625 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.573541 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.572358 20428 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.574869 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.575579 20627 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.576116 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet 78ca000fd50c4b38bfdd60badc024845 with delete_type TABLET_DATA_TOMBSTONED (TS 96eaa6dafb3e4bbe914e54dc12507912 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:43930
I20260709 13:19:57.576560 20626 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:19:57.547722 17518 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:57.578164 20308 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:57.555246 20394 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:57.579845 19791 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.580399 20543 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:57.580457 20625 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.566131 20623 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:57.582703 20623 raft_consensus.cc:697] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:57.583647 20623 consensus_queue.cc:237] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.582707 17525 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:19:57.584780 17525 pending_rounds.cc:85] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 7
I20260709 13:19:57.584985 17525 pending_rounds.cc:107] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:19:57.585211 17525 raft_consensus.cc:2889] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:57.600391 16922 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
W20260709 13:19:57.603847 20475 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:19:57.605201 20572 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:57.605737 20572 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.606148 20572 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:57.607452 17521 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:57.617051 20386 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:57.623800 20593 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.626449 20593 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:57.629684 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.635607 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 69555.1us
W20260709 13:19:57.638268 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.639454 20437 consensus_queue.cc:1059] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:57.639835 20534 consensus_queue.cc:1059] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:57.640594 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:57.641409 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 66538.4us
I20260709 13:19:57.642221 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.581785 19791 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:57.654889 20642 tablet_replica.cc:333] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:19:57.656075 20642 raft_consensus.cc:2243] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:57.663056 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:57.663602 16802 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:19:57.666371 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:57.652335 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 153273us
I20260709 13:19:57.668771 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:57.668005 16850 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:57.669378 16803 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:57.623373 20627 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.671993 17521 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 10. Ops: []
I20260709 13:19:57.672217 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:57.668705 16876 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:19:57.672986 16809 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:57.673205 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:57.676522 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:57.676905 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:57.685478 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:57.679461 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:57.680835 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:57.692806 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:57.693346 16804 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:57.693400 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 51272.1us
I20260709 13:19:57.694305 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:57.698215 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:57.686178 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:57.706439 16810 raft_consensus.cc:2410] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:57.707106 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:57.694100 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:57.710664 16809 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:57.711661 16877 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:19:57.693826 20581 raft_consensus.cc:3055] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:57.713694 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:57.713873 20581 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:57.714833 20581 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.716149 20581 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:57.716094 16922 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:57.719636 16802 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:57.727586 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:57.730701 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:57.731931 16885 raft_consensus.cc:2410] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:19:57.694088 19978 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:57.736095 20572 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.736668 19978 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:57.737516 19978 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.738127 20572 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:57.738670 19978 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.660166 20437 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:19:57.738852 20640 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.739428 20640 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.741484 20640 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:57.742206 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.742775 17526 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:57.744081 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.695593 20626 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:57.745095 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.708442 20428 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:57.745795 20428 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.745985 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:57.746184 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.745353 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:57.744148 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:57.750252 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 52157.9us
I20260709 13:19:57.750509 16922 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:57.750976 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:57.743554 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:57.746138 20428 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:57.755434 16878 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
W20260709 13:19:57.757974 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 77242.3us
I20260709 13:19:57.756980 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:57.694461 20386 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:19:57.766067 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:57.738914 20532 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.765607 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:57.758244 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.773852 17518 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:57.753435 20317 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:57.781543 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.763761 20543 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.763535 20424 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:57.756717 20572 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.768514 20640 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:57.817934 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.773887 20571 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.779405 19791 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:57.794021 20642 raft_consensus.cc:2272] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:57.830765 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:57.808696 20626 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:57.809926 20424 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:57.783746 20532 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.821005 20317 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:57.832108 20572 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.828205 19791 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:19:57.855341 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 81297.3us
W20260709 13:19:57.857472 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 106993us
I20260709 13:19:57.859313 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:57.844332 20437 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:57.843874 20424 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:57.844041 20286 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.865470 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:57.842635 20571 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.850409 20530 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:57.869385 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 100013us
I20260709 13:19:57.852758 19791 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:57.876139 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.856297 20568 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:57.894418 16809 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:57.880928 20317 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.882148 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:57.890049 20637 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
I20260709 13:19:57.860657 20421 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.864394 20437 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.901160 20658 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:19:57.873627 20286 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.873149 20625 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:57.925318 20625 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:57.925678 20625 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.927006 20286 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:57.927263 20543 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:57.929160 20571 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:57.929760 20571 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:57.930138 20571 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:57.930480 20571 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:57.923971 20437 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:57.906046 16958 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:57.940322 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 159191us
I20260709 13:19:57.902403 16959 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:57.911617 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:57.854640 20572 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:57.948344 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 89108.4us
I20260709 13:19:57.949040 16922 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:57.856357 20628 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:57.947467 16804 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:19:57.957392 17518 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:57.909503 20642 ts_tablet_manager.cc:1916] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:57.964118 16959 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:19:57.911517 20532 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:57.961234 16924 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:57.973291 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:57.984274 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:57.984990 16955 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:57.948053 20475 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:57.987243 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:57.989795 16805 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:19:57.990854 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:57.991195 16802 raft_consensus.cc:1240] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:57.986825 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:57.950064 20640 raft_consensus.cc:697] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:58.011304 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.009090 16807 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:58.012152 16808 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:58.008265 16958 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:58.009348 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:57.993202 16954 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:58.009461 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:57.907850 20421 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.015578 16810 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 11. Ops: []
I20260709 13:19:58.011355 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.024704 20589 consensus_queue.cc:1059] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:58.026087 20628 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.026310 20589 raft_consensus.cc:3055] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:58.026702 20589 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:58.028676 20572 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.029237 20572 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:19:58.029675 20572 raft_consensus.cc:697] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:58.030793 16804 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:58.030529 20572 consensus_queue.cc:237] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.027539 20589 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:57.992776 20623 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:58.035627 16801 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:57.992918 20653 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.993362 20626 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:58.056165 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 46780.7us
W20260709 13:19:58.073426 20643 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.416s	user 0.002s	sys 0.000s
I20260709 13:19:58.073623 20424 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:58.095265 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.076180 20640 consensus_queue.cc:237] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:58.079134 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 130139us
I20260709 13:19:58.096064 16850 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.059984 20571 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.104328 19791 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.105320 20571 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.106498 19791 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.108613 16879 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: []
W20260709 13:19:58.109139 20644 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.451s	user 0.001s	sys 0.001s
I20260709 13:19:58.110077 16880 raft_consensus.cc:1240] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:58.110282 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.110925 16881 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:58.112095 16952 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:58.112766 16880 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:58.113196 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.113901 16881 raft_consensus.cc:2393] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 10: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:58.113963 16879 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:58.090533 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 192110us
I20260709 13:19:58.083428 20660 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:58.115697 20532 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:58.115906 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.116255 20532 raft_consensus.cc:697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:58.116921 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.117130 20532 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.117848 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.118399 16876 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:19:58.118559 16848 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.119366 20627 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:58.119880 20627 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.121793 20627 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:58.122289 16950 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:58.123986 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.124723 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.124857 20421 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:58.125213 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.125595 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.123463 16882 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:19:58.125834 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.126122 16878 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.126477 16881 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:19:58.128177 16885 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:58.130666 16848 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.132233 19905 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.132608 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.132836 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.133809 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.133905 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.134164 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.134523 16880 raft_consensus.cc:2393] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 10: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:58.135195 20530 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:58.085650 20475 raft_consensus.cc:697] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:58.135568 20530 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:58.136109 20530 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.136193 20475 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.117204 20428 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.138883 20428 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.100183 20424 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.148164 20428 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.148290 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.148917 16879 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:19:58.090816 20623 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:58.149092 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.149510 20623 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.149804 16885 raft_consensus.cc:2368] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8.
I20260709 13:19:58.096998 20626 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.102337 20589 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.095463 20653 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.115988 20660 raft_consensus.cc:697] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:58.110302 16877 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:58.097651 16922 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.140380 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:58.180516 16950 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
W20260709 13:19:58.090801 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 110817us
I20260709 13:19:58.169811 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:58.170423 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:19:58.179306 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:58.184540 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:58.191526 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 47005.1us
W20260709 13:19:58.185071 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 87480.1us
I20260709 13:19:58.192286 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.190683 16848 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.185748 16950 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:58.181716 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.195189 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:58.195533 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.183044 16954 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.200753 19791 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:58.201299 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:58.201886 16955 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:58.201424 19791 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:58.204003 19791 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.204188 16957 raft_consensus.cc:1240] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:58.204969 20571 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.205235 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:58.205566 20571 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.206724 16957 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:58.207962 16951 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:58.209220 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.210919 19791 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.213013 20571 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.214991 20571 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:58.217343 16955 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:19:58.217643 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.218523 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:58.221040 16958 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.219274 16922 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.226879 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.230489 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.233595 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:58.234371 16953 raft_consensus.cc:2410] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:58.248078 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.248831 16885 raft_consensus.cc:2368] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:19:58.249246 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.249907 16884 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:58.250048 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.250370 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.179334 20624 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:58.258756 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.259449 16882 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.250798 16881 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:19:58.250931 16877 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:58.256749 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.258044 16879 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:58.263115 16952 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:58.263892 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.182153 20627 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:58.260514 19791 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.218065 20424 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.277824 16958 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:19:58.229854 20593 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:58.229990 20658 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:58.190297 20568 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:19:58.286166 16959 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:19:58.248421 20286 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.178957 20317 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:19:58.258661 20624 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:58.288986 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 96693.2us
I20260709 13:19:58.269915 20534 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.195827 20437 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:58.292140 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 150667us
I20260709 13:19:58.306063 16848 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.278635 20640 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.281395 20581 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.317320 16958 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:58.305133 20624 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:58.320860 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 123589us
I20260709 13:19:58.325004 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.321350 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:58.325860 16955 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:58.322413 16950 raft_consensus.cc:1240] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:58.304721 20543 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:58.307312 20593 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:58.288488 20627 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.327430 16952 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:58.327778 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:58.328496 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:58.338063 16959 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:19:58.309309 20658 raft_consensus.cc:697] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:58.330189 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 109935us
I20260709 13:19:58.304721 20534 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.291405 20672 consensus_queue.cc:1059] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:19:58.321084 20532 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:58.327111 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:58.348436 16953 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 10: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:58.312093 20654 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:19:58.349884 16708 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58310 (request call id 266) took 21854 ms (client timeout 15000 ms). Trace:
I20260709 13:19:58.350135 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.351570 16848 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.333456 20394 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.330592 20543 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:58.384249 19905 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:58.326308 20660 consensus_queue.cc:237] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.383862 20671 consensus_queue.cc:1059] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:19:58.388161 20593 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.340698 20421 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.349949 20532 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:58.393712 20532 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.394604 20658 consensus_queue.cc:237] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.377410 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:58.397444 16953 raft_consensus.cc:2368] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8.
I20260709 13:19:58.320964 20424 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:19:58.401057 16959 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:19:58.344779 20534 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.405853 20642 ts_tablet_manager.cc:1929] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:19:58.406775 20532 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.381991 20681 consensus_queue.cc:1059] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:19:58.383647 20627 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:58.360839 20666 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:19:58.339004 16707 catalog_manager.cc:5697] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:19:58.385357 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 60413.5us
I20260709 13:19:58.368177 20437 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.381587 16878 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:19:58.418573 16707 catalog_manager.cc:5697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 7 to 8, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 8 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:58.386822 16882 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:19:58.326797 20625 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.429358 16954 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
W20260709 13:19:58.454079 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 104003us
I20260709 13:19:58.430064 16955 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
W20260709 13:19:58.455232 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 71592.3us
I20260709 13:19:58.418740 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.459501 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.460328 16809 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.462692 16707 catalog_manager.cc:5697] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:58.464463 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.468281 16807 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:19:58.407706 20642 log.cc:1199] T 78ca000fd50c4b38bfdd60badc024845 P 96eaa6dafb3e4bbe914e54dc12507912: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/wals/78ca000fd50c4b38bfdd60badc024845
I20260709 13:19:58.383953 20656 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:19:58.409159 20543 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.381608 20653 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.470715 16808 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:19:58.350348 16708 rpcz_store.cc:269] 0709 13:19:36.486435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:36.486604 (+   169us) service_pool.cc:224] Handling call
0709 13:19:58.340421 (+21853817us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:57.121727 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:57.122584 (+   857us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:57.122645 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:19:57.122671 (+    26us) tablet.cc:662] Decoding operations
0709 13:19:57.140151 (+ 17480us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:57.146557 (+  6406us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:57.150115 (+  3558us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:19:57.248144 (+ 98029us) tablet.cc:701] Row locks acquired
0709 13:19:57.248207 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:19:57.248406 (+   199us) write_op.cc:270] Start()
0709 13:19:57.248582 (+   176us) write_op.cc:276] Timestamp: P: 1783603197248333 usec, L: 0
0709 13:19:57.248612 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:19:57.262919 (+ 14307us) log.cc:844] Serialized 2813 byte log entry
0709 13:19:57.552592 (+289673us) op_driver.cc:464] REPLICATION: finished
0709 13:19:57.714064 (+161472us) write_op.cc:301] APPLY: starting
0709 13:19:57.714162 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:57.714408 (+   246us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:57.714524 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:57.715462 (+   938us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:57.715774 (+   312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:19:57.715822 (+    48us) write_op.cc:312] APPLY: finished
0709 13:19:57.716144 (+   322us) log.cc:844] Serialized 59 byte log entry
0709 13:19:57.716322 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:57.716428 (+   106us) write_op.cc:454] Released schema lock
0709 13:19:57.716487 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:57.716844 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:57.716874 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":252,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":161171,"apply.run_cpu_time_us":2771,"apply.run_wall_time_us":2778,"num_ops":7,"prepare.queue_time_us":314624,"prepare.run_cpu_time_us":14196,"prepare.run_wall_time_us":241326,"raft.queue_time_us":120842,"raft.run_cpu_time_us":87212,"raft.run_wall_time_us":125932,"replication_time_us":303828,"thread_start_us":546634,"threads_started":4,"wal-append.queue_time_us":160793}]]}
W20260709 13:19:58.474429 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 55773.8us
I20260709 13:19:58.475271 19905 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:58.478878 20530 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.482162 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.482905 16878 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:58.465534 20668 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.491910 16809 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:19:58.492799 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.494634 16802 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:58.469596 20673 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:58.496078 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.495961 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.500258 16882 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:58.467186 20626 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.505568 16885 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:19:58.505519 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 313266us
I20260709 13:19:58.507990 16880 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:58.508499 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.510128 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.507133 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:58.513195 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 58242.8us
I20260709 13:19:58.513777 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.509572 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.513809 16801 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:19:58.514678 16884 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:58.515130 16881 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:58.517627 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.518214 16808 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:58.519745 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.520256 16809 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:58.519469 16707 catalog_manager.cc:5697] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 7 to 9, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 9 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:19:58.522210 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.526166 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.517383 20595 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.528291 16807 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:19:58.529094 16850 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.530367 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.527174 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.499558 20673 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:58.534967 20685 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.539220 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:58.546365 17521 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:58.539388 16707 catalog_manager.cc:5697] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 7, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.548885 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.552644 16809 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:58.530332 20654 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:19:58.554093 20421 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.539983 20673 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.555231 20684 consensus_queue.cc:1059] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:19:58.554692 20667 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:58.558625 20667 raft_consensus.cc:697] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:58.559553 20667 consensus_queue.cc:237] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.549451 16881 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:58.530241 20437 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.562131 20492 raft_consensus.cc:3055] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:58.562390 20437 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:19:58.562584 20492 raft_consensus.cc:740] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:58.562917 20437 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.563478 20492 consensus_queue.cc:260] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.564611 20623 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.566700 20623 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.568127 20534 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.568593 20532 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.540371 20640 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:58.569954 20530 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:58.545189 19978 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:58.571098 19978 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.571430 19978 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.573429 20624 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.499163 20668 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.576050 20684 raft_consensus.cc:3055] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:58.576228 20625 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.576470 20684 raft_consensus.cc:740] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:58.577797 20668 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.552320 16924 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.578555 20286 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:58.580085 20623 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:58.580471 20623 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.578563 20616 raft_consensus.cc:3055] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:19:58.581056 20616 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:58.581037 20653 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:58.581681 20308 raft_consensus.cc:3055] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:58.582095 20308 raft_consensus.cc:740] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:58.582515 20653 consensus_queue.cc:1059] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:58.582907 20308 consensus_queue.cc:260] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.583393 20653 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:58.580842 20623 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:58.599965 16707 catalog_manager.cc:5697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 8 to 10, no longer has a pending config: VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1), VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2), VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3), VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 10 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.602387 16707 catalog_manager.cc:5697] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 5, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 5 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.603972 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.604517 16879 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.606640 20308 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.606964 20623 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.578595 20437 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:58.585481 20581 raft_consensus.cc:3055] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:58.585842 20673 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.586190 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.598712 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.587780 19791 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.577366 20684 consensus_queue.cc:260] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:58.582096 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 75030us
I20260709 13:19:58.569999 20534 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.597008 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.610498 16877 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
W20260709 13:19:58.597679 20648 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:19:58.539414 20595 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:58.598783 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.615252 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:58.612864 16879 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:19:58.609602 19791 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.617081 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.618448 16707 catalog_manager.cc:5697] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.623548 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.624744 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.626137 16707 catalog_manager.cc:5697] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.623807 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.588261 20624 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:58.613684 20424 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:58.613586 20581 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:58.636276 16707 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.582583 20616 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:58.634637 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 111893us
I20260709 13:19:58.623402 20286 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.647378 20437 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.635198 20640 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:58.649147 20581 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.650147 20581 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.653898 20543 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.654924 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.655244 16882 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:58.656348 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.657900 19905 raft_consensus.cc:1064] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
W20260709 13:19:58.661947 20688 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:58.662992 20690 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.666321 19978 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.668431 19791 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.668938 20595 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:58.669131 20685 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.669589 20685 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.637311 20571 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.670857 20571 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.671424 20571 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.670771 20424 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.673207 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.673502 20424 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.673691 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.673826 16808 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:19:58.633297 20625 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:19:58.675328 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 50672.4us
I20260709 13:19:58.676707 16807 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:58.636574 20593 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.635437 20534 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.696167 16707 catalog_manager.cc:5697] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 3 to 10, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 10 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.676321 19905 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.636654 20684 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.680150 20679 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:19:58.682394 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.682976 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.679783 20616 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:58.713462 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.713711 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.714043 16805 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:58.683830 20656 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:19:58.683985 20532 consensus_queue.cc:1059] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:58.685078 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.671555 20685 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.718488 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.685251 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:58.687037 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:58.688130 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.691654 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.720604 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.692588 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.722275 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.698899 16808 raft_consensus.cc:1240] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:58.724583 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.725219 16808 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:58.686086 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.700081 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:58.704846 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:58.726967 16954 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:19:58.728024 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:58.729259 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:58.734467 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:58.723479 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.705013 16773 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:58.712448 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:58.714299 16809 raft_consensus.cc:2376] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10. Re-sending same reply.
I20260709 13:19:58.716989 16955 raft_consensus.cc:1240] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:58.717121 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.736894 16806 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:58.740911 16801 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:58.741079 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:58.742022 16810 raft_consensus.cc:2393] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:58.745184 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:58.745651 16959 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:19:58.745711 17522 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.678393 20625 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:58.749786 17523 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:58.749967 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.747032 19791 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:58.747108 16951 raft_consensus.cc:2368] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:19:58.749346 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:58.751925 16957 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.749554 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.749822 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.752737 16810 raft_consensus.cc:2393] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:58.744946 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet 78ca000fd50c4b38bfdd60badc024845 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:19:58.754468 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:58.714483 20534 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.755616 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:58.756217 17519 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.756690 20534 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.701236 20593 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.747185 20660 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:58.758066 20660 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:58.758440 20660 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:58.759023 20593 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.759967 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.760531 20673 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.761371 16809 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:58.761540 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:58.762204 17520 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:19:58.763098 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:58.763846 16956 raft_consensus.cc:2393] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:58.764148 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:19:58.746902 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 60878.7us
I20260709 13:19:58.765786 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.751091 19791 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.749109 16707 catalog_manager.cc:5697] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 8 to 9, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 9 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.766238 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.766840 19791 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:58.769102 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.769901 16802 raft_consensus.cc:2410] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:19:58.772493 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:58.772889 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.684444 20421 consensus_queue.cc:1059] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:19:58.776767 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.780507 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.782755 16805 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:19:58.787595 16707 catalog_manager.cc:5697] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.746721 20530 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:58.783599 16773 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:58.785959 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.763931 20543 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.764827 20625 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:58.777016 20593 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.789354 16707 catalog_manager.cc:5697] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 6, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 6 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:19:58.786877 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 104549us
I20260709 13:19:58.791913 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:58.779156 20595 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:58.783928 20668 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:58.809374 16707 catalog_manager.cc:5697] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:58.790257 20572 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:58.856639 17519 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:58.814043 19791 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.808732 20694 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:58.816442 20683 consensus_queue.cc:1059] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:58.794010 19978 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.772274 20437 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:19:58.802497 20690 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:58.819032 20394 consensus_queue.cc:1059] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:58.820231 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.820506 20656 raft_consensus.cc:3055] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:58.820749 17522 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:58.826260 20386 raft_consensus.cc:3055] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:58.805295 20568 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:58.842316 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.843158 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:58.779637 20424 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:19:58.776674 20673 consensus_queue.cc:1059] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:19:58.790561 20530 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.865257 16707 catalog_manager.cc:5697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.912736 19791 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.854967 20623 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:58.924490 20627 raft_consensus.cc:3055] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:58.924556 20681 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:58.925034 20627 raft_consensus.cc:740] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:58.886868 20286 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.820729 20593 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.925884 20627 consensus_queue.cc:260] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.927469 20593 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:58.855998 20572 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.904260 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:58.835290 20669 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:58.908869 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 88700.2us
I20260709 13:19:58.936262 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:58.941358 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:58.942595 16955 raft_consensus.cc:1240] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: []
I20260709 13:19:58.808957 20680 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:58.868167 20694 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.905246 20656 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:58.895547 16808 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:19:58.921780 16707 catalog_manager.cc:5697] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 7, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.947467 16957 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:58.925226 20681 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:58.928637 16881 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:58.888707 20690 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.930317 16773 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:58.932538 17519 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:19:58.986362 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 56151.3us
I20260709 13:19:58.987753 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:58.988260 16808 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:19:58.980742 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 44577.8us
I20260709 13:19:58.902894 20543 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.984326 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:58.952036 16707 catalog_manager.cc:5697] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 8 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:58.989490 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.990592 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:58.991170 16805 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 6.
I20260709 13:19:58.888604 20668 raft_consensus.cc:697] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:58.993674 16954 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:58.994140 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 188120us
W20260709 13:19:58.994604 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.998569 16953 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:59.000222 16956 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:58.911900 20658 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.911971 20568 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:59.002620 16876 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:19:58.928335 20530 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:19:59.016052 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:58.930539 20572 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.016464 20543 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.017319 16707 catalog_manager.cc:5697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 7, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.019032 16803 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:58.984117 19978 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.908859 20386 raft_consensus.cc:740] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:58.990069 16807 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:19:59.039934 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:19:59.050282 16808 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:58.997507 20593 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:58.996197 20690 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:58.992825 20394 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:19:58.978911 20571 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:58.978538 20694 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:59.043335 20568 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.053630 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.062646 19791 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:19:59.063084 19791 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.063453 19791 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:59.062722 16707 catalog_manager.cc:5697] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 7, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 7 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:59.058387 19978 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.072005 16707 catalog_manager.cc:5697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 7 to 10, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 10 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:59.074319 16707 catalog_manager.cc:5697] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:59.057319 20437 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:59.103585 16952 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:59.113320 16707 catalog_manager.cc:5697] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:59.118471 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.065012 20593 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:59.043471 20658 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.126811 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:59.127395 16879 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:59.134421 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:59.135107 16882 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:59.124332 20640 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:59.138197 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 115941us
W20260709 13:19:59.139503 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 118081us
I20260709 13:19:59.052614 20656 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.122284 20437 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:59.158847 16882 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:59.172374 16879 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:59.165313 16775 leader_election.cc:400] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:19:59.176331 16775 leader_election.cc:403] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:19:59.120786 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 334899us
I20260709 13:19:59.124639 20668 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.175113 19791 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.115664 16707 catalog_manager.cc:5697] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 5, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 5 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:59.190346 17492 leader_election.cc:400] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8.
W20260709 13:19:59.194187 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.138949 20386 consensus_queue.cc:260] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.193578 17492 leader_election.cc:403] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:19:59.205277 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.194516 16707 catalog_manager.cc:5697] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 2 to 6, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 6 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:19:59.218479 16707 catalog_manager.cc:5697] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.220345 19791 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:59.230441 16881 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:59.239223 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:59.249670 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:59.250327 17527 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:59.252604 20683 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:19:59.253907 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:59.254635 20671 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:59.256096 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:59.256841 20671 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:59.257926 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:59.258607 20671 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:59.259748 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:59.260957 17492 leader_election.cc:400] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 7 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8.
I20260709 13:19:59.261863 20671 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:59.262197 20671 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:19:59.262287 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:59.262585 20671 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:59.264896 20571 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:59.269745 20671 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.270648 20492 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:59.272717 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:59.275532 20671 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:59.275413 20695 consensus_queue.cc:1059] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:59.276132 20671 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:59.280943 16922 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:59.285862 20475 raft_consensus.cc:3055] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:59.286403 20475 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:59.291046 20624 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:59.291572 20624 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:59.294131 20624 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.296458 20624 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:59.300266 20696 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.281s	user 0.004s	sys 0.000s
I20260709 13:19:59.287442 20475 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.305742 20475 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:59.306948 20680 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.307484 20680 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.308918 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:59.309649 17521 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:59.310256 20680 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:59.323566 20679 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.324157 20679 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.326344 20679 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:19:59.236160 20698 log.cc:927] Time spent T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.185s	user 0.001s	sys 0.001s
I20260709 13:19:59.330706 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:59.331041 17518 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:19:59.340749 17518 pending_rounds.cc:85] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 7
I20260709 13:19:59.341053 17518 pending_rounds.cc:107] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:19:59.341310 17518 raft_consensus.cc:2889] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:59.331182 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:59.336274 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:59.332897 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:59.226485 20673 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8.
I20260709 13:19:59.347625 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:59.348664 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:59.237486 19978 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:59.354988 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:19:59.350804 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.350975 16805 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:19:59.351804 17526 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:59.367621 17519 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:59.355659 17522 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.327668 20681 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:59.193470 20713 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.163s
I20260709 13:19:59.373999 16806 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:19:59.382398 20656 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.370146 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:59.383706 16810 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:59.394104 20658 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:59.187498 20593 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.367908 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:59.407703 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 264412us
I20260709 13:19:59.343956 20543 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:59.353566 20581 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:59.353389 20386 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:59.415583 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:59.418119 16951 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:19:59.408684 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:19:59.414113 20616 consensus_meta.cc:287] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.002s
W20260709 13:19:59.375357 20700 log.cc:927] Time spent T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
W20260709 13:19:59.433929 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.435050 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:59.445350 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:59.447865 17524 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:59.422168 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:59.448786 16805 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:59.404470 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.223412 20437 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:19:59.450131 19978 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:19:59.450047 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 45661.3us
I20260709 13:19:59.450765 19978 raft_consensus.cc:697] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:19:59.453619 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 44981.4us
I20260709 13:19:59.453856 17522 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:59.453737 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:59.455060 16810 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:59.457304 16805 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:19:59.419852 20658 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:59.423578 20640 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:59.373953 20654 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:19:59.469790 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:59.473322 20394 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:59.474174 20394 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:59.474483 20394 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:59.476071 16803 raft_consensus.cc:2368] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11.
I20260709 13:19:59.475239 20394 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.451548 19978 consensus_queue.cc:237] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.486812 20394 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:59.485276 20701 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
W20260709 13:19:59.483037 20660 consensus_meta.cc:287] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.724s	user 0.002s	sys 0.009s
I20260709 13:19:59.499811 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:59.500227 20660 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.480115 20640 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.501458 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:59.501695 20722 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:59.502255 20660 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:59.502207 20722 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.502671 20640 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:59.502863 20317 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:59.503269 20317 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:59.503607 20317 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.507272 16803 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:59.508795 16809 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:59.510288 20627 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:59.512656 20715 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:59.513804 16775 leader_election.cc:400] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:19:59.466987 20658 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.467917 20704 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:59.521361 20704 raft_consensus.cc:697] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:59.489858 20702 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
W20260709 13:19:59.488890 20706 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:59.515334 16775 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:59.518989 20530 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.520280 16806 raft_consensus.cc:1240] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:19:59.520478 20625 consensus_meta.cc:287] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.000s
I20260709 13:19:59.485839 20595 consensus_queue.cc:1059] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:19:59.538765 16848 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:59.542016 16805 raft_consensus.cc:1240] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:19:59.544569 16801 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:59.453766 16924 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.506009 20572 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.549315 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:59.529930 20658 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.549971 16848 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:59.552548 16807 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:59.540637 20624 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:59.551663 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:59.555083 19905 consensus_queue.cc:1059] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:19:59.552650 16952 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
W20260709 13:19:59.559171 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:59.548164 20684 consensus_meta.cc:287] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.835s	user 0.002s	sys 0.008s
I20260709 13:19:59.453083 20694 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.542815 20640 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.575145 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.565111 17521 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:19:59.566985 16848 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:19:59.546634 20492 raft_consensus.cc:3055] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:59.545188 20660 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:19:59.550661 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 98472.4us
I20260709 13:19:59.578951 19905 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:59.579761 17523 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:59.580586 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:59.581036 19905 raft_consensus.cc:697] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:59.552776 20654 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:59.585158 16880 raft_consensus.cc:3055] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:19:59.586313 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:59.586603 16806 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:19:59.587327 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:59.588096 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 307220us
I20260709 13:19:59.543159 20625 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.588775 16850 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:59.577412 20492 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:19:59.585552 16880 raft_consensus.cc:740] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:59.590544 17520 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:19:59.591221 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:59.593637 20719 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:19:59.595086 20723 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:19:59.565464 20286 consensus_queue.cc:1059] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:19:59.589735 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:59.597581 16809 raft_consensus.cc:1275] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:59.591831 16810 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:19:59.575881 20624 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:19:59.579873 20679 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:59.596074 20707 raft_consensus.cc:3055] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:59.603839 20679 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.604044 20707 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:59.604305 20679 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:59.604364 20722 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:59.605186 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:59.605808 16956 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:19:59.600930 17492 leader_election.cc:400] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11.
I20260709 13:19:59.607172 17492 leader_election.cc:403] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:59.608093 16880 consensus_queue.cc:260] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.608590 20616 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:59.609047 16880 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:19:59.613250 20424 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.613842 20625 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:59.613793 20424 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.616950 20317 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.616667 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:19:59.600237 20721 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:59.619053 20317 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:59.619429 20673 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:59.601347 16804 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:59.621876 16881 raft_consensus.cc:3055] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:59.622339 16881 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:59.622816 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.522296 20704 consensus_queue.cc:237] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.580178 20640 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.631234 20424 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:59.632012 20717 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:19:59.601835 16952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:59.588155 20437 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:59.628612 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:59.636322 16882 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.630216 20716 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:59.630698 20710 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:59.633443 16952 raft_consensus.cc:606] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:59.628968 19905 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.623920 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.634279 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:59.644009 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.644999 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:59.647051 16877 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:59.603600 20654 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:59.619469 20721 raft_consensus.cc:697] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:59.632479 20640 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:59.649686 20710 raft_consensus.cc:697] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:59.648193 20437 raft_consensus.cc:697] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:59.651511 20572 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:59.650050 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.653106 19791 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:59.653136 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.653975 19791 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.654496 19791 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.653097 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:59.655432 17527 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:19:59.644377 16881 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.659125 16881 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:59.650261 20568 consensus_meta.cc:287] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 13:19:59.665053 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.642267 20424 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.672253 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:19:59.684662 17527 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:59.650422 16850 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:19:59.648272 20717 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:59.675156 19791 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.672915 20710 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.658123 20719 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:59.687160 16882 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:19:59.651798 20492 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:19:59.678278 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.698256 17527 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:19:59.697525 16881 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:59.691362 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.712314 19791 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:59.648545 20716 raft_consensus.cc:697] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:59.651957 20711 consensus_queue.cc:1059] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 13:19:59.710868 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.713423 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:59.673586 20572 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:59.716274 16876 raft_consensus.cc:1275] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:19:59.719609 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:59.720374 16881 raft_consensus.cc:2376] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10. Re-sending same reply.
I20260709 13:19:59.722820 16882 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:19:59.724062 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:59.724658 16881 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:19:59.725647 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:59.725963 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:59.726544 16882 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
W20260709 13:19:59.698403 20690 consensus_meta.cc:287] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.626s	user 0.006s	sys 0.004s
I20260709 13:19:59.656415 20581 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:19:59.735402 16952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:59.738214 16952 raft_consensus.cc:606] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:59.738821 16952 raft_consensus.cc:614] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:59.709113 20475 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.711076 20653 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:19:59.728550 20286 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:19:59.739540 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:59.746973 16883 raft_consensus.cc:2368] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11.
I20260709 13:19:59.729188 20543 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:19:59.745061 20727 log.cc:927] Time spent T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:19:59.730329 20717 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:59.691128 20568 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.728787 20572 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.717124 20719 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:59.698854 20424 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.710942 20640 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:19:59.764024 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:59.767473 16881 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:59.728653 20437 consensus_queue.cc:237] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.770943 20724 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.751961 20572 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:59.773675 16952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:19:59.775727 20726 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:59.760680 20543 raft_consensus.cc:697] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:19:59.741971 20653 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.777697 20653 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.777438 20543 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.780154 20658 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.781087 20568 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:59.777478 20424 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:59.782114 20658 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:19:59.784565 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.786499 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:59.786813 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.787046 16877 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.789502 17526 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:19:59.716030 20624 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.738718 20690 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.794412 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:59.795447 20690 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:59.795508 20684 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:59.796649 16808 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:19:59.801112 16953 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:59.803272 16950 raft_consensus.cc:1240] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:59.797047 16773 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:19:59.804172 17526 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:59.806180 16953 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:19:59.805088 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:59.826172 16880 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:19:59.749341 20475 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.828588 16883 raft_consensus.cc:1240] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:59.785123 20530 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:59.837525 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:19:59.837900 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:59.829108 16956 raft_consensus.cc:1240] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 5. Current term is 6. Ops: []
I20260709 13:19:59.807272 17526 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:19:59.839846 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 127229us
I20260709 13:19:59.843003 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:59.843959 16956 raft_consensus.cc:2368] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10.
I20260709 13:19:59.836316 20719 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.836946 20475 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:59.771420 20724 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.788630 20726 raft_consensus.cc:697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:19:59.795460 20394 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.837292 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:19:59.888518 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:59.892930 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:19:59.832477 20669 consensus_meta.cc:287] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.854s	user 0.011s	sys 0.000s
W20260709 13:19:59.885564 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 44622.7us
I20260709 13:19:59.802989 20673 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:59.890631 16950 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:19:59.895821 16953 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:59.898630 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:59.899202 16805 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:19:59.899392 16802 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:19:59.901089 16804 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:59.832788 20694 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:59.903650 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:59.888136 20714 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:59.905045 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:59.905210 20714 raft_consensus.cc:697] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:19:59.905974 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 53111.2us
I20260709 13:19:59.906061 20707 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.761150 20721 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.892349 20667 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:19:59.741338 20654 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.911643 20667 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.913734 20667 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:19:59.797567 20716 consensus_queue.cc:237] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.914919 20717 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:19:59.894025 20729 log.cc:927] Time spent T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:19:59.926163 16950 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 12: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:59.806181 20679 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.884840 20626 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:19:59.918123 16951 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:19:59.930882 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:19:59.931557 16950 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:19:59.932140 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:59.918020 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:19:59.934818 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:59.935529 16804 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.939309 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:59.939862 16809 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.940049 16877 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:19:59.893762 20424 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.941536 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:59.941466 20424 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.942306 16957 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:19:59.943058 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:59.900755 20669 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:59.898116 20394 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:19:59.925777 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:19:59.900563 20673 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.943835 16801 raft_consensus.cc:2410] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:19:59.948148 16802 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.949618 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:19:59.954238 16806 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:59.907497 20707 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.959287 16951 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:19:59.965670 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:59.966116 17492 leader_election.cc:400] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11.
I20260709 13:19:59.966415 16881 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:59.903014 20530 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:59.975282 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:19:59.964887 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:59.979324 16809 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:19:59.968665 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:19:59.949806 20673 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:59.943656 20424 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:19:59.949296 20394 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:19:59.950467 20656 raft_consensus.cc:3055] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:59.992194 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:00.005065 16881 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:59.993152 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:59.969436 16955 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:19:59.996917 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:59.997767 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:19:59.971879 20669 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:00.007085 16878 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:20:00.012221 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.041579 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:00.042094 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.013314 16804 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:00.002931 17522 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:00.042923 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:00.042590 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:19:59.971233 17525 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:00.048520 16806 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:19:59.957244 20684 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:19:59.947752 20658 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:20:00.049587 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:00.057979 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:00.058238 16876 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:00.054698 16802 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:19:59.944327 20668 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:20:00.058599 16879 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:19:59.949318 20626 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.040782 20656 raft_consensus.cc:740] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:20:00.073974 16922 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.720s (SENT) [suppressed 29 similar messages]
I20260709 13:19:59.949663 20726 consensus_queue.cc:237] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:19:59.906069 20714 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.049328 20704 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.058099 20589 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:00.107513 16881 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:00.152923 20656 consensus_queue.cc:260] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.154024 20656 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:00.156901 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:00.161324 16881 raft_consensus.cc:3055] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:00.161788 16881 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:00.162563 16881 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.169492 16881 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:00.090996 20653 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.189230 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:00.165946 20700 log.cc:927] Time spent T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:20:00.172255 20735 log.cc:927] Time spent T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:20:00.172439 20720 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:20:00.173175 20734 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:20:00.197513 16881 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:20:00.156258 20589 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:00.210336 16952 raft_consensus.cc:606] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:00.210826 16952 raft_consensus.cc:614] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:00.116791 20704 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.152998 20724 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:00.206101 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:00.212143 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 245180us
W20260709 13:20:00.213706 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.207067 16881 pending_rounds.cc:85] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 7
I20260709 13:20:00.186475 20654 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:00.214339 16881 pending_rounds.cc:107] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 11.8
W20260709 13:20:00.220930 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 146973us
I20260709 13:20:00.216763 16881 raft_consensus.cc:2917] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Aborting config change with OpId 11.8: Aborted: Op aborted by new leader
I20260709 13:20:00.229866 16881 raft_consensus.cc:2889] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:00.204337 20748 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.193301 20737 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:20:00.231721 16922 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:00.214727 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:00.190646 20667 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:20:00.239315 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:00.240926 17522 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEARNER]: Advancing to term 12
I20260709 13:20:00.194880 19978 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:20:00.194334 20738 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 13:20:00.216470 20743 log.cc:927] Time spent T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:20:00.254465 20572 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.264127 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:00.265062 16953 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:20:00.266819 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.267524 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:00.238243 20748 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.268137 20748 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.269058 20653 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:00.271211 20589 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.236886 20623 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.272332 20623 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:00.245442 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 44838.9us
I20260709 13:20:00.258844 20704 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:00.297147 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 64663.4us
I20260709 13:20:00.297303 20532 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:00.231365 20679 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:00.298393 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.216517 20654 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:00.304672 20654 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.278965 20623 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:00.280643 20744 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:20:00.282119 20572 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:00.283825 20616 consensus_meta.cc:287] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.001s
I20260709 13:20:00.364909 16773 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:00.366487 16773 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:00.286552 20739 log.cc:927] Time spent T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 13:20:00.286598 17522 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:00.288336 17525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44648 (request call id 584) took 1047 ms. Trace:
I20260709 13:20:00.288511 17518 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:00.288970 20530 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:00.289098 20711 raft_consensus.cc:3055] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:20:00.290931 20696 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:20:00.291297 20684 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.294588 20626 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:00.295182 20733 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
W20260709 13:20:00.312235 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.374322 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:00.335458 20734 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:20:00.313369 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 591) took 1067 ms. Trace:
I20260709 13:20:00.328272 16876 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
W20260709 13:20:00.330245 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 62800us
W20260709 13:20:00.331064 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 55598.2us
I20260709 13:20:00.330205 20668 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:00.312335 17519 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
W20260709 13:20:00.376509 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 144877us
I20260709 13:20:00.379302 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:00.368940 17525 rpcz_store.cc:276] 0709 13:19:59.241164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.241273 (+   109us) service_pool.cc:224] Handling call
0709 13:20:00.288159 (+1046886us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54005befd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:00.288281 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388338560}
I20260709 13:20:00.382974 16922 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
W20260709 13:20:00.369946 20747 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:20:00.243697 20571 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 13:20:00.330787 20694 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.380461 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:00.380801 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 587) took 1138 ms. Trace:
I20260709 13:20:00.381548 16806 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:00.334941 20721 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:20:00.336638 20653 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:00.371964 20704 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:00.395105 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:00.407027 16850 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:00.377715 17527 rpcz_store.cc:276] 0709 13:19:59.245554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.732693 (+487139us) service_pool.cc:224] Handling call
0709 13:19:59.733026 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.733445 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.733480 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.748528 (+ 15048us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.958265 (+209737us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:59.958301 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.958367 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.313138 (+354771us) raft_consensus.cc:1685] finished
0709 13:20:00.313164 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.313303 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1375,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":1672,"thread_start_us":169375,"threads_started":1,"wal-append.queue_time_us":284982}
I20260709 13:20:00.372393 20679 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.372465 20616 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11.
I20260709 13:20:00.398689 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:00.420601 16809 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:00.400215 16801 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:20:00.396068 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:00.403641 16922 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:00.400431 17521 rpcz_store.cc:276] 0709 13:19:59.242685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.582736 (+340051us) service_pool.cc:224] Handling call
0709 13:19:59.583129 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.583460 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.583486 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.583924 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:19:59.838296 (+254372us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:19:59.838330 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:59.838389 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.380619 (+542230us) raft_consensus.cc:1685] finished
0709 13:20:00.380637 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.380752 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":9272,"thread_start_us":195407,"threads_started":1,"wal-append.queue_time_us":672660}
I20260709 13:20:00.376407 20394 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:00.378521 20685 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.372009 20711 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:00.411924 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:00.427278 16876 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:20:00.411763 20543 raft_consensus.cc:993] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:00.406427 20658 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:00.424114 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:00.430483 16922 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:00.418569 20673 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.432329 16850 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:00.395470 20762 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.439996 16809 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:00.378974 20684 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.436812 16806 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.436924 17521 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:20:00.428797 20750 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:20:00.407980 20668 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:00.385007 20667 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:20:00.423045 19978 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:00.425772 19791 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.451879 20721 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:00.437950 20726 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:00.445158 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:00.458657 16876 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:00.404212 20626 consensus_queue.cc:1059] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:20:00.447943 19905 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:20:00.408818 20694 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.454650 19791 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.456627 16922 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:00.424182 20679 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.442998 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:00.468196 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.465612 16808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1786) took 1110 ms. Trace:
I20260709 13:20:00.468238 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:00.438256 20653 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:00.445873 20704 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.434160 20685 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.472954 16809 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:20:00.471958 16808 rpcz_store.cc:276] 0709 13:19:59.347462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.348252 (+   790us) service_pool.cc:224] Handling call
0709 13:19:59.348636 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.797007 (+448371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.457766 (+660759us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54000d84d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:00.457964 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029785984}
I20260709 13:20:00.477591 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:00.452188 20770 raft_consensus.cc:1081] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:00.479090 16922 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:00.478147 19905 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.493494 19791 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:00.456862 20658 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:00.489794 19905 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.476585 20571 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:00.491164 20623 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:00.471392 19978 raft_consensus.cc:697] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:00.445019 20762 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.478602 20718 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:00.523020 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:00.523523 19905 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:00.478684 20660 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:00.495817 16810 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:00.478477 20532 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:00.514000 20286 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:00.494967 20653 raft_consensus.cc:697] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:00.524190 20707 consensus_meta.cc:287] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.003s
I20260709 13:20:00.539017 20654 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:00.524654 20572 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:20:00.543231 20708 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.543375 20653 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.521920 20593 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:00.525111 20571 raft_consensus.cc:697] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:00.521588 20737 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:20:00.521152 20623 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.517791 20726 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:20:00.596001 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 78021.6us
I20260709 13:20:00.536052 20626 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:00.520468 20710 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:20:00.489135 20704 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.476933 20711 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:00.620430 20763 log.cc:927] Time spent T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:20:00.603849 20658 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.535178 20718 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.623124 20718 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:00.556954 20593 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:00.613566 20707 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:00.628715 20593 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:00.629124 20765 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:20:00.628955 20707 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:00.630571 20760 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:20:00.632104 20707 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:00.615689 20771 log.cc:927] Time spent T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:20:00.525393 20668 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:00.616529 20757 log.cc:927] Time spent T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:20:00.603530 20708 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.610486 20669 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:00.628288 20769 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:20:00.628568 20571 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.631649 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 1013) took 1164 ms. Trace:
I20260709 13:20:00.525923 20716 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:20:00.602746 20623 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:00.634649 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:00.635690 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:00.635950 17518 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 816) took 1056 ms. Trace:
I20260709 13:20:00.653815 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:00.657681 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 129792us
I20260709 13:20:00.659360 16950 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:00.663254 16955 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:00.664031 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:00.668790 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:00.659937 17524 rpcz_store.cc:276] 0709 13:19:59.467380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.891456 (+424076us) service_pool.cc:224] Handling call
0709 13:19:59.903747 (+ 12291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:59.904046 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:59.904076 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:59.951180 (+ 47104us) log.cc:844] Serialized 26 byte log entry
0709 13:20:00.382170 (+430990us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:00.382208 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.382270 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:00.631458 (+249188us) raft_consensus.cc:1685] finished
0709 13:20:00.631479 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:00.631594 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":397,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":391076,"threads_started":1,"wal-append.queue_time_us":474299}
W20260709 13:20:00.670238 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 152121us
I20260709 13:20:00.662263 17518 rpcz_store.cc:276] 0709 13:19:59.579543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.912185 (+332642us) service_pool.cc:224] Handling call
0709 13:20:00.288307 (+376122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:00.369049 (+ 80742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:00.635774 (+266725us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54005befd0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:00.635897 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":864064768}
I20260709 13:20:00.671429 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:00.672721 16957 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:00.672845 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:00.679980 16954 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:00.681015 20718 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:00.684595 20694 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:00.685303 20679 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:00.687884 20684 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:00.676210 20543 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:00.689960 20762 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:00.690876 16950 raft_consensus.cc:1240] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:20:00.614959 20626 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.691993 16806 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
W20260709 13:20:00.693714 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.699287 16955 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:20:00.783288 16955 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:20:00.783488 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:00.786347 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:00.696242 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:00.787225 16951 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:00.788981 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:00.789806 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:00.789772 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 114849us
I20260709 13:20:00.798538 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:00.690793 20707 raft_consensus.cc:2764] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:00.799569 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:00.804188 16878 raft_consensus.cc:2393] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:00.800555 16884 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:00.801069 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:00.804842 16885 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:00.623974 19978 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.802485 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:00.808342 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:00.808887 16877 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:00.809517 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:00.801508 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:00.806401 16878 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:00.812252 20626 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:00.813059 20738 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:00.815529 20708 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:00.670222 20669 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.815837 20673 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:00.781471 20317 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:20:00.817521 16876 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:00.817683 20669 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:00.823979 20660 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:00.825243 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:00.829418 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.832707 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:00.841023 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.818630 20685 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:00.851586 16850 leader_election.cc:400] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10.
I20260709 13:20:00.852830 16850 leader_election.cc:403] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:20:00.799114 20654 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:20:00.842514 20767 log.cc:927] Time spent T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:20:00.860666 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:00.849342 20748 consensus_meta.cc:287] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.000s
I20260709 13:20:00.835644 20710 consensus_queue.cc:1059] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:20:00.871556 20778 log.cc:927] Time spent T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:00.861960 20532 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10.
I20260709 13:20:00.850915 20726 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:20:00.871466 20623 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:00.892935 20660 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:00.879487 20748 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.918041 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:00.899317 20543 raft_consensus.cc:697] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:00.912066 20775 log.cc:927] Time spent T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:20:00.910271 20783 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:20:00.918881 16807 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.906016 20718 raft_consensus.cc:3055] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:00.920794 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:00.921530 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:00.923380 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 62793.2us
I20260709 13:20:00.924497 16951 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:20:00.925372 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:00.926121 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:00.937074 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:00.939366 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:00.941155 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:00.942318 16958 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:00.942782 17524 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:20:00.960812 17526 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:20:00.927459 20625 raft_consensus.cc:3055] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:00.975054 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:00.975736 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:00.962924 17524 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:20:00.981700 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:00.982375 16882 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:20:00.960829 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:00.961925 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:00.962532 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:00.982463 17524 pending_rounds.cc:85] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 6
I20260709 13:20:00.923969 20718 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:00.984536 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:00.981909 16877 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:00.983577 16955 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:20:00.979709 16807 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:00.926924 20704 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:00.993055 16951 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:20:00.983523 17524 pending_rounds.cc:107] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:20:00.987409 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:00.988610 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:00.994297 17524 raft_consensus.cc:2889] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:00.994843 17526 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:00.995573 17521 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:00.999538 16877 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:01.003691 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:01.005115 17524 raft_consensus.cc:2376] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10. Re-sending same reply.
W20260709 13:20:01.008435 20786 log.cc:927] Time spent T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:20:00.989733 20673 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.010878 20532 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.011448 20532 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.012423 20593 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.013721 16959 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:01.013798 20532 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.015177 20593 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:00.932392 20543 consensus_queue.cc:237] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:00.981719 20625 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:01.019038 20625 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.020236 20625 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:00.956140 20717 consensus_queue.cc:1059] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:20:01.021095 20717 consensus_queue.cc:1243] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:01.021781 20798 raft_consensus.cc:3055] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:01.022148 20798 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:01.022997 20798 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.024238 20798 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:01.025604 20623 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:01.027186 20748 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:01.028960 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:01.030792 20718 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.032090 20718 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:00.956820 20794 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.042829 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:00.971203 20716 consensus_queue.cc:1059] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:20:01.043999 17526 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:01.008301 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:01.048750 16958 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:20:01.052198 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 252595us
I20260709 13:20:01.061725 16953 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:01.064810 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:01.053014 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:01.067437 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:01.071702 17524 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:01.046303 20685 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.047183 20748 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.076808 19791 consensus_queue.cc:1059] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:01.077769 19791 raft_consensus.cc:3055] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:01.078163 19791 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:01.052215 20704 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:01.058061 20714 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.083958 16958 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:01.035560 20794 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.080247 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:01.086360 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:01.087179 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:01.079085 19791 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.090273 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:01.089363 19791 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.092445 16877 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:01.094319 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:01.094813 16877 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:20:01.095185 16877 pending_rounds.cc:85] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 3
I20260709 13:20:01.071719 19978 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:01.095433 16877 pending_rounds.cc:107] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:20:01.142539 16877 raft_consensus.cc:2889] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:01.143743 20785 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.144308 20785 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.147529 17520 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:20:01.071544 20530 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:20:01.127547 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:01.119807 16807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:20:01.119136 16952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50296 (request call id 27) took 1324 ms. Trace:
I20260709 13:20:01.096926 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:01.095911 17527 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 11: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:01.085248 20748 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.149652 16884 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:01.325875 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:01.157617 16952 rpcz_store.cc:276] 0709 13:19:59.773387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:59.773551 (+   164us) service_pool.cc:224] Handling call
0709 13:20:01.097452 (+1323901us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b540032afd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef090853 00007feef405e60a 00007feeed5e47d4 00007feeed5e4762 00007feeed5e4691 00007feeed5e460c 00007feeed5e38c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:01.097576 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002731904}
I20260709 13:20:01.084841 20581 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:01.338563 16876 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:01.329845 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.210700 16804 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:20:01.095266 16882 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 11: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:01.235502 16803 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:01.166827 16956 raft_consensus.cc:1240] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:20:01.077064 20595 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.112958 16958 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:20:01.339875 16807 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:20:01.175694 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.162134 16808 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:20:01.320791 20805 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:01.344071 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:20:01.320588 20806 log.cc:927] Time spent T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:20:01.219143 20799 log.cc:927] Time spent T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:20:01.315963 20797 log.cc:927] Time spent T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:20:01.151376 16885 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:01.141427 20801 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.100015 20543 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:01.346086 16807 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.345664 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:01.087538 20704 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.342504 20581 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.348178 16804 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 11: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:01.352782 16876 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:01.357549 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:01.113343 20317 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:01.083768 20685 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:01.349594 20740 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:20:01.369215 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:01.349958 20286 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:20:01.370236 20532 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.351253 20595 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.380491 16804 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:20:01.417930 16804 pending_rounds.cc:85] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 7
I20260709 13:20:01.418304 16804 pending_rounds.cc:107] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:20:01.418686 16804 raft_consensus.cc:2889] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:01.353615 20719 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.343865 20717 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:20:01.373384 20581 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:01.096134 20714 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:01.422992 16807 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.376289 20694 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:01.441448 20492 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.375319 20801 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.449728 20801 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:01.418138 20532 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.452289 20532 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:01.453364 16802 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:01.454350 20714 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.430856 20719 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.387399 20317 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.457934 20669 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.458333 20317 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.458835 20773 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:01.458618 20669 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.460155 17523 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:01.461048 20685 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:01.461488 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 312140us
W20260709 13:20:01.464252 20804 log.cc:927] Time spent T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:20:01.464932 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 1811) took 1086 ms. Trace:
I20260709 13:20:01.465277 16810 rpcz_store.cc:276] 0709 13:20:00.378088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.380224 (+  2136us) service_pool.cc:224] Handling call
0709 13:20:01.464760 (+1084536us) spinlock_profiling.cc:243] Waited 95.4 ms on lock 0x7b540011a3d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:01.464856 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219507456}
I20260709 13:20:01.466087 20704 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.467514 20748 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:01.393611 20762 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:01.468174 20762 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.468501 20762 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.475582 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:01.476224 16959 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:01.476914 19978 raft_consensus.cc:697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:01.478404 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.478084 19978 consensus_queue.cc:237] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.481240 20543 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:01.481861 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:01.482118 20543 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.482900 20794 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.459218 20773 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:01.483930 20788 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.484463 20788 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.484568 20773 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.485946 20773 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:01.486363 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.486373 20788 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:01.496483 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44648 (request call id 597) took 1257 ms. Trace:
I20260709 13:20:01.496869 17523 rpcz_store.cc:276] 0709 13:20:00.238848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:00.239104 (+   256us) service_pool.cc:224] Handling call
0709 13:20:01.496282 (+1257178us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400235ad4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:01.496397 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2805557504}
I20260709 13:20:01.497781 19905 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:01.498399 19905 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.500782 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:01.501451 16953 raft_consensus.cc:606] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:01.501799 16953 raft_consensus.cc:614] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:01.505007 16953 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:20:01.471139 20581 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.508328 16807 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.512816 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:01.515712 16850 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:01.518855 16955 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:20:01.525635 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 140959us
I20260709 13:20:01.508337 20704 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.537930 19905 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:01.538198 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.545481 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:01.548758 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:01.546103 17523 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:01.555037 16955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:01.523895 20317 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.555649 17519 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:20:01.556135 16850 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:01.555614 16955 raft_consensus.cc:606] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:01.556813 16955 raft_consensus.cc:614] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:01.555001 19905 consensus_queue.cc:1059] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:20:01.526619 20798 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:01.526538 20286 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:01.559134 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:01.558748 19905 consensus_queue.cc:1059] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:01.559654 20798 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.563632 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:01.524334 20718 consensus_queue.cc:1059] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:20:01.567942 19905 raft_consensus.cc:3055] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:01.526381 20656 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:20:01.568933 19905 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:01.528383 20708 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:20:01.572340 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:01.541312 20421 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:20:01.578926 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:01.565120 20616 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:01.566010 20798 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:01.557358 20717 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:20:01.569983 20286 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:01.579646 19905 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.598106 19905 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:01.557621 20704 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.561656 20317 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.605798 20714 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:01.613171 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 150807us
I20260709 13:20:01.603081 20286 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.604789 20718 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:01.604683 20616 raft_consensus.cc:697] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:01.631214 19791 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:20:01.640100 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 67814.9us
W20260709 13:20:01.640518 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 84449us
I20260709 13:20:01.633558 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:01.614516 20673 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.648667 16879 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:01.646145 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:01.626721 20286 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:01.652688 16877 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:01.626883 20718 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:01.656325 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:01.659876 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:01.613436 20714 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.640928 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:01.662693 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:01.697655 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 56817.4us
I20260709 13:20:01.664549 16876 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:01.666605 16884 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:01.628578 20534 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:20:01.653282 20653 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:01.697683 16885 raft_consensus.cc:2410] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:01.634855 20748 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:20:01.643826 20593 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:20:01.706897 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:01.652747 20708 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:20:01.680666 20694 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:01.680277 20581 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:01.716241 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 67618.1us
I20260709 13:20:01.700672 20595 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.706043 20673 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:20:01.740474 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.700778 20717 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:20:01.665736 20718 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.751293 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:01.701548 20817 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:20:01.740751 20708 consensus_queue.cc:1243] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:01.742477 20653 raft_consensus.cc:697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:01.792774 20653 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.741976 20475 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.795979 20475 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.798182 20685 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.798343 20708 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.798688 20685 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:01.798959 20708 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.800698 20685 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.800616 20762 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.715482 20421 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:20:01.798377 20475 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.741250 20822 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:20:01.805291 20762 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:01.749795 20581 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:20:01.745169 20673 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:01.807080 20673 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.808583 17519 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:01.754710 20820 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:20:01.812134 16951 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:20:01.759117 20704 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.744300 20623 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:01.773994 20718 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:01.715327 20616 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.818755 20711 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:01.774844 20424 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:01.775753 20812 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.319s	user 0.004s	sys 0.000s
W20260709 13:20:01.776584 20815 log.cc:927] Time spent T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:20:01.748108 20658 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:20:01.776358 20317 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.782469 16807 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:01.780786 20714 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:01.786624 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:01.832567 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 71525.4us
W20260709 13:20:01.833186 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.834558 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:01.835152 16807 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.801117 20708 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:01.835956 20737 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:01.838837 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:01.835393 20770 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:20:01.839740 16950 raft_consensus.cc:2410] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:20:01.801908 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:01.840561 17524 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:20:01.841460 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:01.846755 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:01.847494 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.790114 20719 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.850618 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:01.851202 16808 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:20:01.852003 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:01.852618 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:01.853168 17524 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:20:01.859772 16807 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:20:01.862726 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:01.863135 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:01.862386 16809 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:20:01.863960 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:01.864850 16807 raft_consensus.cc:1240] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:20:01.866801 16809 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:20:01.867048 16807 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:01.868873 16802 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:20:01.870003 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:01.870724 16802 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:01.872028 16802 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:01.874044 16806 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:01.875358 16805 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:20:01.875818 16805 pending_rounds.cc:85] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 6
I20260709 13:20:01.876072 16805 pending_rounds.cc:107] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:20:01.876348 16805 raft_consensus.cc:2889] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:01.878307 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:01.839498 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:01.881659 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:01.882596 16802 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:01.879154 16951 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:20:01.880849 16848 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:01.889111 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:01.886750 16807 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:20:01.885114 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:01.893260 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:01.894568 16807 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:20:01.917471 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:01.891884 16802 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:01.980859 16806 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:20:01.930135 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:01.915695 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 66072.4us
I20260709 13:20:02.057492 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:02.063113 16806 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:01.986974 20820 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:20:01.999177 20828 log.cc:927] Time spent T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:20:01.973727 20660 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:02.066334 20660 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.068982 20660 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:02.022251 20775 log.cc:927] Time spent T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 13:20:02.069763 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:01.961665 20788 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.109s
W20260709 13:20:01.977284 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 137966us
I20260709 13:20:02.136831 16957 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:20:02.137698 16922 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:02.071271 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:02.072595 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 191021us
I20260709 13:20:02.073338 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:02.073700 20832 raft_consensus.cc:476] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 13:20:02.075656 16808 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:02.076709 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:02.107786 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.140633 16878 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
W20260709 13:20:02.112977 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 51443.8us
I20260709 13:20:02.131119 19905 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:02.141782 19905 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.145732 19905 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:01.883595 20704 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:01.834597 20798 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.146937 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:02.147104 16878 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:02.060230 20530 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:01.927989 20794 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:01.972045 20681 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.048238 20822 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:01.912710 20714 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.003700 20726 raft_consensus.cc:3055] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:02.151291 19905 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.013965 20286 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:01.939587 20656 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:02.155046 16956 raft_consensus.cc:1240] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:20:02.083734 20685 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:02.141072 20721 raft_consensus.cc:3055] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:02.112041 20792 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:02.151346 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 78126.2us
I20260709 13:20:02.083534 20421 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:20:02.144568 20748 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:20:02.135936 20820 raft_consensus.cc:697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:02.159847 20726 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:02.201253 16922 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:02.161959 20794 raft_consensus.cc:697] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:02.176677 20656 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.174607 20817 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:02.156872 20704 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.211424 19905 consensus_queue.cc:1059] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:20:02.212399 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:02.215431 19791 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:02.172137 20721 raft_consensus.cc:740] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:02.236649 16956 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:02.171063 20831 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.246443 16922 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:02.160905 20681 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.165940 20714 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:02.210081 20834 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 13:20:02.250308 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.250805 19905 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.178263 20801 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:02.161796 20822 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.176266 20738 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:20:02.200260 20719 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.178859 20667 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:20:02.303779 19905 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.292299 16922 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:02.208804 20660 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.178481 20685 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:02.318986 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.312064 20623 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:02.267735 20785 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.234079 20593 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 13:20:02.311251 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 172072us
I20260709 13:20:02.316306 20719 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.211226 20717 consensus_queue.cc:1059] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:20:02.211814 20571 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 13:20:02.181548 20792 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:02.404747 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 193996us
I20260709 13:20:02.338295 19905 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.315857 20801 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.336100 20623 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:02.343600 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:02.344185 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 237481us
W20260709 13:20:02.344554 20840 log.cc:927] Time spent T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:20:02.511502 20843 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 13:20:02.513350 20838 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 13:20:02.514055 20286 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.514876 20719 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.516973 20704 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.316083 20653 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 13:20:02.348256 20785 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:02.520164 20785 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:02.520623 20785 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:02.520776 20822 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.524107 20798 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.411175 20721 consensus_queue.cc:260] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.527020 20721 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:02.344826 20794 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.536931 20656 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:02.537199 20718 consensus_meta.cc:287] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.721s	user 0.006s	sys 0.002s
I20260709 13:20:02.330338 20726 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:02.537984 20842 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:20:02.538388 20726 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.543744 20623 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:02.343351 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 51155.7us
W20260709 13:20:02.496387 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 153002us
I20260709 13:20:02.253919 20831 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.341123 20424 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:02.337996 20660 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.576802 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:20:02.509539 20839 log.cc:927] Time spent T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.290s	user 0.000s	sys 0.000s
W20260709 13:20:02.510159 20850 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:20:02.347558 20820 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.513274 20792 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.339233 20616 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:02.583335 20806 log.cc:927] Time spent T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.237s	user 0.000s	sys 0.006s
I20260709 13:20:02.576612 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:02.586115 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 1033) took 1098 ms. Trace:
I20260709 13:20:02.597841 17520 rpcz_store.cc:276] 0709 13:20:01.480731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.495889 (+ 15158us) service_pool.cc:224] Handling call
0709 13:20:01.496256 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:01.496680 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.496718 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:01.497240 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:20:01.717387 (+220147us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:01.717601 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:01.717765 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:02.410493 (+692728us) raft_consensus.cc:1685] finished
0709 13:20:02.579237 (+168744us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.579435 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9710,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3055,"thread_start_us":218727,"threads_started":1,"wal-append.queue_time_us":414811}
I20260709 13:20:02.579806 20827 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:02.578722 20844 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:02.584077 20286 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:02.587754 20762 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:02.592077 20845 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:02.631829 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.618783 20421 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:02.585520 20424 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:02.645743 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.649858 20421 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.654268 20831 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:02.654884 20831 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:02.655820 20846 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:02.656334 20846 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.658488 20846 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.655584 20717 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.655396 20831 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.655315 20421 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.661733 20831 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.659335 20717 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.615065 20718 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:02.622123 20711 consensus_meta.cc:287] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.803s	user 0.012s	sys 0.000s
I20260709 13:20:02.619347 20656 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.596390 20616 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.663604 20717 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.686506 20656 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.689926 20656 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.691154 20714 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.622078 20816 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.686507 16878 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:02.665071 20704 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.720492 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:02.651854 20708 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.677709 20718 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:02.619724 20286 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.614615 20827 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.623083 20762 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:02.716130 20673 consensus_meta.cc:287] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.889s	user 0.006s	sys 0.005s
W20260709 13:20:02.745054 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.694482 20714 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:02.776201 16804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.025s	sys 0.042s
W20260709 13:20:02.776644 16804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.025s	sys 0.042s
I20260709 13:20:02.728674 20718 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:02.727985 20711 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.677336 20845 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.738891 20685 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:02.789256 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 200842us
I20260709 13:20:02.730505 20681 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.802644 16806 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:20:02.802460 16810 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:20:02.777230 20714 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.740706 20708 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.813618 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:02.731144 20816 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.828473 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:02.829191 17520 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:20:02.825909 20656 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:02.831143 20857 log.cc:927] Time spent T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:20:02.831074 20656 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.832983 20762 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.833098 20656 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.834429 20286 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.836448 20852 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:02.837867 20852 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:02.837718 20718 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.839859 20718 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.840397 20669 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:02.844199 20861 log.cc:927] Time spent T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:20:02.772874 20673 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:02.845022 20858 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:20:02.845422 17524 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:20:02.846354 20673 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:02.847551 20841 log.cc:927] Time spent T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.225s	user 0.000s	sys 0.000s
I20260709 13:20:02.848476 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:02.849112 17520 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:02.812743 20685 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:02.850754 20685 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:02.851490 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:02.852281 20616 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.852706 20685 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:02.853267 20849 log.cc:927] Time spent T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:20:02.854877 20859 log.cc:927] Time spent T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:02.856305 20660 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:02.864372 20865 log.cc:927] Time spent T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:20:02.872442 20856 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:20:02.874266 20853 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:20:02.875039 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:02.875360 20694 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:02.876045 20694 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:02.877857 20708 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.801683 20801 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.879624 20845 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.880625 20827 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:02.883628 20860 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:20:02.889725 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1885) took 1048 ms. Trace:
I20260709 13:20:02.890071 16883 rpcz_store.cc:276] 0709 13:20:01.841338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.847401 (+  6063us) service_pool.cc:224] Handling call
0709 13:20:01.886496 (+ 39095us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:01.928516 (+ 42020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:01.928561 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:01.964480 (+ 35919us) log.cc:844] Serialized 52 byte log entry
0709 13:20:02.398509 (+434029us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:02.398550 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.398627 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:02.889539 (+490912us) raft_consensus.cc:1685] finished
0709 13:20:02.889558 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:02.889673 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41508,"raft.queue_time_us":42225,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":47328,"thread_start_us":379610,"threads_started":1,"wal-append.queue_time_us":769868}
I20260709 13:20:02.884400 20424 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.896561 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:02.897171 16809 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:02.898121 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:02.898847 16807 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:20:02.899772 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:02.900332 16804 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:20:02.898167 16954 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:20:02.912536 17524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 833) took 1058 ms. Trace:
I20260709 13:20:02.913080 17524 rpcz_store.cc:276] 0709 13:20:01.853940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.860311 (+  6371us) service_pool.cc:224] Handling call
0709 13:20:01.860592 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.845842 (+985250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:02.912230 (+ 66388us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b540026f7d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:02.912451 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264303360}
I20260709 13:20:02.919343 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:02.923508 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:02.844144 16881 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:20:02.924939 16881 pending_rounds.cc:85] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 6
I20260709 13:20:02.925244 16881 pending_rounds.cc:107] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:20:02.925535 16881 raft_consensus.cc:2889] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:02.920208 16879 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:20:02.733170 20704 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.927911 16810 raft_consensus.cc:2393] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:02.822463 20714 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:02.941130 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:02.797637 20854 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.133s
I20260709 13:20:02.942586 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:02.943733 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:02.944718 16876 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:02.945966 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:02.946779 16804 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:02.801327 20711 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.871492 20785 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:02.949286 20658 raft_consensus.cc:1064] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:20:02.956250 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:02.943965 20770 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:02.968103 20816 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:02.969151 20788 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.969635 20788 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:02.971568 20826 log.cc:927] Time spent T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.954s	user 0.010s	sys 0.014s
I20260709 13:20:02.971704 20788 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:02.974436 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:02.957594 20492 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:02.977355 17524 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:20:02.980180 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:02.966236 20773 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.980842 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:02.980873 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:02.981384 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:02.982968 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:02.983973 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:02.989974 16950 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:02.980403 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:02.985180 17523 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:02.975270 20827 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:02.985232 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:02.993551 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:02.998787 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.002863 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.002950 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:02.986759 20816 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:03.005167 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:03.003626 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 99385.6us
I20260709 13:20:03.009351 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:02.986865 20492 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.011616 20785 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:03.004053 20718 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.012971 20492 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:03.012753 20718 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.014829 20718 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:03.016971 20704 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:03.007019 20816 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:03.017823 20816 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:03.022830 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 209364us
I20260709 13:20:03.025125 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:03.026125 16950 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:03.027349 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.027832 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.007612 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:03.029788 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:03.036522 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.037621 20492 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:03.038053 20492 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.037998 20704 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.008566 20623 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.039805 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:03.040123 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:03.047035 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:03.083933 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:02.988960 20773 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.006709 20616 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:03.091555 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.091586 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:03.090667 16807 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:03.098513 16950 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:03.100782 16953 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:03.042722 20492 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:03.102671 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.099345 20673 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:03.103458 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.137678 16885 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:03.137794 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:03.135974 20721 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:03.103565 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 93864us
I20260709 13:20:03.138537 20721 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.104450 20817 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:03.104233 20437 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:03.102101 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:03.142853 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:03.109288 16773 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:03.109575 20854 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:03.111277 20762 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:03.089915 20708 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:03.146530 16773 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:03.093976 20616 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.092136 20660 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.113198 16805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1840) took 1224 ms. Trace:
I20260709 13:20:03.113396 20681 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:03.119935 16884 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:20:03.121922 20816 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.158478 16884 pending_rounds.cc:85] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 4
I20260709 13:20:03.158833 16884 pending_rounds.cc:107] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:20:03.137362 20673 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.129173 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:03.132269 20711 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:03.133329 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.133986 20773 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:03.135386 20623 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:03.136391 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:03.136782 16883 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:03.138017 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:03.168901 17523 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.140362 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.137633 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:03.139058 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:03.145083 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:03.169878 16954 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:03.141930 20817 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.130637 20714 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.151166 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:03.151495 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:03.152935 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:03.150055 20762 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:03.159199 16884 raft_consensus.cc:2889] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:03.123178 19905 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:20:03.167236 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.145470 20286 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:03.169231 17524 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:03.173354 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:03.146795 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:03.156339 16805 rpcz_store.cc:276] 0709 13:20:01.888428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.928850 (+ 40422us) service_pool.cc:224] Handling call
0709 13:20:02.056217 (+127367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.308254 (+252037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.308296 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:02.308352 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:02.308395 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.112993 (+804598us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54002a9254. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:03.113040 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.113149 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579164416}
I20260709 13:20:03.155035 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.150871 20624 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:03.157147 20704 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:03.156756 20616 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.154534 20873 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:03.153000 20872 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:03.267536 20872 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:03.268139 20872 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:03.214947 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.276146 20656 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:03.215517 16951 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:20:03.276682 20656 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:03.277539 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.278622 20721 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:03.278784 20656 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:03.279036 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.216313 19905 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:03.218204 16957 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:03.163971 20660 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.280114 19905 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.280776 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.177296 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.281514 20660 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:03.282132 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.282231 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.283183 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.221096 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.283972 16885 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:03.284013 16877 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:03.285001 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:03.285540 16885 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.287953 20694 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.289898 20694 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:03.215690 20726 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:03.218762 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.290678 20726 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.228798 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:03.291606 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.158836 20708 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:03.292661 20726 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:03.292976 20708 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.293064 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:03.253724 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.170737 20673 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.299122 17527 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:03.255930 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.256501 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.256904 20437 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:03.173753 20532 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:03.305217 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.305783 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.168128 20681 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.257491 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:03.308532 17524 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:20:03.258908 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:03.262524 17523 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:03.263764 20773 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:03.279243 20656 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.215987 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1889) took 1300 ms. Trace:
I20260709 13:20:03.281013 19905 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:03.293149 20788 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:03.316596 16884 rpcz_store.cc:276] 0709 13:20:01.915550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.941260 (+ 25710us) service_pool.cc:224] Handling call
0709 13:20:03.119258 (+1177998us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b580013ef98. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:20:03.119497 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.215751 (+ 96254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.215936 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2944768}
I20260709 13:20:03.296192 16883 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:03.296888 16885 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:03.238538 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:03.255095 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 81851.3us
I20260709 13:20:03.301898 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.302030 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.341827 16950 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:03.342320 16950 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:03.342367 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:03.302588 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.302277 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.343184 16807 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:03.343403 16805 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 12: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:03.344043 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.344262 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.345055 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.304158 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.203056 20530 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:03.227445 20762 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:03.349870 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:03.350641 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.307127 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:03.309667 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 50824.1us
I20260709 13:20:03.351831 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.343458 16950 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.352790 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:03.353308 16950 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:03.353673 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.310674 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.354274 16807 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:03.254227 20286 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:03.231071 20704 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:03.357311 20286 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.359935 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.360993 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.361765 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1891) took 1389 ms. Trace:
I20260709 13:20:03.361949 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.362545 16802 raft_consensus.cc:2393] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:03.355980 20801 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:03.363520 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:03.364007 20530 raft_consensus.cc:697] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:03.364241 16809 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 12: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:03.305423 20844 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.364795 16882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1888) took 1471 ms. Trace:
I20260709 13:20:03.364984 20844 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.365317 16882 rpcz_store.cc:276] 0709 13:20:01.893840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.894026 (+   186us) service_pool.cc:224] Handling call
0709 13:20:03.363992 (+1469966us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b580013ef98. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef406ffc0 00007feef405a929 00007feef405a3d2 00007feeed5d1bd4
0709 13:20:03.364180 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.364394 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.364431 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:03.364499 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:03.364547 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.364617 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.364729 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8004864}
I20260709 13:20:03.366945 20844 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:03.367009 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.370739 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.372287 16882 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:03.330585 20656 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.342729 16804 raft_consensus.cc:2410] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:03.303382 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:03.347787 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.283608 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.355103 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.355768 20437 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:20:03.355985 20317 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.376940 20571 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:03.372572 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.362294 16878 rpcz_store.cc:276] 0709 13:20:01.972666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.156059 (+183393us) service_pool.cc:224] Handling call
0709 13:20:02.156313 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.719920 (+563607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.361480 (+641560us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b5400191c54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:03.361693 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213752576}
I20260709 13:20:03.378351 16885 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:03.352461 16884 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:20:03.374388 16808 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:03.380304 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.381035 16883 raft_consensus.cc:2410] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:20:03.381614 16950 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:03.382647 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.382932 16950 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:03.356165 20694 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:03.375316 20572 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:03.377056 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.344789 16805 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:03.349504 20623 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:03.377530 20317 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.318727 20827 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:03.390012 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.401106 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.311300 20532 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.357373 20704 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.390537 16876 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:20:03.436789 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.395090 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.401862 16882 raft_consensus.cc:2410] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:20:03.404027 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.439059 16957 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
W20260709 13:20:03.404191 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.391417 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:03.441277 17523 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:03.436820 20801 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:03.441936 17527 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:03.402474 20827 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:03.442472 20827 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:03.390012 20694 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:03.443207 20694 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:03.406291 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.389405 20816 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:03.406919 20880 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:03.384279 16877 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:20:03.411741 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:03.451095 16953 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:03.414132 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.452200 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.414773 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.415613 16809 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:03.417565 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:03.432814 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:03.458863 17523 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:20:03.378005 20781 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:20:03.403069 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.467152 16850 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:03.467864 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.468108 19905 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:03.468473 16885 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:03.440905 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:20:03.469127 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.446791 16883 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:03.448773 16807 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:03.448697 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:03.470667 19905 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:03.471064 16802 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:03.449219 16808 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:20:03.473052 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:03.473729 19905 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:03.474957 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.475297 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:03.476084 19905 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:03.387655 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:03.364833 20530 consensus_queue.cc:237] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.477591 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1896) took 1227 ms. Trace:
I20260709 13:20:03.475704 16882 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:03.477957 16881 rpcz_store.cc:276] 0709 13:20:02.249965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.800018 (+550053us) service_pool.cc:224] Handling call
0709 13:20:02.825424 (+ 25406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:02.926000 (+100576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.477388 (+551388us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b540041a5d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:03.477539 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42137344}
I20260709 13:20:03.481876 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:03.484112 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 96502.3us
I20260709 13:20:03.488749 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:03.493551 17525 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:03.401716 20878 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
W20260709 13:20:03.496835 16877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 567) took 1584 ms (client timeout 1798 ms). Trace:
I20260709 13:20:03.526712 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:03.528883 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 59141.8us
I20260709 13:20:03.402179 20877 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.083s
W20260709 13:20:03.530844 16877 rpcz_store.cc:269] 0709 13:20:01.898279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:01.964676 (+ 66397us) service_pool.cc:224] Handling call
0709 13:20:03.128993 (+1164317us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b580013ef98. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:20:03.482952 (+353959us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400341f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:03.483043 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279702016}
W20260709 13:20:03.486011 20885 log.cc:927] Time spent T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:20:03.562723 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:03.476307 20714 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:03.572721 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 95830.1us
I20260709 13:20:03.574734 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:03.530332 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:03.497593 20845 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:03.579733 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 49493.9us
I20260709 13:20:03.529202 20844 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:03.635349 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 60707.3us
I20260709 13:20:03.676303 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:03.530051 20711 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:03.532965 20882 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:03.477345 20716 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:20:03.637413 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:03.534279 20816 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:03.495024 20832 consensus_queue.cc:1059] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
W20260709 13:20:03.679144 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 104941us
I20260709 13:20:03.570839 20718 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:03.525779 20624 consensus_queue.cc:1059] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:20:03.633787 20660 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:03.637984 20873 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:03.706013 20873 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:03.706825 20873 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.705540 20624 raft_consensus.cc:3055] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:03.724284 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:03.724330 16884 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:03.677893 20711 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.698913 20721 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:03.692359 20571 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:03.712249 20844 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:03.719071 20681 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:03.720425 20624 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:03.738716 20711 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:03.757695 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:03.762801 16882 raft_consensus.cc:2410] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:03.761089 20898 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:03.727787 20424 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:20:03.766826 16882 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:03.712138 20870 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:20:03.770810 20898 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:03.771581 20888 log.cc:927] Time spent T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:20:03.725414 20748 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:20:03.749806 20844 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.773013 20898 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:03.773401 20844 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:03.773954 20889 log.cc:927] Time spent T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:20:03.776646 16955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 2209) took 1714 ms. Trace:
I20260709 13:20:03.776434 20669 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:03.777570 20624 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.778560 20624 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:03.761089 20887 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
W20260709 13:20:03.781279 20817 consensus_meta.cc:287] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.601s	user 0.005s	sys 0.003s
I20260709 13:20:03.781663 20817 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.782913 20827 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.784252 20817 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:03.784598 20801 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:03.785140 20801 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:03.787124 20616 consensus_meta.cc:287] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.527s	user 0.005s	sys 0.001s
I20260709 13:20:03.787521 20616 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.740351 20770 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:20:03.752102 20656 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:03.789429 20616 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:03.803236 20872 consensus_meta.cc:287] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.001s
W20260709 13:20:03.799201 20543 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:20:03.805874 20658 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.777034 16955 rpcz_store.cc:276] 0709 13:20:02.061823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:02.061978 (+   155us) service_pool.cc:224] Handling call
0709 13:20:02.144768 (+ 82790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:02.161764 (+ 16996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:02.161795 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:02.172681 (+ 10886us) log.cc:844] Serialized 26 byte log entry
0709 13:20:03.139170 (+966489us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18000c44e0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec360d1 00007feeef051a0f
0709 13:20:03.433816 (+294646us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:03.433857 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:03.433924 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:03.776291 (+342367us) raft_consensus.cc:1685] finished
0709 13:20:03.776320 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:03.776554 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16592,"raft.queue_time_us":30043,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":25559,"spinlock_wait_cycles":2917760,"thread_start_us":294466,"threads_started":1,"wal-append.queue_time_us":1301068}
I20260709 13:20:03.768064 20317 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:03.820196 20704 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:03.821565 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 145328us
I20260709 13:20:03.746115 20571 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.801644 20673 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.824710 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:03.761879 20762 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.831357 20673 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:03.831984 17519 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:20:03.822901 20872 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.840657 20623 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:03.841207 20623 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:03.842880 20844 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.844157 20738 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:03.839762 20492 consensus_meta.cc:287] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.000s
W20260709 13:20:03.849978 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 212606us
I20260709 13:20:03.850332 16878 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:20:03.853004 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.853389 17524 raft_consensus.cc:1240] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:03.844673 20738 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.846309 20492 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:03.867985 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 157833us
I20260709 13:20:03.869823 20534 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:20:03.871744 19978 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:20:03.881019 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 307448us
I20260709 13:20:03.885491 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:03.897600 16810 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:03.864398 20872 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:03.914208 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.914302 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:20:03.914888 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:03.911036 16806 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:03.912611 17518 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:03.888900 20903 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:20:03.922457 16806 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:20:03.928406 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:03.929129 16950 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:03.938699 20492 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:03.939919 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:03.940378 20762 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:03.942088 20738 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:03.942595 20801 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:03.943027 20694 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.944257 17522 raft_consensus.cc:2410] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:20:03.944226 20571 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:03.947760 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:03.949695 16950 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:03.962906 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:03.963305 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:03.964221 17527 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:03.962955 17526 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:03.967314 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:03.975732 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:04.013581 17518 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:20:04.021386 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 105950us
W20260709 13:20:04.022641 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 91095.4us
I20260709 13:20:04.023336 16922 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:03.945058 20694 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:04.023940 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 76283.7us
I20260709 13:20:04.041218 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:04.044971 16924 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:04.046329 16924 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:04.020190 20911 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:20:03.945556 20801 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:04.077383 19791 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:04.077999 19791 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.078426 19791 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.051707 20748 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:04.053217 20571 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:04.051288 20827 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.054574 20868 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.099326 20844 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.060636 20904 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.140762 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:20:04.145709 20912 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:20:04.057065 20899 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:20:04.102805 20905 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:04.137663 20868 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.161826 20868 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.141356 20704 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:04.168363 20906 log.cc:927] Time spent T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:04.173544 20721 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.174036 20721 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.174522 20846 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:04.175019 20846 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.176064 20721 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.176600 20721 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.176987 20721 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.177763 20890 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:04.178262 20890 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.178854 20721 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.180347 20890 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:04.180850 20721 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:04.180943 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 356268us
I20260709 13:20:04.181277 20721 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.181672 20721 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.181996 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.184041 20719 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.184967 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.186067 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:04.183784 20623 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.190775 20708 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:04.192713 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.194667 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.197853 16848 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:04.198925 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.199942 16848 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.194818 20726 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:04.195415 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 139274us
W20260709 13:20:04.202159 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 137690us
W20260709 13:20:04.226284 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 180022us
I20260709 13:20:04.230527 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.195359 20718 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:04.231750 16850 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:04.231633 20716 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.233361 20900 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:04.235865 20900 raft_consensus.cc:697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:04.236167 20907 consensus_queue.cc:1059] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:04.237207 20907 raft_consensus.cc:3055] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:04.236697 20900 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.237555 20907 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:04.238382 20907 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.239357 20907 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.240895 20716 consensus_queue.cc:1059] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:04.241698 20716 raft_consensus.cc:3055] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:04.242007 20716 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:04.241004 20719 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:04.242712 20719 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.243180 20719 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.242791 20716 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.244211 20716 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.249738 20532 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.250633 16922 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:04.251376 20905 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:04.252619 20801 consensus_queue.cc:1059] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:04.252925 20653 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:04.253520 20904 raft_consensus.cc:3055] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:04.254257 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.257753 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:04.257822 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:04.228528 20890 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:04.259488 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:04.259208 16806 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:04.262154 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:04.255764 16922 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:04.154232 19791 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.228830 20726 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:04.257203 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:04.232149 20660 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:04.265514 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.269485 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.270476 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.276109 16952 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:04.276686 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.265816 16810 raft_consensus.cc:2393] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:04.269491 16959 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:04.255041 20653 raft_consensus.cc:697] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:04.233570 20656 consensus_queue.cc:1059] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:20:04.278666 19791 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:04.271400 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.285082 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.234656 20817 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:04.269761 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.253858 20904 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:04.274396 16958 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:20:04.275038 16877 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:04.286489 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.284222 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.289894 16959 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:20:04.262137 20899 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:04.295550 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.296695 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.297650 16952 raft_consensus.cc:2393] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:04.297883 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.300704 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.301023 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.301251 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.302637 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.303304 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.299176 20714 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.306458 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.299309 20899 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:04.307111 16956 raft_consensus.cc:2368] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9.
I20260709 13:20:04.307124 20899 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.308424 20530 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:04.308821 20530 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:04.309183 20530 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.312288 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.277714 20726 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.278364 20704 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:04.329819 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.330160 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:04.296825 20624 consensus_meta.cc:287] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.000s
W20260709 13:20:04.338382 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.274096 20878 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:20:04.331573 20714 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:04.332248 20904 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:04.333382 20711 consensus_meta.cc:287] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
I20260709 13:20:04.279659 20660 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:04.334733 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.440392 16959 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.343192 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.344110 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.342105 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.336390 20901 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.271159 19978 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:20:04.374013 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.312714 20844 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:04.302201 20708 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.375175 20656 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.448953 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:04.375818 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:04.381521 16850 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.274231 20845 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:20:04.433480 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.456080 16958 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:04.458225 19978 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:04.458565 16959 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:04.459196 19978 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.459910 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.293042 20877 consensus_queue.cc:1059] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:20:04.335253 20898 raft_consensus.cc:3055] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:04.349624 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.444005 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.465788 16953 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:20:04.445310 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:04.467099 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:04.467628 16810 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.446964 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:04.448179 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:04.434469 20714 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:04.462491 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 81020.1us
I20260709 13:20:04.469903 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:04.469061 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:04.471700 16806 raft_consensus.cc:2393] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:04.444718 20660 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.469349 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:04.474232 16877 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.475028 16953 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:04.476322 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:04.434105 20770 consensus_queue.cc:1059] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:20:04.473243 16951 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:04.433080 20581 consensus_queue.cc:1059] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:20:04.448043 20844 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:04.442953 20711 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.469094 20898 raft_consensus.cc:740] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:04.498220 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:04.474490 20714 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:20:04.503439 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 165535us
I20260709 13:20:04.484760 20844 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.466027 20656 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.481488 20623 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:04.462008 20708 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.513091 16880 raft_consensus.cc:1240] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:04.491400 20846 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.489144 20762 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:04.518615 16877 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:04.519821 16882 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:04.446930 20653 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.566200 16883 raft_consensus.cc:2410] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 12 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:04.572115 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:04.572952 16882 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.573547 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:04.573655 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 236713us
I20260709 13:20:04.553823 20907 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.577812 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.565785 20827 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:04.566458 20931 raft_consensus.cc:3055] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:20:04.584301 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 247466us
I20260709 13:20:04.585539 16877 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:20:04.592715 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.593457 16882 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:04.569370 20762 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:04.594823 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.594978 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:04.595208 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:04.596750 16806 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:04.596755 16807 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.585088 20931 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:04.600935 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:04.601742 16806 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.573642 20898 consensus_queue.cc:260] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.604298 20898 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:04.606565 20932 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:20:04.610797 20530 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.612541 20656 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.616441 20708 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:04.617650 16806 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:20:04.621014 20931 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.624787 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:04.625458 16806 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.633045 20721 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.635257 20721 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.588340 20827 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.637315 20827 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.638473 16810 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:04.642491 16810 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:04.664947 20931 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:04.642617 16806 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:20:04.644155 20719 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:04.645587 20929 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:20:04.645750 20714 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:04.647011 20930 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:04.650116 20899 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.651427 20711 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.653198 20530 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.653930 20762 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.656198 16807 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:04.693859 20844 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:04.697034 20915 log.cc:927] Time spent T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.521s	user 0.001s	sys 0.000s
W20260709 13:20:04.697227 20922 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.435s	user 0.002s	sys 0.000s
I20260709 13:20:04.701859 20899 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.674428 20901 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:04.702589 20901 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.683418 16775 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.684231 16884 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:20:04.685542 20719 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.687731 20714 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.690649 20726 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.706322 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:04.660605 20660 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.710739 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.712460 16954 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:04.713851 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.711654 16924 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:04.716753 20530 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:04.720625 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:04.727861 20901 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:04.728626 20660 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:04.730779 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:04.731335 20726 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:04.714251 20844 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.736862 16802 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:04.738044 16802 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:04.739233 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.739501 16802 raft_consensus.cc:1240] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:04.748458 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.747274 20948 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:04.750424 20726 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:04.751125 20940 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.751555 20940 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:04.751932 20940 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.712533 20949 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.753299 20949 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:04.753647 20949 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.759020 16850 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:04.763649 16950 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:04.759793 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:04.765738 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:04.777694 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.780198 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.785398 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.788002 19791 consensus_queue.cc:1059] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:04.789996 19791 consensus_queue.cc:1059] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:04.790674 19791 raft_consensus.cc:3055] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:04.791051 19791 raft_consensus.cc:740] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:04.790715 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.791792 19791 consensus_queue.cc:260] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.792855 19791 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:04.793139 20711 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:04.794325 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:04.795167 20846 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:04.795516 20846 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.795850 20719 consensus_queue.cc:1059] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:04.796001 20898 consensus_queue.cc:1059] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:04.796711 20711 raft_consensus.cc:3055] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:04.797060 20711 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:04.797794 20898 raft_consensus.cc:3055] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:04.798321 20898 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:04.797857 20711 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.799145 20711 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:04.799063 20898 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:04.799779 20873 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.007s	sys 0.009s
W20260709 13:20:04.800125 20873 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.007s	sys 0.009s
I20260709 13:20:04.800765 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.800962 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.801577 16956 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:20:04.802112 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.803160 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.803963 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:04.804996 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.809036 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.795857 20846 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:04.812093 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:04.813356 20898 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.817916 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:04.820852 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:04.823124 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:04.824652 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:04.827304 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:04.829034 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:04.830483 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:04.758193 20726 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:20:04.758469 20948 raft_consensus.cc:697] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:04.838672 16850 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:04.839834 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:04.787038 20925 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:04.782243 20658 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:04.826056 20660 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:04.838671 20873 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.758569 20653 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:20:04.849932 16882 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:04.835573 20716 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:04.840072 20721 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:04.825773 20718 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:20:04.863543 16882 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:20:04.843371 20876 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.849023 20941 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.843760 20939 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:04.850422 20660 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:04.876021 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.849541 20900 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:04.895617 20900 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.896155 20900 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:04.850730 20844 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:04.900033 20844 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.903015 20844 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:04.869292 20581 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:04.865320 20658 raft_consensus.cc:697] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:04.918561 17518 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:04.924190 20919 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.732s	user 0.004s	sys 0.000s
I20260709 13:20:04.872241 20925 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:04.892304 20762 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:04.864751 20873 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.906193 20660 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:04.954222 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1872) took 1058 ms. Trace:
I20260709 13:20:04.959594 16809 rpcz_store.cc:276] 0709 13:20:03.895392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.895576 (+   184us) service_pool.cc:224] Handling call
0709 13:20:03.895917 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.896136 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:20:04.834365 (+938229us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.953921 (+119556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:04.953967 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:04.954006 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.954072 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:04.954175 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":875503,"prepare.queue_time_us":996377,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":47,"thread_start_us":194155,"threads_started":2}
I20260709 13:20:04.915284 20581 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:04.978327 20581 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.979856 20581 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:04.915663 20948 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.905306 20941 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.976544 20658 consensus_queue.cc:237] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:04.983467 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:04.957368 20868 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:04.894285 20876 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:04.905972 20939 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:04.968688 20770 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.965996 20762 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:03.729642 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:05.120332 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:05.122202 20959 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:20:05.084434 20714 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:20:05.064574 20770 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:05.066151 20925 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:05.143195 20846 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:05.145612 20846 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.146310 16884 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
W20260709 13:20:05.148291 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.156272 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44636 (request call id 1049) took 1272 ms. Trace:
W20260709 13:20:05.157187 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.156710 17522 rpcz_store.cc:276] 0709 13:20:03.884150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.885280 (+  1130us) service_pool.cc:224] Handling call
0709 13:20:05.149937 (+1264657us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b54004f3154. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:05.156216 (+  6279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133170560}
W20260709 13:20:05.135282 20954 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:20:05.136579 20816 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:05.165275 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.179283 20877 raft_consensus.cc:3055] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:05.179740 20877 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:05.180601 20877 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.181665 20877 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:05.185490 20938 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.605s	user 0.000s	sys 0.001s
I20260709 13:20:05.201799 20762 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:05.208425 20918 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 1.063s	user 0.000s	sys 0.002s
I20260709 13:20:05.210538 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1867) took 1320 ms. Trace:
I20260709 13:20:05.210994 16801 rpcz_store.cc:276] 0709 13:20:03.890083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.890197 (+   114us) service_pool.cc:224] Handling call
0709 13:20:03.900521 (+ 10324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.910322 (+  9801us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:20:03.910350 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.910851 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.020996 (+110145us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:04.021036 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.021099 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.207854 (+1186755us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:05.210165 (+  2311us) raft_consensus.cc:1685] finished
0709 13:20:05.210193 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.210464 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14985,"raft.queue_time_us":16695,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":21941,"spinlock_wait_cycles":307914624,"thread_start_us":109828,"threads_started":1,"wal-append.queue_time_us":233751}
I20260709 13:20:05.212903 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:05.213450 16801 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
W20260709 13:20:05.218523 20964 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:20:05.219537 20958 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:20:05.221045 20957 log.cc:927] Time spent T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:20:05.222784 16808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1869) took 1330 ms. Trace:
I20260709 13:20:05.223228 16808 rpcz_store.cc:276] 0709 13:20:03.892299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.893114 (+   815us) service_pool.cc:224] Handling call
0709 13:20:03.893486 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.893929 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:04.758478 (+864549us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b180009eaa0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf23c0a 00007feef5663219 00007feeebfaba40 00007feeebfa64e4 00007feeebfa6455 00007feef2a8e3c7 00007feeef0a09a7 00007feeef0b00bf 00007feeef0b0038
0709 13:20:04.758717 (+   239us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.871774 (+113057us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.875248 (+  3474us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.875389 (+   141us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:04.875418 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.875496 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.222469 (+346973us) raft_consensus.cc:1685] finished
0709 13:20:05.222575 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.222719 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56163,"prepare.queue_time_us":958414,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":39853,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2221,"spinlock_wait_cycles":11007744,"thread_start_us":112655,"threads_started":1,"wal-append.queue_time_us":255607}
W20260709 13:20:05.226253 20960 log.cc:927] Time spent T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:20:05.226877 20954 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:05.174572 20816 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:05.199376 20873 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:05.168490 20770 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:05.254068 16810 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:05.269716 20669 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.270392 20669 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.260176 20770 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.277243 20770 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:05.240170 20530 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:05.253664 20941 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.281906 20939 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:05.283954 20876 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.325218 20669 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:05.326145 20914 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 1.385s	user 0.000s	sys 0.004s
I20260709 13:20:05.329841 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:05.348940 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:05.338358 20940 consensus_meta.cc:287] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.000s
I20260709 13:20:05.356180 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:05.339303 20921 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 1.180s	user 0.000s	sys 0.006s
I20260709 13:20:05.351605 20669 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:05.358292 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:05.358978 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:05.359900 16951 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:05.351025 20437 consensus_queue.cc:1059] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:20:05.364817 20669 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.365845 20437 raft_consensus.cc:3055] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:05.366189 20437 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:05.366974 20437 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.368242 20437 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:05.316176 20660 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.373659 20660 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:05.376257 20711 consensus_meta.cc:287] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.004s
I20260709 13:20:05.367419 20669 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.376893 20669 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.353520 20770 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:05.362883 20286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.650s	user 0.024s	sys 0.009s
W20260709 13:20:05.377465 20920 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 1.148s	user 0.001s	sys 0.001s
I20260709 13:20:05.350978 20581 consensus_queue.cc:1059] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:20:05.378475 20949 consensus_meta.cc:287] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.624s	user 0.013s	sys 0.000s
I20260709 13:20:05.360473 20940 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.377451 20669 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:05.381660 20286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.680s	user 0.025s	sys 0.010s
I20260709 13:20:05.408048 16805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1873) took 1512 ms. Trace:
I20260709 13:20:05.395000 20879 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:05.410130 16805 rpcz_store.cc:276] 0709 13:20:03.895762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.895910 (+   148us) service_pool.cc:224] Handling call
0709 13:20:03.896237 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.896473 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:20:05.123979 (+1227506us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.393404 (+269425us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:05.393487 (+    83us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:05.393546 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.394485 (+   939us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.407786 (+ 13301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":885532,"prepare.queue_time_us":1011533,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":433,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6613,"thread_start_us":633228,"threads_started":2,"wal-append.queue_time_us":280336}
I20260709 13:20:05.399310 20845 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:05.420084 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:05.415946 20845 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.426203 20669 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.428419 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1899) took 1819 ms. Trace:
I20260709 13:20:05.428912 16881 rpcz_store.cc:276] 0709 13:20:03.608554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.608717 (+   163us) service_pool.cc:224] Handling call
0709 13:20:03.668206 (+ 59489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.734117 (+ 65911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:03.734161 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:03.742371 (+  8210us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.027964 (+285593us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:04.028012 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.028098 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.376957 (+1348859us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:05.428064 (+ 51107us) raft_consensus.cc:1685] finished
0709 13:20:05.428091 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.428345 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36905,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":111439232,"thread_start_us":350794,"threads_started":2,"wal-append.queue_time_us":397593}
W20260709 13:20:05.431766 20973 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:20:05.435127 16803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1866) took 1545 ms. Trace:
I20260709 13:20:05.387965 20949 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:05.409950 20832 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.684s	user 0.014s	sys 0.003s
I20260709 13:20:05.448175 20990 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:05.448494 20979 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.455159 20990 raft_consensus.cc:697] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:05.455392 20979 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:05.456151 20530 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:05.456619 20898 consensus_meta.cc:287] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 13:20:05.456750 20530 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:05.456184 20990 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.435633 16803 rpcz_store.cc:276] 0709 13:20:03.889729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.898727 (+  8998us) service_pool.cc:224] Handling call
0709 13:20:03.923619 (+ 24892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:03.924036 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:05.292404 (+1368368us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.434715 (+142311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:05.434784 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:05.434842 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.434928 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.435061 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":942372,"prepare.queue_time_us":1012175,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"thread_start_us":569404,"threads_started":2,"wal-append.queue_time_us":124209}
I20260709 13:20:05.409407 20762 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:20:05.435140 20845 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:05.460712 20979 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.465758 20940 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:05.467499 16958 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:05.452526 20832 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.733s	user 0.015s	sys 0.003s
I20260709 13:20:05.436430 20943 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:05.475054 20900 consensus_meta.cc:287] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.001s
I20260709 13:20:05.476101 20530 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:05.478228 20530 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.479017 20949 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:05.476306 20900 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:05.484742 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:05.505033 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.486641 20532 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:05.486937 20721 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:05.487217 20660 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:20:05.525162 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 105145us
I20260709 13:20:05.488493 20711 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:05.474990 20816 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.528717 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:05.529239 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1875) took 1630 ms. Trace:
I20260709 13:20:05.529733 16884 raft_consensus.cc:2368] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10.
I20260709 13:20:05.529668 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:05.531121 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:05.530557 16879 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:05.529618 16804 rpcz_store.cc:276] 0709 13:20:03.898902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.899038 (+   136us) service_pool.cc:224] Handling call
0709 13:20:03.899395 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:03.910276 (+ 10881us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:20:05.288915 (+1378639us) log.cc:844] Serialized 14 byte log entry
0709 13:20:05.435882 (+146967us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:05.454302 (+ 18420us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.454495 (+   193us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:20:05.454545 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:05.454638 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:05.529027 (+ 74389us) raft_consensus.cc:1685] finished
0709 13:20:05.529045 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.529172 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":912658,"prepare.queue_time_us":1020812,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":10535,"raft.queue_time_us":44061,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":39463,"thread_start_us":555260,"threads_started":2,"wal-append.queue_time_us":145135}
I20260709 13:20:05.535890 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:05.536463 16881 raft_consensus.cc:2376] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8. Re-sending same reply.
I20260709 13:20:05.537765 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:05.538442 16883 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:05.539927 17526 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:20:05.540071 17527 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:05.537858 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:05.542279 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:05.542702 17518 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:05.543169 17519 raft_consensus.cc:2410] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:20:05.527067 20846 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.531662 20898 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:05.562153 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.563763 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:05.566920 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:05.563606 17527 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:05.532536 20718 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:05.564431 17525 raft_consensus.cc:1240] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:20:05.630374 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 63545.9us
I20260709 13:20:05.630646 17519 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:20:05.632894 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:05.533411 20286 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:05.634014 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:05.527901 20532 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:05.654475 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:05.529068 20721 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.530721 20660 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.662046 17518 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:20:05.530928 20711 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:05.564510 20726 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:05.654516 20964 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:20:05.653234 20669 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:05.654120 20990 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:05.655102 20987 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:05.562520 20846 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.655644 20718 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.652827 20898 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:05.686149 20721 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:05.688496 20660 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:05.672502 20762 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:05.670651 20991 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:05.659564 20286 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:05.704639 20286 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.682617 20990 raft_consensus.cc:697] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:05.704967 20532 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.705830 20990 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.707324 20718 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:05.709468 20898 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.711611 20711 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:05.712889 20934 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 1.137s	user 0.005s	sys 0.000s
I20260709 13:20:05.696137 20900 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:05.697064 20983 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 13:20:05.699646 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.701509 20816 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.714094 20846 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:05.673153 20726 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.715716 16705 catalog_manager.cc:5697] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 6 to 9, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 9 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:05.716980 20726 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:05.717612 16705 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 7 to 8, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 8 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:05.693157 16877 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:05.719638 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1915) took 1448 ms. Trace:
I20260709 13:20:05.724344 20532 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:05.723506 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.725230 20532 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.727319 20532 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:05.728005 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:05.723351 20660 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.729453 20660 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:05.732460 16881 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:05.724824 16885 rpcz_store.cc:276] 0709 13:20:04.271152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.271273 (+   121us) service_pool.cc:224] Handling call
0709 13:20:04.271531 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.271877 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.271922 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.272298 (+   376us) log.cc:844] Serialized 26 byte log entry
0709 13:20:04.516332 (+244034us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:04.567316 (+ 50984us) log.cc:844] Serialized 14 byte log entry
0709 13:20:04.567756 (+   440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:04.567890 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:04.701984 (+134094us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b1800433f00. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebfa93f3 00007feeebfab7c1 00007feeebfab779 00007feeebfab709 00007feeebfab6d1 00007feeebfaa9cd 000000000038f354 000000000038f199 00007feeebf8c83a
0709 13:20:05.482263 (+780279us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b4800002dd8. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef3fbfaa1 00007feef3fb6b37 00007feef3fb69ca 00007feef40ae26f 00007feef40adf37 00007feef40c255c 00007feef40c2508 00007feef40c2488 00007feef40c2443 00007feef40c16ec 00007feef2feba96
0709 13:20:05.712404 (+230141us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:05.719451 (+  7047us) raft_consensus.cc:1685] finished
0709 13:20:05.719471 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:05.719585 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50745,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1793,"raft.queue_time_us":1818,"raft.run_cpu_time_us":3437,"raft.run_wall_time_us":1207659,"spinlock_wait_cycles":31022464,"thread_start_us":243789,"threads_started":1,"wal-append.queue_time_us":232353}
I20260709 13:20:05.733807 16879 raft_consensus.cc:1240] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:20:05.733714 20660 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:05.735055 16884 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:05.727398 16705 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 6 to 9, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 9 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:05.723830 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.736582 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:05.737362 16877 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:05.739574 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:05.743778 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:05.747107 16882 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
W20260709 13:20:05.748664 20995 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
W20260709 13:20:05.750375 16850 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.513s (SENT) [suppressed 5 similar messages]
I20260709 13:20:05.751180 16882 raft_consensus.cc:1240] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:05.755246 16882 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:05.758811 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:05.759809 16882 raft_consensus.cc:2410] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:20:05.776043 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.781567 16879 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:20:05.771946 20942 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:05.794593 20925 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:05.801178 20925 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.801548 20781 raft_consensus.cc:3055] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:05.802161 20781 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:05.811609 20925 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:05.825683 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 171313us
I20260709 13:20:05.828838 17492 leader_election.cc:400] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9.
I20260709 13:20:05.829219 17492 leader_election.cc:403] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:20:05.830348 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:05.831370 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:05.803879 20942 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.039810 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:05.888762 20532 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:05.976643 20718 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:06.061949 20718 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:05.876959 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:06.066170 16959 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.040772 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:06.041360 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:06.071980 20718 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.039191 20660 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:06.076376 20660 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.078727 20660 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:06.039120 20762 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9.
I20260709 13:20:06.080462 20762 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:06.081125 20762 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:06.090786 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:06.093990 16807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1885) took 1386 ms. Trace:
I20260709 13:20:06.101626 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 2233) took 1833 ms. Trace:
I20260709 13:20:05.834824 20872 raft_consensus.cc:3055] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:06.081449 20762 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:06.092818 20660 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:06.102043 16954 rpcz_store.cc:276] 0709 13:20:04.268249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.268355 (+   106us) service_pool.cc:224] Handling call
0709 13:20:04.268593 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.712830 (+444237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.101411 (+1388581us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54002d4954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:06.101573 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020387712}
I20260709 13:20:06.105083 16959 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:06.094414 16807 rpcz_store.cc:276] 0709 13:20:04.707319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.707457 (+   138us) service_pool.cc:224] Handling call
0709 13:20:04.707753 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.707929 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:20:05.127821 (+419892us) log.cc:844] Serialized 14 byte log entry
0709 13:20:06.093236 (+965415us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b18002bb700. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf23c0a 00007feef5663219 00007feeebfaba40 00007feeebfa64e4 00007feeebfa6455 00007feef2a8e3c7 00007feeef0a09a7 00007feeef0b00bf 00007feeef0b0038
0709 13:20:06.093475 (+   239us) log.cc:844] Serialized 14 byte log entry
0709 13:20:06.093689 (+   214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:06.093733 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:06.093781 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.093847 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.093942 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159543,"prepare.queue_time_us":245837,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":7468,"raft.queue_time_us":8272,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4844,"spinlock_wait_cycles":9435520,"thread_start_us":427809,"threads_started":2,"wal-append.queue_time_us":249857}
I20260709 13:20:06.104692 20660 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.107259 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1887) took 1399 ms. Trace:
I20260709 13:20:06.107553 20660 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.039988 20926 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:05.819303 20781 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.107625 16806 rpcz_store.cc:276] 0709 13:20:04.707809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.707924 (+   115us) service_pool.cc:224] Handling call
0709 13:20:04.708206 (+   282us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:04.708530 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.708555 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:04.709038 (+   483us) log.cc:844] Serialized 52 byte log entry
0709 13:20:05.487459 (+778421us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b1800074b60. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec360d1 00007feeef051a0f
0709 13:20:05.528864 (+ 41405us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:05.748080 (+219216us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:06.106747 (+358667us) log.cc:844] Serialized 14 byte log entry
0709 13:20:06.106951 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.107021 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:06.107057 (+    36us) raft_consensus.cc:1685] finished
0709 13:20:06.107072 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.107206 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":578391,"prepare.queue_time_us":578359,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":850,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3670,"spinlock_wait_cycles":46694656,"thread_start_us":41244,"threads_started":1,"wal-append.queue_time_us":931938}
I20260709 13:20:06.118494 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:06.081840 20879 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:06.115590 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:06.101513 20991 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:06.121444 17518 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:06.104045 20872 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:06.111217 20762 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:06.123080 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:06.089254 20532 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:06.132268 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.153031 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.126775 20781 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.178308 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1897) took 2625 ms. Trace:
I20260709 13:20:06.186667 16880 rpcz_store.cc:276] 0709 13:20:03.531029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:03.637118 (+106089us) service_pool.cc:224] Handling call
0709 13:20:03.695449 (+ 58331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:04.514305 (+818856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.155863 (+1641558us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54003f4b54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:06.156074 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879858944}
I20260709 13:20:06.129442 20879 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:06.200196 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 158909us
W20260709 13:20:06.201766 17522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.007s	sys 0.006s
W20260709 13:20:06.202108 17522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.007s	sys 0.006s
I20260709 13:20:06.206574 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:06.206759 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:06.210812 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:06.133275 20991 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.196537 20872 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.113016 20926 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.211164 20999 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:06.216063 20987 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:06.235327 20532 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:06.230113 20801 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:06.231536 20987 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:06.240717 20872 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:06.241302 20942 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.239403 20990 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:20:06.247195 20987 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.259119 20991 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:06.289978 16850 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.047s	sys 0.121s
W20260709 13:20:06.291124 16850 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.048s	sys 0.122s
W20260709 13:20:06.292032 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 68995.1us
W20260709 13:20:06.293231 16876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.032s
W20260709 13:20:06.293799 16876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.006s	sys 0.032s
I20260709 13:20:06.294137 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:06.291910 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 541463us
I20260709 13:20:06.301904 20991 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:06.306624 20623 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:06.307315 20623 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.323722 20532 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.324656 20532 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.325026 16885 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:20:06.306720 20926 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.310050 20623 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:06.303337 20991 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.291970 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:06.246655 20801 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.342528 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:06.348680 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 133337us
I20260709 13:20:06.349097 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.350049 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:06.363088 16959 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:06.359573 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.365202 16922 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.016s	sys 0.037s
I20260709 13:20:06.366315 20898 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:06.370739 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:06.375129 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.375308 20660 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:06.380894 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 568090us
I20260709 13:20:06.381286 20801 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.377861 21009 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:06.379089 20898 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.385026 20660 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.389834 20898 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:06.390014 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:06.390470 20898 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:06.391331 21009 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:06.398517 20770 raft_consensus.cc:3055] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:06.399065 20770 raft_consensus.cc:740] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:06.390106 20660 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:06.405047 20991 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:06.416093 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.420533 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.391340 20898 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.400686 20770 consensus_queue.cc:260] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.424557 20660 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:06.445125 16775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.598s	user 0.020s	sys 0.031s
W20260709 13:20:06.446277 16775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.600s	user 0.020s	sys 0.032s
I20260709 13:20:06.446520 20785 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:06.446841 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 1.60022e+06us
I20260709 13:20:06.447295 20785 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:06.447152 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.451136 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.448673 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:06.455736 21009 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.452081 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:06.461194 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.469980 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:06.472515 20976 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 1.033s	user 0.004s	sys 0.009s
I20260709 13:20:06.473618 20942 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:06.474421 20942 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.477591 20942 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:06.480764 20898 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.481310 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.462208 20770 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:06.484512 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.487507 19905 raft_consensus.cc:3055] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:06.487970 19905 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:06.489171 19905 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.490810 19905 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:06.495361 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 46986.1us
I20260709 13:20:06.482049 16705 catalog_manager.cc:5697] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.462277 20660 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.492060 20942 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.498418 17492 leader_election.cc:400] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10.
I20260709 13:20:06.508095 17492 leader_election.cc:403] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:06.508930 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.509625 16775 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:06.514076 20899 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:06.515085 20904 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:06.493603 20785 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:06.522809 20899 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:06.525933 21011 log.cc:927] Time spent T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:20:06.537583 20899 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.541110 20532 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.541460 20899 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:06.546711 20660 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:06.547878 16707 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58336 (request call id 237) took 15722 ms (client timeout 15000 ms). Trace:
W20260709 13:20:06.551568 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.556833 20990 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.558616 16959 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:06.558463 20879 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.569118 20714 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:06.570147 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.572069 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.572191 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:06.573165 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.573837 20660 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.574100 20532 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:06.574712 20660 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.573807 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.576956 20719 consensus_queue.cc:1059] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.574997 20532 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:06.578997 20718 raft_consensus.cc:3055] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:06.578218 20660 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.579489 20718 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:06.579988 20532 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:06.580693 20718 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.582424 20718 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:06.583938 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 123135us
I20260709 13:20:06.584982 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:06.596303 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.548516 16707 rpcz_store.cc:269] 0709 13:19:50.825541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:50.828126 (+  2585us) service_pool.cc:224] Handling call
0709 13:19:51.958772 (+1130646us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400037fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeef000090 00007feeef09ef3a 00007feef4e551cc 00007feef4f5337e 00007feef34142a4 00007feef3414232 00007feef3414161 00007feef34140dc 00007feef3413392 00007feeed3d148c 00007feeed3d08c6
0709 13:20:06.547616 (+14588844us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:59.602810 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:59.620624 (+ 17814us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:59.620663 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:19:59.620682 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:59.630698 (+ 10016us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:59.630755 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:59.630785 (+    30us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:19:59.784093 (+153308us) tablet.cc:701] Row locks acquired
0709 13:19:59.784111 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:19:59.784292 (+   181us) write_op.cc:270] Start()
0709 13:19:59.784407 (+   115us) write_op.cc:276] Timestamp: P: 1783603199784217 usec, L: 0
0709 13:19:59.784426 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:19:59.906298 (+121872us) log.cc:844] Serialized 10112 byte log entry
0709 13:20:00.549074 (+642776us) op_driver.cc:464] REPLICATION: finished
0709 13:20:00.908321 (+359247us) write_op.cc:301] APPLY: starting
0709 13:20:00.917345 (+  9024us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:00.927472 (+ 10127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:00.927604 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:00.930419 (+  2815us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:00.930834 (+   415us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 13:20:00.930896 (+    62us) write_op.cc:312] APPLY: finished
0709 13:20:00.931468 (+   572us) log.cc:844] Serialized 176 byte log entry
0709 13:20:00.931654 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:00.972476 (+ 40822us) write_op.cc:454] Released schema lock
0709 13:20:00.984956 (+ 12480us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:01.034381 (+ 49425us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:01.034416 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1271780,"reported_tablets":42,"spinlock_wait_cycles":372444032,"child_traces":[["op",{"apply.queue_time_us":343925,"apply.run_cpu_time_us":5915,"apply.run_wall_time_us":130532,"num_ops":26,"prepare.queue_time_us":70445,"prepare.run_cpu_time_us":21076,"prepare.run_wall_time_us":477658,"raft.queue_time_us":259458,"raft.run_cpu_time_us":55326,"raft.run_wall_time_us":290072,"replication_time_us":747035,"thread_start_us":538314,"threads_started":4,"wal-append.queue_time_us":305528,"wal-append.run_cpu_time_us":56444,"wal-append.run_wall_time_us":1725307}]]}
I20260709 13:20:06.604039 20437 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.609706 20901 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:06.610533 20901 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.613068 20901 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:06.613947 20437 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.614982 20991 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:06.616227 20437 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:06.616581 20879 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:06.615432 20991 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:06.620638 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:06.623116 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.589818 20942 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.626235 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:06.626658 20987 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.628232 16954 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:06.629031 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:06.630584 16808 raft_consensus.cc:1240] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:20:06.630985 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 46178.1us
I20260709 13:20:06.620220 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:06.632822 16809 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:06.621366 20991 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:06.642714 20762 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.639518 16801 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:06.608989 20623 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.647897 16957 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:06.653662 16806 raft_consensus.cc:2410] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:20:06.654330 20898 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:06.654357 20437 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.656164 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:06.656051 20437 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.657673 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:06.658408 20437 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:06.659323 20770 consensus_queue.cc:1059] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:06.664170 20942 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:06.667925 16807 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:06.668322 21015 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:06.668161 20801 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.669375 20788 consensus_queue.cc:1059] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:20:06.671653 21010 consensus_queue.cc:1059] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:20:06.671983 20796 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:06.672151 20926 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.672637 20905 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.674081 20785 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:06.687650 21010 raft_consensus.cc:3055] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:06.705251 21010 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:06.706351 21010 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.682389 16950 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:06.682258 20437 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:06.708163 20437 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:06.709183 20437 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.710525 20437 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.685906 16850 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:06.682166 21009 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:06.706768 20872 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:06.712240 21009 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.712422 20872 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.686213 20796 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.712806 21009 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.711565 20788 consensus_queue.cc:1059] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:20:06.713943 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 204517us
I20260709 13:20:06.674389 20987 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:06.698951 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.704414 16958 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:20:06.695572 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.718497 21025 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:06.719198 21025 raft_consensus.cc:697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:06.720446 21025 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:06.724926 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.726210 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.726926 16955 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:20:06.727828 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.728123 21018 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:06.728415 16955 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:20:06.729331 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.729005 21018 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.730314 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.730948 16952 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:06.732301 21018 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.733381 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:06.733496 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:06.733902 17522 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 12: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:06.734112 16956 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:06.735267 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:06.741408 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.694409 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:06.715974 16958 pending_rounds.cc:85] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 8
I20260709 13:20:06.679733 20898 raft_consensus.cc:697] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:06.756017 20898 consensus_queue.cc:237] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.759125 20801 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.759560 20623 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:06.746665 16958 pending_rounds.cc:107] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:20:06.760406 16958 raft_consensus.cc:2889] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:06.766983 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:06.768401 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:06.693269 20990 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10.
I20260709 13:20:06.750765 21010 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:06.751597 20796 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.759171 20942 consensus_queue.cc:1059] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:20:06.776634 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.752071 20872 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:06.700799 20816 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.688660 20762 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:06.790580 16806 raft_consensus.cc:2393] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:06.791534 16850 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:06.699997 20660 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.804860 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:06.692698 20991 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.803850 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:06.806569 16850 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:06.700453 20926 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.803375 20942 consensus_queue.cc:1243] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer 4b60b701acc7473e87e3e529a2a34689 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:06.853993 19978 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:06.854503 19978 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.855513 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 1917) took 2520 ms. Trace:
I20260709 13:20:06.855907 16878 rpcz_store.cc:276] 0709 13:20:04.278387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:04.280387 (+  2000us) service_pool.cc:224] Handling call
0709 13:20:04.280740 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:04.281163 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:04.281202 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:04.281689 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:20:05.832954 (+1551265us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b1800125b00. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf772a6 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9
0709 13:20:06.509456 (+676502us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b1800125b00. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec360d1 00007feeef051a0f
0709 13:20:06.617335 (+107879us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:06.617383 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:06.624415 (+  7032us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:06.791193 (+166778us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b540024eda0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00bdbe 00007feeef016930 00007feeef0168d8 00007feeef016858 00007feeef016813 00007feeef015a9c 00007feef4f01626 00007feef4efbdd8 00007feeef0527cb 00007feeef0552c0
0709 13:20:06.798912 (+  7719us) raft_consensus.cc:1685] finished
0709 13:20:06.798932 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:06.799060 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2437,"raft.queue_time_us":91,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11697,"spinlock_wait_cycles":88900864,"thread_start_us":46428,"threads_started":1,"wal-append.queue_time_us":2296010}
I20260709 13:20:06.858431 21017 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:06.859371 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:06.859969 16801 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:06.860040 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 48705.9us
I20260709 13:20:06.863031 21023 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:06.862809 20781 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.863484 21023 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:06.863888 21023 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.864897 20781 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:06.700599 21015 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.806402 21018 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:06.849835 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 46468.7us
I20260709 13:20:06.873206 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:06.703918 20905 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:06.867774 21024 log.cc:927] Time spent T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 13:20:06.887742 20719 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:06.888180 20719 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:06.888545 20719 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:06.889619 21009 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.886883 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:06.868741 20532 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:06.886983 16951 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:06.902941 19905 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:06.903496 19905 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:06.903923 19905 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:06.883663 20816 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:06.916826 20904 raft_consensus.cc:3055] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:06.917307 20904 raft_consensus.cc:740] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:06.918069 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:06.921020 20926 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.921762 16806 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:06.924387 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:06.927270 19978 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:06.934504 16801 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:06.852617 20660 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:06.893577 20532 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:06.950142 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:06.879992 20770 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
W20260709 13:20:06.955845 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 60273.6us
I20260709 13:20:06.918329 20904 consensus_queue.cc:260] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.965021 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:06.965633 16806 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:20:06.973613 16805 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:06.957674 20532 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:06.978750 20904 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:06.979862 20534 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:06.980295 20534 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:06.980996 16850 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:06.981860 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:06.973207 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:06.984179 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:06.992689 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:06.994743 16807 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:06.998154 20593 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:06.988819 20796 raft_consensus.cc:3055] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:06.997849 20534 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:06.999053 20796 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:06.999917 20949 consensus_queue.cc:1059] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:06.999502 20534 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:07.000102 20796 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.001663 20796 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.008299 20660 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:07.009130 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:07.023737 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.026774 19905 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:07.033211 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 48444.5us
W20260709 13:20:07.034291 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 59542.9us
I20260709 13:20:07.034515 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.036640 16807 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:07.036829 16885 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:07.010876 21025 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:07.045254 20719 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.046941 20905 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:07.017287 20898 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:20:07.048300 20668 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.048841 20668 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:07.050922 20668 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:07.051389 20781 raft_consensus.cc:3055] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:20:07.042151 21026 log.cc:927] Time spent T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:20:07.059664 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.076643 16880 raft_consensus.cc:2393] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:07.060132 16808 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:20:07.054427 20991 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.052265 21015 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.054179 16881 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:07.061578 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:07.056074 20801 raft_consensus.cc:3055] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:07.080731 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.082054 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.040400 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.056814 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:07.057580 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:07.057183 16807 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:07.047441 20719 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.064698 19905 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.084019 16883 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:07.085237 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.082078 17522 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:07.041641 21025 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:07.086335 20714 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:07.081732 20801 raft_consensus.cc:740] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:07.087214 16882 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.097404 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:20:07.093175 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 62640.1us
I20260709 13:20:07.101761 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.077399 21017 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:07.079311 20816 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:07.104133 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:07.077878 20781 raft_consensus.cc:740] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:07.106180 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:07.112823 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.115799 16884 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:07.115968 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:07.116182 21017 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:07.116377 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:07.116997 16958 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.117170 21017 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.120280 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:07.121153 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.121904 17523 raft_consensus.cc:2393] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:07.122649 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.122959 16952 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:07.123740 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.124182 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.124779 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:07.125078 17520 raft_consensus.cc:2393] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:07.125754 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.125896 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.128090 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.128733 17523 raft_consensus.cc:2393] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:07.124244 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.133699 21009 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.135156 17519 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:20:07.136883 17518 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:07.138391 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:07.138854 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.138367 17522 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:07.101409 21025 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:07.153239 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 170313us
I20260709 13:20:07.154942 16801 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:07.110221 16879 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:07.168689 16808 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:07.171226 16882 raft_consensus.cc:2410] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:20:07.174413 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.174172 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:07.176390 16957 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:07.177132 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.177239 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:07.177806 16952 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:07.149621 21015 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:07.178913 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:07.179783 17522 raft_consensus.cc:2393] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:07.180068 19905 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:07.182049 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:07.182610 16882 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:07.175005 16809 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:07.185902 19905 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.180377 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:07.112895 21023 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:07.191466 21028 log.cc:927] Time spent T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:20:07.192219 19905 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:07.192323 21031 log.cc:927] Time spent T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:20:07.200701 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:07.206269 20801 consensus_queue.cc:260] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.176234 20719 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.200104 20781 consensus_queue.cc:260] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.208595 20781 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.208320 20719 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:07.211040 20719 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:07.205691 19791 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:07.207131 17527 raft_consensus.cc:2393] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:07.211639 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.213207 17525 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:07.214316 16882 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:20:07.224835 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:20:07.227342 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.228605 16802 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.230098 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.204316 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.231699 17522 raft_consensus.cc:2376] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10. Re-sending same reply.
I20260709 13:20:07.183414 21015 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:07.238678 16883 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:07.240339 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:20:07.247792 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.248000 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:07.248478 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 71512us
I20260709 13:20:07.232580 20801 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.254447 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.257025 16958 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:07.253983 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.188200 20816 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:07.239775 21015 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.262348 16801 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:20:07.263861 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:07.265512 16806 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:20:07.269848 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:07.270586 16951 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
W20260709 13:20:07.271577 21037 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.134s	user 0.004s	sys 0.000s
I20260709 13:20:07.268594 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.273972 20816 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.275422 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.279664 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.262818 20714 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:07.279868 20719 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:07.281894 20714 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.282202 19905 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:07.282776 19905 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.283100 19905 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.263546 20898 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:07.283964 20898 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:07.284034 20714 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.284420 20898 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:07.285058 16882 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.285518 16806 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:07.285640 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.286548 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.287976 20718 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.288403 16807 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:20:07.288810 16807 pending_rounds.cc:85] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 6
I20260709 13:20:07.288487 20718 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.289536 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.290624 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.290778 20718 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.287568 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.291890 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.281736 16958 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:07.282202 20719 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:07.293597 20719 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.291002 19905 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:07.289058 16807 pending_rounds.cc:107] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:20:07.296532 16807 raft_consensus.cc:2889] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:07.266987 16809 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:07.310518 16957 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:07.322384 16882 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:07.328430 19905 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:07.329185 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.332790 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.330596 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:07.259229 20532 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:07.370630 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.371658 17522 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:07.372001 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:07.384747 16876 raft_consensus.cc:2368] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10.
I20260709 13:20:07.384601 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.388497 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.389106 16809 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.394039 20532 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:07.404112 21018 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:07.404692 21018 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:07.407021 21018 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.412189 17522 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:07.413304 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.415444 20660 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.416007 20660 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.417994 20660 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:07.429629 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.438148 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.438881 16801 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:20:07.439771 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.440063 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.440809 20816 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.440860 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.441165 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.441553 20816 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:07.442245 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.442907 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:07.444751 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.443567 20816 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.444082 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.443579 17524 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:07.444427 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.444929 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.446163 17519 raft_consensus.cc:2393] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:07.443857 17518 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:07.446667 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.446880 21023 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:07.445354 17526 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.437683 21025 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:07.449044 21025 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:07.441252 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.452147 16801 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:07.452445 16806 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:07.455021 16809 raft_consensus.cc:2410] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:07.455114 17526 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:07.378001 20718 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:20:07.459718 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.458302 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.456593 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.472728 17527 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:20:07.469281 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 76796.9us
I20260709 13:20:07.457525 17519 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:07.475101 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.475840 16802 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:07.484511 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:07.485109 17522 raft_consensus.cc:2376] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9. Re-sending same reply.
I20260709 13:20:07.445518 17525 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:20:07.486796 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.456945 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.494974 17519 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:20:07.502278 17521 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 12: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:07.503556 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.500131 19791 consensus_queue.cc:1059] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:20:07.403254 21015 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.507154 17519 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:07.508461 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.509253 17525 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:20:07.515810 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.516438 17522 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:07.517985 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.516642 16804 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 12: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:20:07.518683 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.518803 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:07.508656 21015 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.519583 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:07.524204 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:07.525853 16848 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:07.526845 21015 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.529882 20898 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.530521 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:07.530949 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.531378 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:07.532047 16804 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:07.532140 16957 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:20:07.518704 17519 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:07.534621 19791 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:07.534963 19791 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:07.536047 20654 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:07.536306 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.536576 20654 raft_consensus.cc:697] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:07.537185 20770 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:07.537586 20770 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.537437 20654 consensus_queue.cc:237] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.538012 20770 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.538134 20534 consensus_queue.cc:1059] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:07.539067 20796 raft_consensus.cc:3055] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:07.499786 20781 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:20:07.540031 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.540979 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:07.541451 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.541503 21015 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:07.541780 20534 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:07.543623 20534 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.544044 20534 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.545819 20770 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.499570 20593 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:20:07.548353 20770 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:07.548920 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.549500 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.550113 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.550658 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.551194 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.551836 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.555882 20904 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:07.556248 20904 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:07.556586 20904 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.562081 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.562834 16806 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:07.563716 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.564898 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.574426 19791 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.567101 20904 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:07.569718 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.539456 20796 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:07.541564 17521 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:07.575493 19791 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:07.575407 20770 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:07.611071 20770 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:07.612301 20796 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:07.612380 20770 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.613550 20796 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.614560 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.615834 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.616456 16806 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:07.582870 16848 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:07.618842 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.621655 20904 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:07.609797 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.627293 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.628332 16806 raft_consensus.cc:2410] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:20:07.629122 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 46307.3us
W20260709 13:20:07.629222 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 300382us
I20260709 13:20:07.638474 16848 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:07.640440 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.643137 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.637878 21015 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:07.638859 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.574585 16952 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:07.585137 20898 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.651219 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.651814 16807 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:07.648300 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.649894 21025 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:07.654940 16805 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:20:07.645833 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 70133.6us
I20260709 13:20:07.573585 20534 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.659129 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.659427 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:07.656472 21017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.000s	sys 0.020s
I20260709 13:20:07.650352 21054 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.665277 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.687987 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.690335 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.658360 21025 raft_consensus.cc:697] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:07.690932 16806 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:20:07.693714 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:07.697752 16952 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:07.688761 21017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.001s	sys 0.020s
I20260709 13:20:07.699821 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:07.695787 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:07.694768 19791 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:07.700382 16957 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.701340 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:07.709327 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.712720 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.713183 16924 leader_election.cc:400] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10.
I20260709 13:20:07.713483 16924 leader_election.cc:403] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:07.716811 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:07.718008 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:07.718113 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:07.702742 20593 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:07.708712 20781 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:07.741386 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.752405 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.744132 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:07.753063 16807 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:07.758215 16806 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:07.759862 16878 raft_consensus.cc:2393] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:07.762583 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.764089 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.762253 16924 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.764683 16804 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:20:07.765611 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.766366 16802 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:20:07.767997 19791 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:07.768573 19791 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.769037 19791 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.770198 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.774916 16952 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:07.741099 20781 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.780884 16801 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:07.772748 16958 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:07.786207 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:07.786860 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.789464 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.790169 16804 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:07.783093 20781 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.789083 20714 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.797411 20714 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.798950 20534 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:07.799448 20714 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:07.791165 21025 consensus_queue.cc:237] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.811403 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.813022 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.813704 16805 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 12: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:07.814370 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.816079 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.816749 16810 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:07.817296 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.817589 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:07.818497 16952 raft_consensus.cc:2368] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
I20260709 13:20:07.821832 16957 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:07.815536 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:07.830842 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.831610 16801 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.830777 16805 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:07.835482 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.836724 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:07.837991 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.838182 16805 raft_consensus.cc:3055] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:07.838675 16805 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:07.838784 16810 raft_consensus.cc:2410] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:20:07.839926 16805 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:07.840958 16805 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:07.843869 20816 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:07.848409 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:07.849160 16957 raft_consensus.cc:2368] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:07.793632 20719 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:20:07.852360 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.828042 20785 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10.
I20260709 13:20:07.853246 21058 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:07.857676 21058 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:07.853502 20898 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:20:07.858709 21058 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:07.863284 16924 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.867467 16806 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:07.867543 19791 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:07.864290 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.869648 16850 leader_election.cc:400] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
I20260709 13:20:07.869992 16850 leader_election.cc:403] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:20:07.870154 16804 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:07.890383 16805 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:07.892457 16801 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:07.893642 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.894754 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:07.910778 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 46461.4us
I20260709 13:20:07.913789 16850 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:07.917259 19791 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:07.863193 20796 consensus_queue.cc:1059] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:20:07.923810 21039 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:07.924288 21039 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:07.924635 21039 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:07.930203 20801 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:07.930759 20801 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:07.931595 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:07.931649 20801 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:07.941169 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:07.942788 16958 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
W20260709 13:20:07.947523 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 328074us
I20260709 13:20:07.966683 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.967520 16801 raft_consensus.cc:2368] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
W20260709 13:20:07.971319 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 59694.8us
W20260709 13:20:07.987875 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 300713us
I20260709 13:20:07.989108 16850 leader_election.cc:400] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:07.989411 16850 leader_election.cc:403] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:07.918323 20949 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:07.910274 20593 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:07.988632 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
W20260709 13:20:07.990906 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 56330.5us
I20260709 13:20:07.916430 20719 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:07.996528 16848 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.013863 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:07.990644 20718 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:07.912511 20904 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:20:07.987340 20898 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.021348 16803 raft_consensus.cc:2368] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:07.995249 20593 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.028400 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:08.001700 20949 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:08.049340 20593 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:08.067227 17521 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:08.068356 21061 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:20:08.051258 21015 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:08.063176 16801 raft_consensus.cc:2410] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:20:08.100279 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.087568 21025 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:08.122110 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 227428us
I20260709 13:20:08.095865 21067 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.100167 21054 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.135159 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:08.139827 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.086764 21039 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.154942 16922 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:20:08.155216 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.129688 21025 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:08.160630 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 164209us
I20260709 13:20:08.166759 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:08.167328 16801 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:08.154608 20654 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:08.158694 20898 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.161096 21025 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:08.195806 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 206780us
I20260709 13:20:08.200075 16850 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:08.157745 21066 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:08.196705 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.206033 19791 raft_consensus.cc:3055] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:08.206390 19791 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:08.210377 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.211007 16801 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:08.203886 21058 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:08.234256 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 71833.6us
I20260709 13:20:08.215898 19791 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:08.156997 21067 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.243331 16879 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:20:08.248409 16958 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:08.204527 20654 raft_consensus.cc:697] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:08.247149 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.184523 21054 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:20:08.259316 19791 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:08.213800 20718 raft_consensus.cc:697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:20:08.263654 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 275077us
I20260709 13:20:08.264869 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.268026 16882 raft_consensus.cc:1240] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:20:08.253767 20816 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:08.239504 21075 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.208117 20898 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.280049 16879 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:08.285982 16884 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:08.213312 21066 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.186980 20949 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.213851 21074 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:20:08.291236 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.277609 20816 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:08.244226 21058 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:08.326843 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 88681us
I20260709 13:20:08.267716 21076 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:08.300815 21063 log.cc:927] Time spent T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.244s	user 0.001s	sys 0.001s
I20260709 13:20:08.339722 16922 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:08.307461 20816 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.355795 19791 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.327184 21084 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:08.360957 19791 consensus_queue.cc:1059] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:08.364313 21067 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:08.350841 21054 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:20:08.354315 20654 consensus_queue.cc:237] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:08.372354 21073 log.cc:927] Time spent T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:20:08.372462 20770 raft_consensus.cc:3055] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:08.373100 20770 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:08.357466 21070 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:20:08.383630 16880 raft_consensus.cc:2468] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
W20260709 13:20:08.386773 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 109018us
I20260709 13:20:08.388518 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.389981 16954 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:08.387539 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:08.374980 21039 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:08.374385 21087 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.379907 21084 raft_consensus.cc:697] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:08.352126 21076 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:08.401393 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 131328us
I20260709 13:20:08.407543 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:08.408174 21072 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:20:08.409715 21062 log.cc:927] Time spent T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.318s	user 0.000s	sys 0.003s
I20260709 13:20:08.409971 21066 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:08.410257 16884 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:20:08.414077 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.415069 21087 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.435016 21087 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:08.356964 20718 consensus_queue.cc:237] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.417237 21058 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:08.418218 21078 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:20:08.420560 16955 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:08.420203 21084 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.421298 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.440274 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.421993 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:08.422714 21015 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:08.423259 21092 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.442095 21092 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:08.423694 21079 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:08.423846 21025 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.443303 21079 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.444576 21025 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:08.445948 21079 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:08.424399 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.430135 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:08.431843 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 44390us
I20260709 13:20:08.446959 16959 raft_consensus.cc:2368] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
W20260709 13:20:08.427402 16850 leader_election.cc:336] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.513s (SENT)
I20260709 13:20:08.446270 21092 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:08.447486 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.448119 20898 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:08.448625 21025 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:20:08.449216 16850 leader_election.cc:336] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.565s (SENT)
I20260709 13:20:08.449831 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.450771 21025 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:20:08.451278 16850 leader_election.cc:336] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.625s (SENT)
I20260709 13:20:08.451846 16850 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:08.455142 21039 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:08.456007 21025 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.466691 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.468998 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:08.469906 20781 consensus_meta.cc:287] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.000s
I20260709 13:20:08.470320 20781 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:08.471778 21082 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:08.472381 21082 raft_consensus.cc:697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:08.473341 21082 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.478250 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.474763 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.479892 16884 raft_consensus.cc:2368] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
W20260709 13:20:08.481877 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.481958 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.491288 16879 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:08.509100 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:08.511140 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 64016us
I20260709 13:20:08.516327 21090 consensus_queue.cc:1059] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:08.516726 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:08.517352 16958 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:08.516729 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:08.519088 20719 consensus_meta.cc:287] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 13:20:08.519475 20719 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
I20260709 13:20:08.519917 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:08.520625 16885 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:08.521349 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:08.522311 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.525799 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.499852 16924 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:08.528861 16950 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:08.536568 16885 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:08.539248 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:08.379360 20770 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.539539 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.551131 16954 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:20:08.539449 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.540951 16958 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:08.548448 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:08.536001 20534 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:08.559296 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.560245 16959 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:08.556821 16950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:08.563977 16950 raft_consensus.cc:606] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:08.564174 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.564337 16950 raft_consensus.cc:614] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:08.567965 16885 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:08.568585 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.569574 16959 raft_consensus.cc:2410] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:20:08.550239 21066 raft_consensus.cc:3055] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:08.549254 20796 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:08.578248 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.580461 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.582250 16956 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:08.583777 16959 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:08.586838 16957 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:20:08.559604 21079 consensus_queue.cc:1059] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:20:08.576815 21066 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:08.587767 20816 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.588368 20901 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:08.611182 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.612056 16959 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
W20260709 13:20:08.614631 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 102189us
I20260709 13:20:08.620169 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:08.583422 20796 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.599130 20781 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:08.618419 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.624840 16955 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:08.628232 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:08.629408 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 146355us
I20260709 13:20:08.632098 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:08.635912 16775 connection.cc:256] RPC call timeout handler was delayed by -2.4370266840001023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:20:08.643045 16775 connection.cc:256] RPC call timeout handler was delayed by -2.2169690119999359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:20:08.643528 16775 connection.cc:256] RPC call timeout handler was delayed by -1.9451588629999605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 13:20:08.644115 16775 connection.cc:256] RPC call timeout handler was delayed by -1.7345588629998474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
I20260709 13:20:08.628609 20534 raft_consensus.cc:697] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:08.644439 16775 connection.cc:256] RPC call timeout handler was delayed by -1.6814588629999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:20:08.646951 16775 connection.cc:256] RPC call timeout handler was delayed by -1.6337588629999118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 13:20:08.622658 20901 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.647241 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
W20260709 13:20:08.647537 16775 connection.cc:256] RPC call timeout handler was delayed by -1.3070588629998383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 13:20:08.650836 16959 raft_consensus.cc:606] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:08.651199 16959 raft_consensus.cc:614] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:08.634886 21108 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:08.646727 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:08.653105 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.653168 16850 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:08.657516 20718 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.657475 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:08.662248 16850 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:08.663003 21096 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:08.663637 21096 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.665269 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.666057 20718 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.666399 20534 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.671630 16881 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:08.682467 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.684712 21096 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:08.685159 21096 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:08.685515 21096 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:08.640051 21066 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.651871 21084 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:20:08.687901 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:08.689033 21098 log.cc:927] Time spent T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:20:08.689113 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.690302 20901 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:08.690835 20901 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:08.697077 16957 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:20:08.703742 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:08.704427 16876 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:08.705919 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 74517.2us
I20260709 13:20:08.709818 16884 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:08.711884 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:08.696182 21099 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:20:08.710431 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:08.651384 21076 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:08.716634 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 63582.3us
I20260709 13:20:08.689059 21084 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:08.691330 20901 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:08.719858 21108 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:08.720715 20816 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:08.721657 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:08.721935 20593 consensus_meta.cc:287] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
I20260709 13:20:08.719069 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.707026 21090 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:08.726315 16883 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:08.727587 20904 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:08.730715 21113 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:08.705359 21106 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:08.740814 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.723551 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.712695 21097 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:08.736138 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:08.742053 16877 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:08.742324 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
W20260709 13:20:08.740163 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.743858 16883 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:20:08.751005 21069 log.cc:927] Time spent T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.519s	user 0.000s	sys 0.002s
I20260709 13:20:08.726672 21108 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:08.753149 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:08.740937 21106 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:08.772629 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 51075us
I20260709 13:20:08.736581 21090 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:08.764961 21108 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.792150 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:08.735466 20593 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.739089 21066 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.909626 21089 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.910156 21089 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:08.910424 21096 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.897043 21106 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:08.912494 21089 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:08.913751 21089 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.914173 21089 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:08.739331 21082 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.802323 21090 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:08.783782 16850 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:08.866756 21077 raft_consensus.cc:2955] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 4 to 9, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:20:08.918740 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 135059us
I20260709 13:20:08.919536 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.920490 21091 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:08.920624 20770 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.920945 21091 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.921391 21091 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:08.926384 21090 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.928121 21054 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.928735 20796 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:08.929391 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:08.773782 21076 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:08.930315 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 600) took 1195 ms. Trace:
I20260709 13:20:08.930974 20719 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.893977 16959 raft_consensus.cc:606] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:08.931944 16959 raft_consensus.cc:614] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:08.744422 20816 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:08.930730 16880 rpcz_store.cc:276] 0709 13:20:07.712099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.712380 (+   281us) service_pool.cc:224] Handling call
0709 13:20:08.875787 (+1163407us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54001473d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:08.907384 (+ 31597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934070400}
I20260709 13:20:08.895485 20785 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:08.940655 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.900816 16876 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
W20260709 13:20:08.902060 21100 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.250s	user 0.002s	sys 0.007s
I20260709 13:20:08.901928 21108 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.904241 20718 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:08.904404 20901 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:08.906980 16878 raft_consensus.cc:1240] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:08.743306 21097 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:08.916213 16879 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:08.943414 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.960016 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.952468 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:08.964349 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:08.964951 16882 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:20:08.940541 20816 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:08.945864 21084 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:08.963822 20719 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:08.966176 16883 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:08.968609 21076 raft_consensus.cc:697] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:08.967096 21067 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.969703 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.959375 21097 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:08.965837 21080 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:08.975867 20796 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:08.976989 21108 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:08.977609 21096 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:08.946702 21054 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:08.981549 16881 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:20:09.005826 16881 pending_rounds.cc:85] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 6
I20260709 13:20:09.006062 16881 pending_rounds.cc:107] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:20:09.006263 16881 raft_consensus.cc:2889] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:08.983704 21085 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:20:09.007887 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:09.008526 16959 raft_consensus.cc:606] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:09.008848 16959 raft_consensus.cc:614] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:08.984000 20593 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:08.981133 20816 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:08.986984 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 268769us
I20260709 13:20:08.989202 16924 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:08.966641 20949 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.994386 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:08.995204 21076 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.996803 21091 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:08.997817 21090 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:08.999456 20796 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:09.001055 20718 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:09.020066 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.020490 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:09.024956 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 238391us
I20260709 13:20:09.011894 21089 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:09.026090 16881 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:08.993129 21067 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:09.032090 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 321109us
I20260709 13:20:09.025904 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.035733 20796 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:09.040621 21122 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:09.044028 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efa1a19816094c78802287ff39e74b62"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:09.039554 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.046912 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.017807 20949 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.049880 20949 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:09.049952 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:09.051821 21067 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:09.052668 21113 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:09.053063 21118 log.cc:927] Time spent T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:20:09.030918 20593 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:20:09.053654 21113 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:20:09.054217 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 62474.1us
I20260709 13:20:09.054505 21113 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.054970 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.056386 21015 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:09.020978 20718 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:09.058224 20718 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:09.058651 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.023449 21054 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.020469 20785 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:09.059844 20785 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.060226 20785 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:09.061543 21117 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:09.062063 21117 raft_consensus.cc:697] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:09.062907 21117 consensus_queue.cc:237] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:09.065368 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.066110 17521 raft_consensus.cc:2393] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:09.019815 20534 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:20:09.068248 21105 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:09.068526 20534 raft_consensus.cc:3055] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:09.068825 21105 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:09.068898 20534 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:09.069792 21105 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.069968 20534 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.071102 20534 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.059985 21054 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:09.056540 16850 leader_election.cc:400] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
I20260709 13:20:09.074548 16850 leader_election.cc:400] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
W20260709 13:20:09.074899 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 49108.5us
W20260709 13:20:09.081481 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.076211 21054 consensus_queue.cc:1243] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer 96eaa6dafb3e4bbe914e54dc12507912 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:20:09.087774 20719 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:09.088624 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.031816 21075 consensus_queue.cc:1059] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:20:09.095268 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.095887 16806 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:09.097395 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:09.097565 21075 raft_consensus.cc:3055] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:09.097951 16803 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.099349 16802 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:09.100353 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.100672 17524 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:09.101069 16804 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 12: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:09.104624 16803 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:09.112417 16775 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:09.113758 20816 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.114022 21106 consensus_queue.cc:1059] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:09.115315 21106 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:09.116235 16775 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:20:09.122246 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 46907.3us
I20260709 13:20:09.131699 21113 raft_consensus.cc:3055] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:09.132269 21113 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:09.132440 20816 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:09.133301 21113 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.134303 20785 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:09.135172 21113 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:09.142189 16959 raft_consensus.cc:606] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:09.142535 16809 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:09.097971 21075 raft_consensus.cc:740] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:09.144186 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:09.150995 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:09.151513 17521 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:09.149904 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:09.153278 17519 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:09.150475 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:09.154593 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.155104 16950 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:09.153587 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.157217 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:09.158413 16803 raft_consensus.cc:2955] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 4 to 9, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:20:09.160276 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 44099.3us
I20260709 13:20:09.161012 17523 raft_consensus.cc:2410] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:20:09.157433 16809 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:09.163836 17527 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:20:09.141116 20816 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:09.160126 20901 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:09.169499 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.170117 16806 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:09.170569 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:09.175750 17520 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:20:09.176694 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:09.176694 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:09.177258 17519 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:09.175843 20816 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.178293 21077 consensus_queue.cc:1059] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:09.142504 21090 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:20:09.179747 17526 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.179600 21075 consensus_queue.cc:260] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.179617 20816 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:09.164999 20719 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:09.184303 20719 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.186753 20719 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:09.188235 16775 leader_election.cc:400] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:20:09.188647 16775 leader_election.cc:403] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:09.169011 16850 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:09.193215 17521 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:09.194720 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:09.195662 16950 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:20:09.194718 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:09.137074 20718 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:09.204061 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.210619 16806 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:09.210800 16803 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:20:09.206453 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:09.211664 17521 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 12: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:09.207787 17526 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:09.201598 20785 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:09.208945 21025 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:09.212010 16958 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:09.216925 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 49690us
I20260709 13:20:09.217715 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:09.221829 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:09.223167 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:09.223745 16950 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
I20260709 13:20:09.224050 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:09.224691 16810 raft_consensus.cc:2368] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12.
I20260709 13:20:09.228102 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:20:09.227895 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:09.258072 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.258854 16878 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:09.256249 16880 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:20:09.257937 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:09.234938 17492 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.261364 16879 raft_consensus.cc:2393] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:09.229193 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:09.263535 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.265439 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:09.228847 20901 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:20:09.265695 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:09.266283 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.265138 17519 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:09.255050 21077 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.280143 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:09.280877 17519 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:09.265722 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 48076.5us
I20260709 13:20:09.268981 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:09.269021 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:09.274085 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:09.264285 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:09.283034 17521 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.215432 21025 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.288720 21025 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:09.296097 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:09.296705 16884 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:09.277562 16882 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:09.300676 20718 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:09.301285 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:09.302673 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:09.278223 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:09.303205 20593 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:09.304102 16803 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:09.304908 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:09.305042 20593 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.305913 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.306460 16803 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 7.
I20260709 13:20:09.307258 16801 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:09.288049 16953 raft_consensus.cc:2368] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9.
W20260709 13:20:09.288230 21128 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:20:09.302767 21079 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:09.287513 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.318905 16805 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:09.303495 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:09.230301 20719 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:20:09.270332 21123 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.270516 21108 raft_consensus.cc:2804] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:09.315354 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:09.325532 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:09.326303 17519 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:20:09.328631 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.326367 16804 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:09.320753 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 57315.7us
I20260709 13:20:09.336308 16882 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:09.337348 17521 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:09.339108 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.339607 16924 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:09.313488 21090 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.318697 21079 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.313154 20816 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.333642 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:09.314085 21077 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.348263 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.349080 17526 raft_consensus.cc:2376] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9. Re-sending same reply.
I20260709 13:20:09.349924 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.350135 21077 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:09.350620 17526 raft_consensus.cc:2393] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:09.352509 16805 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:09.352728 21097 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:09.354692 21097 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:09.338455 21106 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:09.357530 21106 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.323062 21074 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:09.341857 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.345350 20949 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:09.346100 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:09.348333 21126 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:09.365578 16882 raft_consensus.cc:2393] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:09.365556 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:09.366981 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.351359 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.360373 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.351526 16884 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:09.360543 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:09.365073 16922 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:09.369657 16922 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:09.368191 17526 raft_consensus.cc:2410] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:20:09.374541 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.366349 16953 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:09.376807 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:09.377569 16805 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:09.377758 16884 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:09.340476 20901 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.325172 21113 consensus_queue.cc:1059] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:20:09.339178 21108 raft_consensus.cc:697] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:09.380784 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.381767 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.383952 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:09.358811 21079 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.330484 20785 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:20:09.366462 20816 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.330322 20796 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:20:09.406066 21087 consensus_queue.cc:1059] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:09.406997 21087 raft_consensus.cc:3055] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:09.407387 21087 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:09.375953 21092 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:09.376027 21105 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:09.365556 21126 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.401162 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:09.413689 16882 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:09.338315 21067 consensus_queue.cc:1059] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:20:09.366256 20949 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.404282 20801 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:09.404661 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:09.376106 21089 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:09.397223 16884 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:09.398733 16804 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
W20260709 13:20:09.411899 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 51586.2us
I20260709 13:20:09.407467 20816 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:09.371850 21123 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:20:09.403014 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.415488 21126 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:09.428515 21108 consensus_queue.cc:237] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.400240 21025 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.402956 20901 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:09.404202 21093 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:09.412091 21105 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.419055 21112 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.385195 21077 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:20:09.411386 21092 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:09.416496 21122 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:09.457374 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 87855.8us
W20260709 13:20:09.516800 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 114001us
I20260709 13:20:09.456460 20949 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:09.526741 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 157133us
I20260709 13:20:09.529201 21105 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:09.534174 20901 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:09.537247 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.519459 21095 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.519251 21089 raft_consensus.cc:697] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:09.556170 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.556905 16804 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:09.541893 21092 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.566260 16804 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:09.568529 16775 leader_election.cc:400] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:20:09.568972 16775 leader_election.cc:403] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:09.572937 21089 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.555330 21106 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:09.529661 21087 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.565433 21144 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:09.616269 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 74872.2us
I20260709 13:20:09.621450 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:09.615753 21141 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:09.635540 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 67190.1us
I20260709 13:20:09.636555 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:09.638075 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.639665 20534 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.640362 20534 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.643033 20534 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:09.654201 21124 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.552s	user 0.002s	sys 0.000s
W20260709 13:20:09.655862 21130 log.cc:927] Time spent T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.485s	user 0.002s	sys 0.000s
I20260709 13:20:09.660379 17520 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:09.661713 17520 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:09.622834 21095 consensus_queue.cc:1059] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:20:09.666355 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:09.673929 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 52545.3us
I20260709 13:20:09.675642 16922 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:09.677325 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:09.679139 16922 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:09.628175 21067 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:20:09.692430 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:09.678069 21144 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:20:09.684854 20781 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:09.711345 21121 log.cc:927] Time spent T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.659s	user 0.004s	sys 0.003s
I20260709 13:20:09.665267 21079 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:09.714543 21112 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:09.719089 20796 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.719947 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:09.720808 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.686094 21145 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:09.714146 16807 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:09.695324 21025 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:09.695086 21109 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.692176 20534 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:09.741971 16850 leader_election.cc:336] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.516s (SENT)
I20260709 13:20:09.769161 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:09.685761 21123 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:09.634626 21141 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.690898 21150 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:20:09.766021 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 45277us
I20260709 13:20:09.774384 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:09.720824 21091 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:09.784590 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:09.728905 21077 consensus_queue.cc:1059] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:20:09.740631 21080 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 13:20:09.786979 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 45055.8us
I20260709 13:20:09.777784 21143 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:09.792160 16809 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:09.792896 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:09.793256 16809 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:09.781001 20801 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:09.748978 20796 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.797271 16958 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:20:09.784006 21145 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:09.785416 21144 raft_consensus.cc:2764] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:09.811908 21143 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:09.812506 21143 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:09.812958 21143 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:09.785514 21054 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:09.816901 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:09.805400 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:09.795997 20904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.009s	sys 0.021s
I20260709 13:20:09.821967 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:09.797017 21112 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:09.795265 21025 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.823395 16953 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:09.804368 16809 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:09.830035 16809 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.831908 16954 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:20:09.824035 20904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.009s	sys 0.021s
I20260709 13:20:09.825002 21090 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:09.837597 16877 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:09.796375 21123 consensus_queue.cc:1059] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:20:09.840435 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:09.844245 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:09.800209 20901 consensus_queue.cc:1059] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:20:09.845616 16876 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:20:09.853673 17519 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:09.854133 16883 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:09.834681 21112 raft_consensus.cc:697] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:09.861862 21080 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:20:09.864691 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:09.865782 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:09.865919 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.866314 16954 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:09.867026 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:20:09.868176 21148 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:20:09.868796 16882 raft_consensus.cc:1240] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:09.869946 16882 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:09.846761 21067 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:09.834877 21025 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.881040 16954 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:20:09.882380 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.882881 16850 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:09.884500 21080 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:09.885040 21080 raft_consensus.cc:697] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:09.885483 20770 raft_consensus.cc:993] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:09.885808 21141 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:09.885926 20770 raft_consensus.cc:1081] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:09.885829 21080 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.886772 21126 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.887357 21113 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:09.828406 21145 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:09.888374 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:09.906973 16775 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.908375 21147 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:09.919217 21153 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:20:09.931504 21075 raft_consensus.cc:3060] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.938295 21151 raft_consensus.cc:3055] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:09.938822 21151 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:09.940492 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.940212 21151 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.941431 16806 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:09.941843 21151 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:09.942387 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.890239 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:09.892993 16878 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:09.923362 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.871887 21054 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:20:09.944464 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.946487 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:09.970211 16802 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:09.943647 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.951565 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.955268 17525 raft_consensus.cc:2393] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:09.955535 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.902951 21113 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:09.965369 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:09.877765 21077 consensus_queue.cc:1059] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:20:09.881847 21067 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:09.981841 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:09.986783 21113 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:09.979517 16882 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:09.972873 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:09.827651 21150 raft_consensus.cc:697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:09.950454 21082 raft_consensus.cc:3055] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:09.957157 21079 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:09.996847 16850 leader_election.cc:336] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 1.571s (SENT)
I20260709 13:20:10.011571 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:09.990955 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:09.961401 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:10.012984 21112 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:10.017800 16803 pending_rounds.cc:85] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 5
I20260709 13:20:10.018143 16803 pending_rounds.cc:107] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:20:10.018396 16803 raft_consensus.cc:2889] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:09.831485 21106 consensus_queue.cc:1175] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" responder_term: 12 status { last_received { term: 9 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:10.020617 21126 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:10.021548 21025 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:10.010545 21082 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:10.022894 21082 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:10.023856 21082 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.024957 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:10.026019 21154 log.cc:927] Time spent T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:20:10.026729 21147 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:10.030081 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 107340us
I20260709 13:20:10.030983 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:10.043846 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:10.046396 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:10.047048 16959 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:10.049270 16850 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:10.012416 21113 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:10.078753 16881 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:10.053195 21147 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.061975 21123 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:10.064046 21074 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.008s	sys 0.008s
I20260709 13:20:10.082261 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:10.082981 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:10.045615 21025 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.013067 21167 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:10.150511 16959 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:20:10.151293 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:10.162586 17519 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:10.151712 17521 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:10.053998 20898 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:10.150171 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:10.155696 16802 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:10.168113 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:10.170737 16882 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
W20260709 13:20:10.171015 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 87516.8us
I20260709 13:20:10.172111 17492 leader_election.cc:400] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9.
I20260709 13:20:10.172461 17492 leader_election.cc:403] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:20:10.161430 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:10.175001 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
W20260709 13:20:10.161314 21074 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.008s	sys 0.008s
I20260709 13:20:10.178987 17492 leader_election.cc:400] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12.
I20260709 13:20:10.194783 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:10.195420 16802 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:20:10.194980 17492 leader_election.cc:403] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:20:10.174587 21159 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:20:10.201679 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:10.174427 20898 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.173739 21090 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:10.204735 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:10.168823 21077 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:10.183198 20816 raft_consensus.cc:2764] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:10.184809 20796 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:10.192390 21074 raft_consensus.cc:697] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:10.220587 16802 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:10.183444 21156 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9.
I20260709 13:20:10.200587 21157 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12.
I20260709 13:20:10.208026 20898 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:10.231833 21105 consensus_meta.cc:287] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.669s	user 0.010s	sys 0.012s
W20260709 13:20:10.233629 21076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.193s	user 0.009s	sys 0.016s
I20260709 13:20:10.269448 16957 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:20:10.270653 16957 pending_rounds.cc:85] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 10
I20260709 13:20:10.271183 16957 pending_rounds.cc:107] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:20:10.272135 16957 raft_consensus.cc:2889] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:10.182919 21150 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:10.264674 21076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.009s	sys 0.016s
I20260709 13:20:10.230326 21077 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:10.277808 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.268574 16802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efa1a19816094c78802287ff39e74b62"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:20:10.283365 16802 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:10.283758 16802 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:10.274225 20781 consensus_meta.cc:287] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.563s	user 0.015s	sys 0.005s
I20260709 13:20:10.289937 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:10.274435 20714 raft_consensus.cc:3055] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:10.296809 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:10.298163 17522 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:10.297640 17527 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:10.279687 21157 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:20:10.303625 21169 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:10.303949 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:10.304451 16883 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:10.279908 21156 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:20:10.311131 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:10.311165 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:10.269135 21105 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:10.305400 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:10.325506 17524 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:10.287618 21067 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:10.296777 21178 log.cc:927] Time spent T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:20:10.306679 20949 consensus_meta.cc:287] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.754s	user 0.008s	sys 0.004s
I20260709 13:20:10.357892 20949 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:10.359942 20949 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:10.360634 16952 raft_consensus.cc:2368] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9.
I20260709 13:20:10.296231 20714 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:20:10.320735 21170 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:20:10.311888 16877 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:10.295442 20781 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:10.337589 17523 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:20:10.291599 21143 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:10.327713 16802 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:10.323978 21169 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:10.347288 21092 consensus_meta.cc:287] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.780s	user 0.017s	sys 0.003s
W20260709 13:20:10.350579 21120 log.cc:927] Time spent T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 1.259s	user 0.002s	sys 0.003s
I20260709 13:20:10.354620 17526 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:10.355932 21105 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:10.306337 21076 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:10.365622 17524 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
W20260709 13:20:10.374094 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 328930us
W20260709 13:20:10.376717 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 181683us
W20260709 13:20:10.395598 16848 leader_election.cc:336] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 1.578s (SENT)
W20260709 13:20:10.399003 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:10.398530 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:10.402240 21183 consensus_queue.cc:1059] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:10.403159 21183 consensus_queue.cc:1243] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer 4b60b701acc7473e87e3e529a2a34689 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:20:10.408542 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:10.375476 21147 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:10.435597 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:10.436326 16803 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:10.439586 16956 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:10.443699 16956 raft_consensus.cc:1240] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:10.451089 16956 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:10.314275 21074 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:10.434104 21076 raft_consensus.cc:697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:10.441642 20816 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:10.393810 21092 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:10.475533 21174 consensus_queue.cc:1059] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:20:10.447232 21054 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.479964 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:10.480608 16957 raft_consensus.cc:3055] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:10.480898 16957 raft_consensus.cc:740] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:10.481588 16957 consensus_queue.cc:260] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:10.482407 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 673) took 1262 ms. Trace:
I20260709 13:20:10.482878 16950 raft_consensus.cc:2368] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12.
I20260709 13:20:10.484076 16807 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:20:10.484493 16807 pending_rounds.cc:85] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 7
I20260709 13:20:10.421298 21145 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:20:10.484743 16807 pending_rounds.cc:107] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:10.485023 16807 raft_consensus.cc:2889] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:10.482697 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:10.482950 17526 rpcz_store.cc:276] 0709 13:20:09.220807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.523069 (+302262us) service_pool.cc:224] Handling call
0709 13:20:09.523419 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.392327 (+868908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:10.482192 (+ 89865us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54005d0a54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:10.482348 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911034240}
W20260709 13:20:10.494856 21192 log.cc:927] Time spent T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:20:10.469563 20816 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:10.496059 20816 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.450688 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:10.503494 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 52858.9us
I20260709 13:20:10.494314 21076 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:10.505133 21174 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:10.502655 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 94221.2us
I20260709 13:20:10.520565 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:10.514616 21190 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:20:10.515094 21092 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:10.522414 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:10.532877 16848 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:10.530475 16803 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:10.537477 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:10.538080 17526 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:10.545415 21143 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:10.458510 20714 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:10.524262 21054 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:10.525280 21077 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:10.555620 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:10.558189 16775 leader_election.cc:400] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12.
I20260709 13:20:10.559900 16775 leader_election.cc:403] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:10.565384 16775 leader_election.cc:400] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9.
I20260709 13:20:10.565768 16775 leader_election.cc:403] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:10.572378 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:10.552919 21015 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.006s	sys 0.005s
I20260709 13:20:10.524739 21167 consensus_queue.cc:1059] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:20:10.585045 16952 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:10.587805 21191 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:10.588276 21204 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:10.552546 21157 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:20:10.596134 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:10.584093 21091 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:10.584673 21147 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9.
W20260709 13:20:10.593237 21015 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.007s	sys 0.006s
I20260709 13:20:10.564410 21143 consensus_queue.cc:1059] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:20:10.605291 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 70970.9us
I20260709 13:20:10.569461 20719 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:10.605451 21167 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:10.673635 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 151304us
I20260709 13:20:10.648015 21150 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:10.737278 21150 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:10.691519 21160 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.827s	user 0.006s	sys 0.001s
I20260709 13:20:10.682755 21080 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.711781 20816 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:10.662184 21167 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:10.740056 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:10.838119 21080 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:10.919030 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 179060us
I20260709 13:20:10.919872 16850 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:10.921455 16953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 479) took 1227 ms. Trace:
I20260709 13:20:10.921924 16953 rpcz_store.cc:276] 0709 13:20:09.689555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.689682 (+   127us) service_pool.cc:224] Handling call
0709 13:20:10.916433 (+1226751us) spinlock_profiling.cc:243] Waited 79.1 ms on lock 0x7b54000b8954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:10.917024 (+   591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181846272}
I20260709 13:20:10.844501 20719 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.924152 20719 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:10.926288 20719 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:10.695570 20898 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:10.917529 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:10.927148 21150 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:10.955788 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:10.957324 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 361231us
I20260709 13:20:10.971355 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:10.950723 20719 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:10.981946 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1975) took 1432 ms. Trace:
I20260709 13:20:10.982434 16804 rpcz_store.cc:276] 0709 13:20:09.547655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.566997 (+ 19342us) service_pool.cc:224] Handling call
0709 13:20:09.567319 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.616045 (+ 48726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.616090 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.623047 (+  6957us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.721356 (+ 98309us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b18003cc5e0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec360d1 00007feeef051a0f
0709 13:20:09.791087 (+ 69731us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:09.791144 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.791238 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:10.608706 (+817468us) spinlock_profiling.cc:243] Waited 8.92 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:10.980217 (+371511us) raft_consensus.cc:1685] finished
0709 13:20:10.980242 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:10.980382 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79676,"raft.queue_time_us":54359,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":10122,"spinlock_wait_cycles":39507072,"thread_start_us":69546,"threads_started":1,"wal-append.queue_time_us":207188}
I20260709 13:20:10.983987 21214 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:10.968602 20901 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:10.970980 21212 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.992946 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:10.979281 21205 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:10.979523 21091 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:10.995177 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:10.997862 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.007944 21204 raft_consensus.cc:697] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:11.016405 21204 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.017373 16951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 2318) took 1212 ms. Trace:
I20260709 13:20:11.017765 16951 rpcz_store.cc:276] 0709 13:20:09.804715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.804819 (+   104us) service_pool.cc:224] Handling call
0709 13:20:09.830028 (+ 25209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:09.830306 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:09.994188 (+163882us) log.cc:844] Serialized 14 byte log entry
0709 13:20:10.394994 (+400806us) log.cc:844] Serialized 14 byte log entry
0709 13:20:11.016875 (+621881us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18003304c0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf23c0a 00007feef5663219 00007feeebfaba40 00007feeebfa64e4 00007feeebfa6455 00007feeef08e060 00007feeef0a0716 00007feeef0b1287 00007feeef0b1208
0709 13:20:11.017026 (+   151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:11.017076 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:11.017117 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.017182 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.017298 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13871,"prepare.queue_time_us":189558,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":6264,"raft.queue_time_us":5296,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":6667,"spinlock_wait_cycles":2995328,"thread_start_us":544933,"threads_started":2,"wal-append.queue_time_us":445849}
I20260709 13:20:11.011099 21205 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.020993 21205 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.021065 21091 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:11.021540 21205 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.022040 21205 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:10.989554 21213 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:11.024907 21213 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:11.022058 21091 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:11.027612 21205 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.028695 20770 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.029150 20770 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.031064 20770 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:11.032239 17525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44648 (request call id 672) took 1812 ms (client timeout 2051 ms). Trace:
W20260709 13:20:11.032666 17525 rpcz_store.cc:269] 0709 13:20:09.219985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.383715 (+163730us) service_pool.cc:224] Handling call
0709 13:20:11.031995 (+1648280us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54002805d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:11.032163 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154375936}
I20260709 13:20:11.034540 16922 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:11.035336 21092 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:11.035737 21092 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:11.036098 21092 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.039845 21089 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:11.040516 21080 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.044073 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:11.044193 21092 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.045102 16959 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:11.046505 21092 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.052253 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:11.052381 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:11.053349 16806 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:11.053550 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:11.054499 16803 raft_consensus.cc:2393] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:11.054817 16806 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 14. Ops: []
I20260709 13:20:11.057070 16950 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:20:11.058650 16806 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:10.992439 21015 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:11.009433 20901 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.062204 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:10.984522 21214 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.066656 20901 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.067471 21075 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.068115 21075 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.070650 21214 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.072032 20816 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.072852 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2000) took 1116 ms. Trace:
I20260709 13:20:11.066682 21109 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.073252 16878 rpcz_store.cc:276] 0709 13:20:10.029505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.029680 (+   175us) service_pool.cc:224] Handling call
0709 13:20:10.054627 (+ 24947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.205565 (+150938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:10.205600 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:10.205642 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:10.205677 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.072649 (+866972us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400135e54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:11.072700 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.072801 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346663296}
I20260709 13:20:11.074096 21109 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.076503 16959 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:11.077111 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:11.071300 21075 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.079025 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:11.080545 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.081202 16954 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:11.080305 16922 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:11.084647 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 475584us
I20260709 13:20:11.088285 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:11.089424 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:11.086584 16848 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:11.060437 21191 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12.
I20260709 13:20:11.112887 17524 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:11.126914 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:11.127653 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:11.149921 17526 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:11.150223 16955 raft_consensus.cc:1275] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:11.111897 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:11.150837 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:11.151139 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:11.151428 16879 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.151705 16884 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:11.151540 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:11.153383 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:11.154124 17527 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.154625 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:11.156061 17525 raft_consensus.cc:2368] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11.
I20260709 13:20:11.072886 20898 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.089634 21126 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:11.173592 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:11.190012 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:11.173671 16954 raft_consensus.cc:1240] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:20:11.187060 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:11.192442 16878 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.148633 21080 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:11.199388 16848 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:11.088932 20770 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:20:11.153072 21015 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.010473 21212 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.010715 21167 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.172931 21214 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:11.211794 21174 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:11.214874 21087 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:11.216449 17527 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:11.217916 21183 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:11.218479 21183 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.226931 21157 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.227504 21157 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.229565 16809 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:20:11.229950 16809 pending_rounds.cc:85] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 5
I20260709 13:20:11.230158 16809 pending_rounds.cc:107] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:20:11.230373 16809 raft_consensus.cc:2889] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:11.231010 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1984) took 1506 ms. Trace:
I20260709 13:20:11.232151 17519 raft_consensus.cc:2410] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:20:11.233132 21126 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:11.233382 16802 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.233946 16802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:43934 (request call id 1986) took 1336 ms. Trace:
I20260709 13:20:11.234234 21126 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:11.235884 21165 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 1.272s	user 0.012s	sys 0.000s
I20260709 13:20:11.237221 16805 raft_consensus.cc:3055] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:11.237277 21183 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.237695 16805 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:11.238627 16805 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.202621 21093 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:11.240094 21093 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.149060 20781 consensus_queue.cc:1059] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:20:11.237727 21109 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:11.155143 21089 consensus_queue.cc:1059] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:20:11.152822 21202 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:20:11.234270 16802 rpcz_store.cc:276] 0709 13:20:09.956412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.258514 (+302102us) service_pool.cc:224] Handling call
0709 13:20:11.232876 (+974362us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b4c0004f840. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed362a20 00007feeed373a29 00007feeed37413f 00007feeed3382ab 00007feeed365f3c 00007feeed3663fe 00007feeed5f388b 00007feeeeff2495 00007feeef04330f 00007feeef08da55 00007feef405dcd0
0709 13:20:11.233852 (+   976us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10471296}
W20260709 13:20:11.243592 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 248507us
I20260709 13:20:11.245357 16848 leader_election.cc:400] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11.
I20260709 13:20:11.231308 16809 rpcz_store.cc:276] 0709 13:20:09.724287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.784419 (+ 60132us) service_pool.cc:224] Handling call
0709 13:20:09.792058 (+  7639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.229287 (+1437229us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400395420. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00ddc0 00007feeef098d87 00007feeef099470 00007feeef095d8f 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c
0709 13:20:11.230781 (+  1494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.230958 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315977984}
I20260709 13:20:11.250846 16848 leader_election.cc:403] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:20:11.195241 16879 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
W20260709 13:20:11.251562 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 51086.4us
I20260709 13:20:11.205090 21205 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:11.252650 16848 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:11.189831 21191 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:20:11.172567 21217 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.154s
I20260709 13:20:11.243316 20816 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.174430 20901 consensus_queue.cc:765] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Error trying to read ahead of the log while preparing peer request: Incomplete: Op with index 8 is ahead of the local log (next sequential op: 8). Destination peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.689s
I20260709 13:20:11.248620 21075 raft_consensus.cc:3055] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:11.255483 21213 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:11.264516 21213 raft_consensus.cc:697] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:11.264601 20816 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.265729 21213 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.266826 20816 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.269554 21219 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.270195 21219 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.272218 21093 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:11.273499 21219 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.275326 21212 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.280591 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:11.281308 16803 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:11.281401 16878 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:11.281519 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:11.254468 21091 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:11.263833 21075 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:11.288530 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:11.254220 21205 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.208789 21015 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.287600 16802 raft_consensus.cc:3055] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:11.295460 16802 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:11.254231 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:11.203686 20898 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:20:11.292994 16808 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:11.261250 21109 raft_consensus.cc:3055] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:20:11.297582 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 207254us
I20260709 13:20:11.262665 21106 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:11.311210 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.253976 21214 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.297274 16802 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.297140 21205 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.298839 20816 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:11.354830 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 270506us
I20260709 13:20:11.320364 21109 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:11.358131 20816 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:11.362984 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 269672us
I20260709 13:20:11.361565 20816 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:11.356405 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 102240us
I20260709 13:20:11.320811 21074 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:11.358846 21106 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:11.329941 16848 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.4:35369 timed out after 2.189s (SENT) [suppressed 37 similar messages]
I20260709 13:20:11.360561 21204 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:11.359864 21220 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:20:11.371186 21225 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:20:11.376665 21015 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.378258 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:11.381523 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:11.390945 21015 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:11.379956 20781 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:11.391508 21015 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.392010 20781 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.393509 21117 raft_consensus.cc:3055] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:11.393672 21015 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.393903 20781 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:11.394505 20781 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.394984 20781 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.381676 17524 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:11.367830 21228 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:20:11.366683 21191 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:11.378410 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:11.401953 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:11.360327 21075 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.393942 21117 raft_consensus.cc:740] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:11.403088 21090 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:11.395303 21109 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.379750 21204 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:11.422015 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 54968.4us
I20260709 13:20:11.509918 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:11.603770 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 277054us
I20260709 13:20:11.672127 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:11.904632 16950 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:11.904999 16924 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:11.906479 16924 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:11.907208 21077 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:11.907828 20949 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:11.908567 21077 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:20:11.691618 16774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.008s	sys 0.007s
W20260709 13:20:11.909082 16774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.009s	sys 0.007s
I20260709 13:20:11.909034 21077 raft_consensus.cc:697] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:11.909935 21077 consensus_queue.cc:237] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.911753 16958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 2320) took 2106 ms. Trace:
I20260709 13:20:11.912145 16958 rpcz_store.cc:276] 0709 13:20:09.805340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.916972 (+111632us) service_pool.cc:224] Handling call
0709 13:20:10.916592 (+999620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.059341 (+142749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.059373 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.061407 (+  2034us) log.cc:844] Serialized 26 byte log entry
0709 13:20:11.297828 (+236421us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:11.297879 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.297962 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.822920 (+524958us) raft_consensus.cc:1685] finished
0709 13:20:11.822939 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:11.911507 (+ 88568us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54000b8950. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:11.911696 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142256,"raft.queue_time_us":144105,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":2298900736,"thread_start_us":235663,"threads_started":1,"wal-append.queue_time_us":236439}
I20260709 13:20:11.913870 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:11.914634 16958 raft_consensus.cc:2410] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:20:11.914702 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:11.915342 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:11.754698 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:11.921094 16958 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:11.560269 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.924028 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:11.598659 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:12.058944 17518 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:20:11.566859 17519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44626 (request call id 893) took 1272 ms. Trace:
I20260709 13:20:12.061035 17519 rpcz_store.cc:276] 0709 13:20:10.294600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.294739 (+   139us) service_pool.cc:224] Handling call
0709 13:20:11.566596 (+1271857us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b540055e954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:11.566782 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116011264}
I20260709 13:20:11.586180 20770 raft_consensus.cc:3055] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:12.093353 20770 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:12.094213 20770 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.489063 20816 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.433292 21075 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.504736 20781 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:11.416023 21087 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:11.421291 21090 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:11.491267 21091 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11.
I20260709 13:20:11.490240 21106 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.453522 21109 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:11.463390 21117 consensus_queue.cc:260] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.417200 21093 consensus_queue.cc:1048] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:20:11.605546 17523 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:11.698706 21163 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:11.624923 21161 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 1.636s	user 0.009s	sys 0.018s
I20260709 13:20:12.119541 17520 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 13: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:12.120293 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 1977) took 2507 ms. Trace:
I20260709 13:20:11.402400 21191 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:11.735612 21199 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 1.273s	user 0.000s	sys 0.013s
I20260709 13:20:11.446702 21205 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.150101 21205 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:11.508670 21209 log.cc:927] Time spent T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.850s	user 0.002s	sys 0.008s
I20260709 13:20:11.745110 21211 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:11.490788 21204 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.492409 21214 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.602052 21234 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.155946 21234 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.503994 21229 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.158540 21234 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.158381 21229 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.835320 16807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 2081) took 2027 ms. Trace:
W20260709 13:20:11.840052 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 510085us
I20260709 13:20:12.160673 16807 rpcz_store.cc:276] 0709 13:20:09.808207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.981040 (+172833us) service_pool.cc:224] Handling call
0709 13:20:09.981316 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:10.491960 (+510644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.835065 (+1343105us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5400266454. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:11.835261 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155335040}
I20260709 13:20:12.162071 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:12.163184 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:11.861651 16805 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.167091 21015 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:11.880584 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.167896 21257 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:12.167623 21015 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.168463 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.168422 21257 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.170259 21015 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.170485 21257 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.170797 21015 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:12.170953 21257 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:11.897149 16951 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:12.171432 21257 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.900117 21172 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:12.174618 21172 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.175344 21257 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.176256 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:12.176744 21172 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.178814 21229 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.754917 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:11.921145 16955 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
W20260709 13:20:11.758517 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.180491 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:12.181304 16922 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:12.181640 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:12.182381 17519 raft_consensus.cc:2410] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:20:12.183405 17525 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:11.920482 21202 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:12.183393 21089 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:12.184507 21228 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:12.185243 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:11.927793 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.184103 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:11.927150 21217 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:11.929518 21220 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:12.171274 21015 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.186482 21220 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.186414 21217 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.188666 21220 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.931272 16958 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:12.188840 21217 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.925840 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:11.941170 21074 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:12.189653 21074 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.189819 20949 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.190315 20949 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.942714 21241 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:12.191109 21241 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.191478 21241 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.192291 20949 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:11.944849 21253 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.193045 21253 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.193941 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:12.194519 16954 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.195019 21253 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.953869 21067 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.195647 21067 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.197521 21067 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.958603 16706 catalog_manager.cc:5697] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 9 to 11, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 11 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:12.198733 16706 catalog_manager.cc:5697] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:12.200179 16706 catalog_manager.cc:5697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:12.200901 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 275098us
I20260709 13:20:12.201552 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:11.960529 16925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.003s	sys 0.012s
W20260709 13:20:12.202491 16925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.004s	sys 0.013s
W20260709 13:20:12.203117 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.203863 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.201670 16706 catalog_manager.cc:5697] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:11.969336 20898 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:11.952507 16705 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58326 (request call id 274) took 19538 ms (client timeout 15000 ms). Trace:
I20260709 13:20:12.205355 16706 catalog_manager.cc:5697] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:12.206085 20781 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:12.206614 20781 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:11.974009 16802 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:12.209803 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:11.987946 21157 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:11.994241 21123 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:12.212414 21123 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.214504 21123 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.997778 21112 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:12.215178 21112 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.003271 20714 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:12.009222 21167 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:20:12.021209 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 74234.9us
W20260709 13:20:12.030118 16773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.011s	sys 0.016s
W20260709 13:20:12.220093 16773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.012s	sys 0.016s
I20260709 13:20:12.034742 16952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 488) took 1001 ms. Trace:
I20260709 13:20:12.046523 21076 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:12.068326 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:12.068799 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.068112 20901 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:12.070312 21219 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:12.080880 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.089377 16808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 1991) took 1039 ms. Trace:
I20260709 13:20:12.095429 20770 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.118274 21236 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.118145 21163 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.120652 16801 rpcz_store.cc:276] 0709 13:20:09.612856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:09.728061 (+115205us) service_pool.cc:224] Handling call
0709 13:20:09.728379 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:09.728667 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:09.728692 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:09.729103 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:20:09.836342 (+107239us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:09.836381 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:09.836457 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:11.624315 (+1787858us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:12.119973 (+495658us) raft_consensus.cc:1685] finished
0709 13:20:12.119998 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.120219 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16594,"raft.queue_time_us":4521,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6157,"spinlock_wait_cycles":7425280,"thread_start_us":56376,"threads_started":1,"wal-append.queue_time_us":133031}
I20260709 13:20:12.124003 21087 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:12.128154 20816 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.123862 21090 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.256008 21236 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.264030 21241 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.264689 21236 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:12.126812 21177 consensus_queue.cc:1175] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" responder_term: 8 status { last_received { term: 6 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: [7.6-7.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:12.240033 21123 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.132052 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:12.266790 21123 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.268318 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:12.268872 16810 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:12.269690 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:12.270246 16810 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:12.133266 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:12.134055 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:12.143847 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:12.272122 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.272691 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:12.272980 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:12.144670 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:12.273276 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.273808 16804 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:12.274360 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.274911 16950 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:12.145218 21191 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.153028 21211 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.176807 17522 raft_consensus.cc:1813] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Handling vote request from an unknown peer 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:12.276612 17522 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:12.277439 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:12.277662 21211 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.278688 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:12.179935 16953 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.184474 21202 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.279738 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:12.281260 21202 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:11.922097 21215 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:12.281957 21215 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:11.924949 16957 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.186053 17526 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:11.929814 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.204021 21240 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:11.967803 20719 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:12.212682 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:12.004946 21113 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.218400 21112 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.221395 16848 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:12.296837 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:12.297582 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 76249.7us
I20260709 13:20:12.299221 21204 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:12.299911 21240 raft_consensus.cc:697] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:12.235047 21106 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.300798 21240 consensus_queue.cc:237] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.300995 21106 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.303712 21106 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.235312 21235 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.303831 20719 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.304509 21235 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.305953 20719 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.306457 20719 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:12.307015 21235 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.222146 21167 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.307426 21191 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:12.235519 21076 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.307986 21191 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.308928 21167 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.309558 21076 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:12.296865 21113 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.212013 21157 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:20:12.203178 16924 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:12.220516 16952 rpcz_store.cc:276] 0709 13:20:11.033744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.043604 (+  9860us) service_pool.cc:224] Handling call
0709 13:20:11.055895 (+ 12291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:11.071951 (+ 16056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:11.071994 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:11.072515 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:20:11.292017 (+219502us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:11.292056 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:11.292120 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:12.034519 (+742399us) raft_consensus.cc:1685] finished
0709 13:20:12.034541 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:12.034685 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15591,"raft.queue_time_us":16824,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":219083,"threads_started":1,"wal-append.queue_time_us":352997}
I20260709 13:20:12.229199 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:12.229951 16805 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:12.216806 16954 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:12.235497 16808 rpcz_store.cc:276] 0709 13:20:11.049807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.051958 (+  2151us) service_pool.cc:224] Handling call
0709 13:20:12.089198 (+1037240us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400265f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:12.089318 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308890496}
I20260709 13:20:12.239290 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:12.239509 16802 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:20:12.315698 16805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 2096) took 2496 ms. Trace:
I20260709 13:20:12.316125 17524 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:12.240300 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.244273 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:12.244788 20781 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:12.203868 21092 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:12.257287 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:12.188675 21015 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.266003 21241 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:12.273422 16806 raft_consensus.cc:2393] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 14: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:12.285678 17525 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:12.261313 21228 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.288391 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.287328 21145 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.293342 16810 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:12.295710 16953 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:12.235198 21230 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.205709 16705 rpcz_store.cc:269] 0709 13:19:52.414074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:52.414347 (+   273us) service_pool.cc:224] Handling call
0709 13:20:11.952409 (+19538062us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:06.888042 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:06.888701 (+   659us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:06.888750 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:20:06.888780 (+    30us) tablet.cc:662] Decoding operations
0709 13:20:06.889442 (+   662us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:06.889512 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:06.889540 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:20:06.890121 (+   581us) tablet.cc:701] Row locks acquired
0709 13:20:06.890178 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:20:06.890338 (+   160us) write_op.cc:270] Start()
0709 13:20:06.890481 (+   143us) write_op.cc:276] Timestamp: P: 1783603206890275 usec, L: 0
0709 13:20:06.890508 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:20:06.959652 (+ 69144us) log.cc:844] Serialized 1667 byte log entry
0709 13:20:07.136980 (+177328us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b18002db9e0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebfa93f3 00007feeebfab7c1 00007feeebfab779 00007feeebfab709 00007feeebfab6d1 00007feeebfaa9cd 000000000038f354 000000000038f199 00007feeebf8c83a
0709 13:20:07.229544 (+ 92564us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:07.503314 (+273770us) op_driver.cc:464] REPLICATION: finished
0709 13:20:07.769714 (+266400us) write_op.cc:301] APPLY: starting
0709 13:20:07.769822 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:07.770102 (+   280us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:07.770139 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:07.770824 (+   685us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:07.771098 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:20:07.771142 (+    44us) write_op.cc:312] APPLY: finished
0709 13:20:07.797159 (+ 26017us) log.cc:844] Serialized 41 byte log entry
0709 13:20:07.797345 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:07.797448 (+   103us) write_op.cc:454] Released schema lock
0709 13:20:07.797515 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:07.797887 (+   372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:07.797914 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2126667,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":241599,"apply.run_cpu_time_us":2852,"apply.run_wall_time_us":28188,"num_ops":4,"prepare.queue_time_us":236393,"prepare.run_cpu_time_us":36551,"prepare.run_wall_time_us":187894,"raft.queue_time_us":226271,"raft.run_cpu_time_us":12865,"raft.run_wall_time_us":193908,"replication_time_us":608688,"spinlock_wait_cycles":33664512,"thread_start_us":453872,"threads_started":4,"wal-append.queue_time_us":124907,"wal-append.run_cpu_time_us":27940,"wal-append.run_wall_time_us":1782189}]]}
I20260709 13:20:12.310827 16809 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:12.309867 21191 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.316172 16802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 611) took 1058 ms. Trace:
I20260709 13:20:12.356213 16802 rpcz_store.cc:276] 0709 13:20:11.257554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.257853 (+   299us) service_pool.cc:224] Handling call
0709 13:20:11.279894 (+ 22041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.973768 (+693874us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b58006a8ed0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeeeff20aa 00007feeef074447 00007feeef08cfe7 00007feeef08e7de 00007feeef098b49 00007feeef099416 00007feeef095d8f 00007feeef09583e 00007feef405a419 00007feeed5d1bd4
0709 13:20:12.315912 (+342144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.316123 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952189440}
W20260709 13:20:12.356773 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.269663 21123 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.317293 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:12.329272 16882 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:12.320561 17522 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:12.331615 17521 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.370141 17524 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:12.332104 21092 raft_consensus.cc:697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:12.255312 16706 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 8 to 9, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 9 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:12.372725 16958 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:20:12.373139 16958 pending_rounds.cc:85] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 10
I20260709 13:20:12.373361 16958 pending_rounds.cc:107] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 12.11
W20260709 13:20:12.335572 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 132439us
I20260709 13:20:12.235584 21214 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:12.316166 16805 rpcz_store.cc:276] 0709 13:20:09.819497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.031982 (+212485us) service_pool.cc:224] Handling call
0709 13:20:10.032525 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:11.237136 (+1204611us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b54000675a0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00ddc0 00007feeef0981c0 00007feeef099231 00007feeef095d8f 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c
0709 13:20:11.861226 (+624090us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b580047d8d0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeeeff20aa 00007feeef074447 00007feeef08cfe7 00007feeef08e7de 00007feeef098b49 00007feeef099416 00007feeef095d8f 00007feeef09583e 00007feef405a419 00007feeed5d1bd4
0709 13:20:12.315432 (+454206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.315630 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103805568}
I20260709 13:20:12.225728 21077 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:20:12.338179 17518 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:12.285925 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:12.260574 21087 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:12.354772 16808 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:12.312165 20714 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:12.338480 21144 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:20:12.340791 21149 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:20:12.358175 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 137007us
I20260709 13:20:12.337476 21217 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:12.338721 21257 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.255082 20901 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.373581 16958 raft_consensus.cc:2889] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:12.374266 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.246920 21219 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.342154 20781 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:12.378271 17526 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:12.414155 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:12.381249 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:12.625726 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:12.345548 21204 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.628551 16885 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:12.628335 16883 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:12.405670 16773 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:12.609535 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.392441 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:12.635246 16882 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:12.635448 16957 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:12.637279 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:12.449762 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.637537 16883 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:12.401160 16706 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 10 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 11 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:12.644169 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 358302us
W20260709 13:20:12.648200 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.651746 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.653024 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:12.394490 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:12.373026 21215 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.712347 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.913643 21254 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:12.914261 21254 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.915138 21076 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:12.915582 21076 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.916015 21076 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.916507 21254 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.920022 21163 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:12.677630 16957 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 2193) took 2185 ms (client timeout 1716 ms). Trace:
I20260709 13:20:12.356309 21145 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.678244 21204 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.921595 16884 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:12.922144 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.923132 21204 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.923733 16810 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:12.353910 21228 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.923837 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.925540 21228 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:12.404296 21214 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.926658 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:12.654270 21074 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.929144 21074 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.637733 21257 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.930361 16884 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:12.931664 21257 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.633751 17521 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
W20260709 13:20:12.859853 21240 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.011s	sys 0.019s
W20260709 13:20:12.932492 21240 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.011s	sys 0.020s
W20260709 13:20:12.783524 16980 debug-util.cc:398] Leaking SignalData structure 0x7b08003cbb00 after lost signal to thread 15723
I20260709 13:20:12.933395 21214 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:12.933816 16980 debug-util.cc:398] Leaking SignalData structure 0x7b08003be1c0 after lost signal to thread 16742
I20260709 13:20:12.934466 16879 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:20:12.935151 16980 debug-util.cc:398] Leaking SignalData structure 0x7b0800355f60 after lost signal to thread 16834
W20260709 13:20:12.935456 16980 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa480 after lost signal to thread 16835
W20260709 13:20:12.936537 16980 debug-util.cc:398] Leaking SignalData structure 0x7b0800380f40 after lost signal to thread 16909
I20260709 13:20:12.937166 21234 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:20:12.937712 16980 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4d00 after lost signal to thread 16983
W20260709 13:20:12.935981 16957 rpcz_store.cc:269] 0709 13:20:10.450912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:10.451065 (+   153us) service_pool.cc:224] Handling call
0709 13:20:10.548173 (+ 97108us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b1800274080. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0d1646 00007feeef00b58e 00007feeef08cf9e 00007feeef08e7de 00007feeef09a27c 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c
0709 13:20:11.910040 (+1361867us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b58002882d0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeeeff20aa 00007feeef074447 00007feeef08cfe7 00007feeef08e7de 00007feeef09a27c 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c
0709 13:20:12.636108 (+726068us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2915832960}
I20260709 13:20:12.909171 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:12.940274 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:12.941627 21150 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:12.386161 21090 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.942216 21150 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.942893 21150 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:12.369119 21167 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:12.944504 21090 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.944775 21167 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.945945 21090 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:12.946575 21090 raft_consensus.cc:697] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:12.948294 21167 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.949303 21234 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.952225 21234 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.964834 20901 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.637807 21217 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.969015 21217 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:12.947607 21090 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:12.910699 16882 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:20:12.628048 21092 consensus_queue.cc:237] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:12.547981 21075 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.938058 16980 debug-util.cc:398] Leaking SignalData structure 0x7b0800341880 after lost signal to thread 16984
I20260709 13:20:12.942986 17520 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:20:12.507422 21123 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:12.677767 21141 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 14 is higher.
I20260709 13:20:12.676271 20781 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:20:12.990406 16980 debug-util.cc:398] Leaking SignalData structure 0x7b0800364440 after lost signal to thread 17551
W20260709 13:20:12.998533 16980 debug-util.cc:398] Leaking SignalData structure 0x7b0800374440 after lost signal to thread 17552
W20260709 13:20:12.988373 21264 log.cc:927] Time spent T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.607s	user 0.003s	sys 0.007s
I20260709 13:20:12.995385 16953 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
W20260709 13:20:12.988734 20770 consensus_meta.cc:287] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.738s	user 0.012s	sys 0.007s
W20260709 13:20:12.999852 16980 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc8c0 after lost signal to thread 21212
I20260709 13:20:13.003283 16706 catalog_manager.cc:5697] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 10 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:12.372687 21230 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:13.038898 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:12.911983 21172 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.153563 16706 catalog_manager.cc:5697] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 2 to 7, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 7 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.159422 16848 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:13.159623 21215 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:13.160241 21215 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.162293 21215 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:12.998024 21123 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.164019 21204 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:13.164698 21204 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.165860 21123 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:13.000144 20781 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:13.167224 21204 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.168116 21220 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.175134 21220 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.152436 21113 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.176692 21219 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.171540 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.172686 21076 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.173785 16878 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:13.178301 16882 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:12.988914 20714 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.175427 21150 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.184449 16803 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:12.996518 21075 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.182197 21215 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:20:13.197031 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 286915us
I20260709 13:20:13.157629 21172 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:13.200310 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 260141us
I20260709 13:20:13.202343 17492 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:13.197515 21220 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.223914 16922 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:13.224794 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.225394 16882 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:13.200095 21215 raft_consensus.cc:697] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:13.214111 21254 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.214082 21163 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.233299 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.233876 16882 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:13.243695 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.248786 21204 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:13.250245 21150 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:13.250586 21204 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.252866 21204 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.253646 21273 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:13.254089 21273 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.254434 21273 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.264300 16877 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:13.265328 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.266391 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.266650 21150 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.267216 21150 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.268026 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.268291 16878 raft_consensus.cc:1240] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:20:13.268687 16883 raft_consensus.cc:2393] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:13.269284 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.269433 21150 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.269899 16880 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:20:13.270835 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.271425 16885 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:13.267364 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.272141 16877 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:13.272415 21075 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:13.283098 20714 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.288327 16955 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:13.291093 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.280671 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.281886 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.288348 16957 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:13.276378 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.294291 16952 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:13.262652 20770 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:13.299361 20770 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.301582 20770 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:13.237066 21275 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:20:13.235872 21254 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:13.306849 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 93258.7us
I20260709 13:20:13.307461 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:13.309998 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 97563.9us
I20260709 13:20:13.311198 16882 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:13.314750 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:13.319048 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.323084 21204 consensus_queue.cc:1059] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:13.327594 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.327787 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 626) took 1040 ms. Trace:
I20260709 13:20:13.330782 16924 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:13.328133 16810 rpcz_store.cc:276] 0709 13:20:12.287311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.348876 (+ 61565us) service_pool.cc:224] Handling call
0709 13:20:13.327622 (+978746us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54003e76d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:13.327735 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679897344}
W20260709 13:20:13.330773 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 106968us
I20260709 13:20:13.317327 21076 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.318459 21230 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.336766 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.337172 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.342093 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.347762 20781 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.352640 16958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 494) took 1159 ms. Trace:
I20260709 13:20:13.362967 16958 rpcz_store.cc:276] 0709 13:20:12.192885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.192995 (+   110us) service_pool.cc:224] Handling call
0709 13:20:12.193232 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.647950 (+454718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.352348 (+704398us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54002080d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:13.352550 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412066688}
I20260709 13:20:13.337998 20770 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:13.325177 21279 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:13.336596 21150 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:13.336691 21157 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:13.350059 21117 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:13.378612 21172 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:13.385339 21089 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:13.385915 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.306461 21215 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.388634 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:13.388019 21279 raft_consensus.cc:697] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:13.399861 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.410188 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:13.411064 16958 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 12: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:13.394878 20781 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:13.430500 21287 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:13.431030 21287 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:13.432200 21287 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.436196 21287 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.444492 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.445586 16958 raft_consensus.cc:2410] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:20:13.388527 21150 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.420317 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:13.448532 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 93853.6us
I20260709 13:20:13.448686 16883 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:13.450012 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.447355 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.451442 16950 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:13.389835 21157 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.412454 20770 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:13.454908 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.455173 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.458071 16876 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:13.456039 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.458285 16877 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:20:13.458848 16882 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:13.392328 21089 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.460433 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 627) took 1113 ms. Trace:
W20260709 13:20:13.453791 21087 consensus_meta.cc:287] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.622s	user 0.003s	sys 0.007s
I20260709 13:20:13.462915 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:13.462457 16879 rpcz_store.cc:276] 0709 13:20:12.343859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.344110 (+   251us) service_pool.cc:224] Handling call
0709 13:20:12.344376 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.934981 (+590605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.457251 (+522270us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400145ad4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:13.457464 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356061056}
I20260709 13:20:13.465456 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.397971 21284 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:20:13.471354 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:13.472474 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.472668 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:13.429108 21240 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:20:13.473383 16950 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.457983 21092 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:13.473678 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.477207 21294 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:13.448143 21273 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.461633 21093 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:13.496474 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:13.497079 16882 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.468204 21205 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.455768 20781 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:20:13.478358 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:13.503358 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.476677 21254 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.512550 16953 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:13.507745 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.514226 16879 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:13.511843 21205 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.519712 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:13.469621 21087 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.526923 16882 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:13.532495 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.533970 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.534628 16879 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:13.477710 21294 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:13.540175 16882 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:20:13.541828 16950 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:13.542876 17527 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:13.544786 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 67839.8us
I20260709 13:20:13.518918 21205 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.478686 21092 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.529517 21254 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:20:13.535233 21220 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:13.502393 21093 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.537282 21294 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.519065 21295 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:20:13.478132 21279 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.576038 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:13.581144 21300 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:13.581701 21300 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:13.582161 21300 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.585129 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 633) took 1191 ms. Trace:
I20260709 13:20:13.585515 16881 rpcz_store.cc:276] 0709 13:20:12.393770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.399823 (+  6053us) service_pool.cc:224] Handling call
0709 13:20:12.400165 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.966316 (+566151us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:12.966809 (+   493us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.212921 (+246112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:13.212971 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:13.213013 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.583570 (+370557us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54000b4354. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:13.583621 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.585074 (+  1453us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":786,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":685,"raft.run_cpu_time_us":4070,"raft.run_wall_time_us":6335,"spinlock_wait_cycles":1301436800,"thread_start_us":239859,"threads_started":1,"wal-append.queue_time_us":283255}
I20260709 13:20:13.592888 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.594419 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.595106 17522 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:13.596628 16922 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:13.597671 20781 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:13.598140 20781 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:13.598596 20781 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.600330 21300 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.600811 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:13.601797 17518 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 12: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:13.605988 20781 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.607159 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:13.609095 21300 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.609477 20781 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:13.612032 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:13.612560 16950 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.612702 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 619) took 1360 ms. Trace:
I20260709 13:20:13.613144 16804 rpcz_store.cc:276] 0709 13:20:12.252156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.275234 (+ 23078us) service_pool.cc:224] Handling call
0709 13:20:12.275472 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.912283 (+636811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.912312 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:12.912358 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:12.912403 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.612430 (+700027us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54001888d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:13.612494 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.612639 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983138560}
I20260709 13:20:13.617720 16950 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:13.622222 16959 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:13.624526 21093 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:13.626832 21265 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 1.283s	user 0.015s	sys 0.005s
I20260709 13:20:13.627154 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:13.628103 16959 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:13.628407 16956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34330 (request call id 2205) took 1562 ms. Trace:
I20260709 13:20:13.628710 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.629215 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.629513 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 2069) took 1234 ms. Trace:
I20260709 13:20:13.629905 17524 raft_consensus.cc:2393] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 14: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:13.630226 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.630676 17518 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:13.631158 16878 raft_consensus.cc:1240] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 14. Ops: []
I20260709 13:20:13.631879 17521 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:13.632840 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:13.633459 16803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 2100) took 1503 ms. Trace:
I20260709 13:20:13.625025 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:13.625435 21145 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:13.633860 16803 rpcz_store.cc:276] 0709 13:20:12.130551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.133060 (+  2509us) service_pool.cc:224] Handling call
0709 13:20:13.633302 (+1500242us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b540009a1d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:13.633387 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098415872}
I20260709 13:20:13.636349 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 911) took 1460 ms. Trace:
I20260709 13:20:13.636713 17527 rpcz_store.cc:276] 0709 13:20:12.175421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.183488 (+  8067us) service_pool.cc:224] Handling call
0709 13:20:12.183749 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:13.543385 (+1359636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:13.636053 (+ 92668us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54005befd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:13.636249 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3125011712}
I20260709 13:20:13.640316 21284 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:13.640880 21284 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:13.641350 21284 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:13.642547 21147 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:13.642827 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.643081 21147 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.642578 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:13.645061 21147 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.645533 21147 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.645777 21235 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.645974 21147 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.646302 21235 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:13.647637 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 1.24191e+06us
I20260709 13:20:13.647881 21226 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:13.648298 21235 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.648381 21226 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:13.648893 21226 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:13.649214 16773 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:13.650364 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:13.635361 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:13.650888 16808 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.651991 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:13.652539 16804 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.655387 21191 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:13.655812 21112 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.655900 21191 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.656347 21112 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.656678 21235 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:13.657145 21235 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.657953 21191 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.657891 16808 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:13.658284 21112 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.659014 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:13.659360 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.659540 21077 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:13.659879 16810 raft_consensus.cc:2410] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:20:13.660974 16807 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:13.661732 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:13.661851 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:13.662358 21122 raft_consensus.cc:2764] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:20:13.662446 20719 consensus_queue.cc:1059] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:13.662715 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.663431 21204 raft_consensus.cc:3055] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:13.663801 21204 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:20:13.664166 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.664211 21235 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.664566 21204 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.666100 21204 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:13.666530 20714 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.667021 20714 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.667979 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.669113 20714 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:13.669130 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.670152 21147 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:13.670974 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.629914 16884 rpcz_store.cc:276] 0709 13:20:12.394728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.637047 (+242319us) service_pool.cc:224] Handling call
0709 13:20:13.629351 (+992304us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54000b4d54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:13.629439 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651985280}
I20260709 13:20:13.672757 21202 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:13.673982 16804 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:13.674160 21226 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:13.675400 21202 consensus_queue.cc:1059] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:13.676028 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:13.676401 20714 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:13.677379 16807 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:13.701865 16802 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 13: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:13.679944 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:13.681783 16924 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:13.683097 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:13.682790 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:13.684099 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:13.704001 16804 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:13.628743 16956 rpcz_store.cc:276] 0709 13:20:12.066239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.170884 (+104645us) service_pool.cc:224] Handling call
0709 13:20:12.171127 (+   243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:12.171432 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:12.171457 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:12.215899 (+ 44442us) log.cc:844] Serialized 26 byte log entry
0709 13:20:12.339011 (+123112us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:12.339048 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:12.339132 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:13.626316 (+1287184us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:13.628158 (+  1842us) raft_consensus.cc:1685] finished
0709 13:20:13.628177 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:13.628356 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6018,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":4640640,"thread_start_us":122792,"threads_started":1,"wal-append.queue_time_us":127144}
I20260709 13:20:13.704560 21172 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:13.704600 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:13.706229 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:13.706852 16803 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:13.680438 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:13.690268 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.698199 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:13.700911 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.711077 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:13.722486 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.712865 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:13.774086 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:13.774317 17518 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:13.774639 16802 raft_consensus.cc:2376] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12. Re-sending same reply.
I20260709 13:20:13.776980 17524 raft_consensus.cc:2393] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:13.679116 21143 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:20:13.769358 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 56134.2us
I20260709 13:20:13.680241 21150 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.772364 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:13.687397 21141 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:13.802558 16806 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:13.707368 16773 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:13.804930 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 97641.4us
I20260709 13:20:13.772890 17527 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
W20260709 13:20:13.768973 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 56332.3us
I20260709 13:20:13.771083 16804 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:13.697888 21106 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:13.700047 21077 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:13.707912 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:13.819975 16803 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:13.811474 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:13.701146 21157 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.800911 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:13.823776 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:13.821874 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:13.776871 21163 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:13.770437 21273 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:13.710570 21089 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:13.677836 21297 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.226s
I20260709 13:20:13.744585 21214 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:13.816118 21291 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.262s	user 0.000s	sys 0.004s
I20260709 13:20:13.825515 21106 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.779078 21235 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:13.810989 21149 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.745412 20714 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.832726 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:13.822836 21077 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:13.824044 21143 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.847632 21300 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:13.848994 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:13.849071 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:13.817284 21113 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:13.851198 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.779349 21230 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:20:13.851883 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:13.830772 21163 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:13.862370 16773 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:13.875743 16924 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:13.876367 21228 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:13.820935 21141 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.842990 21087 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:13.886233 16808 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:13.888671 16773 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:13.884263 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:13.841642 21093 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:20:13.829150 21284 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:13.825834 21237 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:20:13.886270 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:13.988796 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 100207us
W20260709 13:20:13.985695 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 507352us
W20260709 13:20:13.990509 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 106322us
I20260709 13:20:13.875877 21077 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:13.994391 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 108195us
I20260709 13:20:13.995647 16775 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:13.998333 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:13.930267 21075 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:13.885788 21163 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:13.983790 21263 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:20:13.875375 21282 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:13.860898 21145 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.001868 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:13.943463 21202 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:20:13.999145 21293 log.cc:927] Time spent T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.437s	user 0.001s	sys 0.000s
I20260709 13:20:13.943531 21092 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:13.952219 21067 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:14.031342 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.010532 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:13.860762 21149 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.011655 21316 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:14.016624 21106 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:14.017485 21117 consensus_meta.cc:287] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.627s	user 0.007s	sys 0.003s
I20260709 13:20:14.017608 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:13.976703 21228 raft_consensus.cc:697] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:14.018460 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.018579 21141 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:14.020879 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.120662 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:14.120867 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 100064us
I20260709 13:20:13.993259 21123 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:13.943775 21167 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:13.995464 21113 raft_consensus.cc:2764] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:20:14.016636 21299 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:20:14.124042 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.001343 20781 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:13.932770 21300 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.098296 21067 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.022807 21282 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.019949 21112 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:20:13.850108 21302 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:14.040604 21317 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:14.040768 21145 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:14.009333 21272 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:20:14.122835 21167 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.124346 21257 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:14.036424 21296 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.457s	user 0.000s	sys 0.001s
W20260709 13:20:14.052590 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:14.040311 21311 log.cc:927] Time spent T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:14.020231 21226 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:14.009581 21177 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:20:14.055441 21287 consensus_meta.cc:287] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.001s
I20260709 13:20:14.029215 21202 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.136124 20719 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:20:14.103192 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.110095 16810 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:20:14.178074 16810 pending_rounds.cc:85] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 5
I20260709 13:20:14.178262 16806 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:14.178345 16810 pending_rounds.cc:107] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:20:14.178687 16810 raft_consensus.cc:2889] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:14.119204 20714 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.120368 21228 consensus_queue.cc:237] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.123665 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:13.873447 21235 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:14.137686 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:13.842621 21214 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.139618 16805 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:20:14.195804 21214 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.196350 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.197111 16805 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:14.198086 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.198732 16805 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
W20260709 13:20:14.144380 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 320664us
I20260709 13:20:14.146440 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.201220 16807 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:20:14.202045 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:14.017655 21307 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:20:14.202610 16807 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:20:14.149966 17521 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:14.204543 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 617) took 1964 ms. Trace:
I20260709 13:20:14.204895 16801 rpcz_store.cc:276] 0709 13:20:12.239887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:12.249889 (+ 10002us) service_pool.cc:224] Handling call
0709 13:20:12.250156 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:12.927655 (+677499us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:13.207257 (+279602us) log.cc:844] Serialized 14 byte log entry
0709 13:20:13.661883 (+454626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:13.661928 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:13.661969 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.204300 (+542331us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54001a8954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:14.204346 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:14.204493 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":346848,"prepare.queue_time_us":323779,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":347195,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":1557578112,"thread_start_us":386721,"threads_started":2,"wal-append.queue_time_us":107775}
I20260709 13:20:14.206605 21202 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:14.203382 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.119539 21143 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.139369 20781 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.122913 21123 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.153998 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.143986 21219 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:14.040323 21077 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.150415 21167 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:14.177587 21294 consensus_meta.cc:287] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.001s
I20260709 13:20:14.180750 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.179916 21144 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.153280 21302 raft_consensus.cc:697] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:14.190457 16885 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:14.206642 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.265450 16801 raft_consensus.cc:2410] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:20:14.199633 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.237882 17521 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:14.148877 21282 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.201244 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:20:14.238691 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 115110us
I20260709 13:20:14.251492 20781 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.254768 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 2076) took 1080 ms. Trace:
I20260709 13:20:14.255574 16807 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:14.146931 21067 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.267392 21144 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.329219 21067 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:14.255198 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:14.261020 16806 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:14.255095 21220 raft_consensus.cc:3055] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:20:14.330318 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 109826us
I20260709 13:20:14.330571 21220 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:14.331305 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:14.331434 21220 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.332644 21220 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.333066 16924 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:14.334229 21302 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.252300 16802 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
I20260709 13:20:14.250701 20719 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:14.281145 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.251410 21123 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.339994 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
W20260709 13:20:14.325410 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 124226us
I20260709 13:20:14.284363 16876 rpcz_store.cc:276] 0709 13:20:13.178660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.178802 (+   142us) service_pool.cc:224] Handling call
0709 13:20:13.457887 (+279085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:13.458462 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.213410 (+754948us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400145ad0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:14.254716 (+ 41306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639911296}
I20260709 13:20:14.250910 21297 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:20:14.347472 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 66441.6us
I20260709 13:20:14.350924 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.264148 21163 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.341766 21092 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:14.360505 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.368177 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:14.368883 16805 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:14.368959 16882 raft_consensus.cc:2376] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11. Re-sending same reply.
I20260709 13:20:14.362278 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.364676 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:14.370210 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.370867 16883 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:14.338587 20719 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:14.367560 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.337886 21257 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.371703 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.348999 21172 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:14.347123 21141 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:14.265161 21294 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.348019 21287 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:14.390879 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:14.391382 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:14.351397 21333 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:14.392182 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:14.394459 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.395219 16955 raft_consensus.cc:2393] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:14.395876 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.398217 21143 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:14.400413 21141 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:14.400730 21077 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:14.400929 21141 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.402832 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.400034 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.366209 21272 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:14.405911 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.404758 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.405628 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.406466 16957 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:14.406708 16877 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:14.395617 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.347358 21280 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:20:14.384812 21092 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.386823 20719 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.412997 21141 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:14.413599 21325 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:20:14.413771 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.416788 21287 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.411008 21333 raft_consensus.cc:697] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:14.393509 21257 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.418462 16879 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:14.386687 21300 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.422231 16883 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:14.435143 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.436583 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:14.421195 21092 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.423390 21149 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:14.426071 21327 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:20:14.445506 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.446257 21163 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.409817 21226 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:14.447022 21226 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:14.447396 21226 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:14.451812 21287 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.446249 16803 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:14.453975 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.454556 16803 raft_consensus.cc:2393] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 10: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:14.455534 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.408731 21272 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:14.464169 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:14.465035 16803 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.466795 21316 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.497367 16883 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:14.458029 21143 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:14.526271 16803 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:14.527041 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:14.527227 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.527602 16883 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:14.528113 16803 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 12: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:14.529070 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.529399 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:14.538755 21226 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.465365 21272 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.544499 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.556036 17492 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:14.580775 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:14.544212 21077 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.587378 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:14.541338 21143 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:14.593290 16957 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:14.592289 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.557078 21280 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.581149 21090 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:14.584501 21077 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.607192 21257 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.607911 21338 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:14.608960 21329 log.cc:927] Time spent T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:20:14.609944 21339 log.cc:927] Time spent T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:20:14.612744 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.619089 16803 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:14.522877 21316 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.599578 21143 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:14.557096 21123 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.610467 20719 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.611464 21333 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.600822 21092 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.624089 21297 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:14.638950 16803 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:14.639225 16951 raft_consensus.cc:1240] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:20:14.615049 21090 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.630355 21287 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.604914 21280 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.636291 21294 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:14.638365 21297 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:14.652483 21226 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.620199 21338 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.668265 20781 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.675339 21090 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.680481 16883 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:20:14.664642 21297 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:14.667279 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 111340us
I20260709 13:20:14.689448 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:14.691948 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:14.684442 21316 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:14.682912 21254 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:14.684985 21344 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.696411 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.699471 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.699749 16958 raft_consensus.cc:2393] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:14.698499 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.702757 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.703137 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.703826 16950 raft_consensus.cc:2393] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:14.705160 16954 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:14.703775 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.705670 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:14.706120 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:14.706295 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.706878 16959 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:14.707674 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.709077 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.709581 16956 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:14.710059 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:14.710358 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.710307 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.711745 16775 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.711943 17527 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:14.712517 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.713265 21226 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:14.713901 21226 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:14.708037 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.714711 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:14.715461 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.716831 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:14.713917 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.707944 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.719075 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.719156 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:14.719551 16959 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:14.707122 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.720268 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.721082 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.721529 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.722846 16957 raft_consensus.cc:2410] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:14.690111 20719 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.716795 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.721095 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:14.694625 21090 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:14.731336 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.727685 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.727169 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:14.730073 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.696264 21342 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:14.728991 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.728602 16956 raft_consensus.cc:2376] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14. Re-sending same reply.
I20260709 13:20:14.736011 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.736183 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.737807 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:14.691311 21349 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:20:14.739233 16957 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:14.728096 20901 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.728303 21226 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:14.743646 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.743659 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:14.746167 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:14.746271 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:14.723328 21344 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.749581 21344 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.746920 16877 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:14.751379 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.735586 21191 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:14.754603 16955 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:14.752933 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:14.758606 21076 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:14.758730 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2014) took 1052 ms. Trace:
I20260709 13:20:14.759146 16810 rpcz_store.cc:276] 0709 13:20:13.706003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.819496 (+113493us) service_pool.cc:224] Handling call
0709 13:20:13.840241 (+ 20745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:14.179003 (+338762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.758528 (+579525us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54000d8ed4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:14.758680 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618442112}
I20260709 13:20:14.760332 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:14.761942 21143 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.764786 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.765867 21076 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:14.767860 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:14.768998 21076 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:14.769393 21076 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:14.769800 21076 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:14.779274 21273 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:14.779748 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.779872 21273 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.781374 21346 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:14.782420 21273 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:14.785491 21240 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:14.787425 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.754189 21163 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:20:14.765220 21235 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:14.808812 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.805179 17518 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:14.789881 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:14.808879 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.806802 17519 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:14.741878 21342 raft_consensus.cc:697] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:14.741573 21280 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:14.812026 16850 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:14.726091 21254 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.813086 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:14.816707 21357 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.819178 16850 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:14.745334 21226 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:14.750626 21341 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:14.829797 16850 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:14.755270 21191 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:14.832453 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:14.752722 21348 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:14.827415 21294 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:14.834975 21357 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.831655 21316 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:14.832818 21341 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.817176 21349 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:14.836004 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:14.840579 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.826988 21091 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:14.817466 21123 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:14.838892 21287 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:14.826998 21297 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.828765 21226 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:14.845399 16877 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:14.835058 21344 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:14.840003 21282 consensus_meta.cc:287] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.002s
I20260709 13:20:14.824550 21302 consensus_queue.cc:1059] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:20:14.857084 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.838145 21191 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:14.823926 21273 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:20:14.788913 21167 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:14.852958 16808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 1999) took 1174 ms (client timeout 1558 ms). Trace:
I20260709 13:20:14.846917 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:14.854887 21090 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:20:14.855954 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 43648.2us
I20260709 13:20:14.856114 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:14.865911 16922 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:14.866219 16876 raft_consensus.cc:2376] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14. Re-sending same reply.
I20260709 13:20:14.857690 16880 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:14.841706 21143 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.859732 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:20:14.859181 16808 rpcz_store.cc:269] 0709 13:20:13.678787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.682811 (+  4024us) service_pool.cc:224] Handling call
0709 13:20:14.852764 (+1169953us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400099cd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:14.852901 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420107136}
I20260709 13:20:14.860648 21091 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:14.868422 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:14.869724 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.870937 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:14.871632 16808 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.861754 21346 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:14.862999 21297 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:14.887025 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.887259 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.887547 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.887789 16880 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:20:14.877400 16805 raft_consensus.cc:2368] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 14. Current term is 15.
I20260709 13:20:14.888612 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.878950 16922 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:14.890735 16922 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:14.848194 21287 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:14.851780 21286 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:14.893280 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:14.885839 16808 raft_consensus.cc:2468] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:14.894407 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.894562 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.907003 16876 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:14.898893 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:14.908205 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.888538 21074 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:14.876328 21091 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:14.891636 21347 consensus_queue.cc:1059] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:20:14.903014 21358 consensus_queue.cc:1059] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:14.914749 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.909588 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.909818 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:14.912276 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 52641.3us
I20260709 13:20:14.915548 16876 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:14.913118 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.916388 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.916169 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:14.918093 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:14.913249 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:14.914644 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:14.903975 21235 consensus_queue.cc:1059] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:14.887094 21172 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:14.892967 21241 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:14.894263 21240 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:14.897640 21287 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:14.918350 21144 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.905470 21341 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:14.916684 17492 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:14.920308 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.858741 21282 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.900732 21286 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:14.925529 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.926666 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:14.891981 21349 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:20:14.912722 21091 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:14.915470 21220 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:14.864310 21342 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.915831 21302 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:14.945055 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.992228 16877 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:14.952410 21357 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.952764 21254 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:14.954704 20781 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:14.915634 21074 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:14.932651 21280 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:14.921334 21316 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:14.954681 21272 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.967177 20901 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:14.969693 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:15.010599 21272 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:15.007006 21316 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:14.969517 21191 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:15.012034 21316 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:15.012593 21074 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:15.013531 21191 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.972460 21344 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:15.002472 21076 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:15.014441 16808 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
W20260709 13:20:15.014967 21326 log.cc:927] Time spent T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.661s	user 0.002s	sys 0.000s
I20260709 13:20:15.016650 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2016) took 1014 ms. Trace:
I20260709 13:20:14.970765 21226 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:14.915948 21359 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:14.975229 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 58618.6us
I20260709 13:20:15.015703 21076 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.990851 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:20:14.990895 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 64323.1us
I20260709 13:20:14.991483 21220 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:14.993592 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:14.990319 21363 raft_consensus.cc:2804] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:14.992100 21341 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:14.990895 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 81163.7us
I20260709 13:20:15.001230 21284 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:15.004583 16957 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:14.989663 21286 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:15.016999 16809 rpcz_store.cc:276] 0709 13:20:14.002264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.002404 (+   140us) service_pool.cc:224] Handling call
0709 13:20:14.023797 (+ 21393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:14.024135 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:14.024166 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:14.031804 (+  7638us) log.cc:844] Serialized 26 byte log entry
0709 13:20:14.146578 (+114774us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:14.174851 (+ 28273us) log.cc:844] Serialized 14 byte log entry
0709 13:20:14.179915 (+  5064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.179988 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.014438 (+834450us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:15.016421 (+  1983us) raft_consensus.cc:1685] finished
0709 13:20:15.016502 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.016604 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4773,"prepare.queue_time_us":37802,"raft.queue_time_us":9339,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":48500,"spinlock_wait_cycles":128654848,"thread_start_us":68889,"threads_started":1,"wal-append.queue_time_us":206194}
I20260709 13:20:15.010939 21091 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:15.028810 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:15.007123 21368 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:15.033500 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44636 (request call id 1119) took 1023 ms. Trace:
I20260709 13:20:15.057375 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2035) took 1556 ms. Trace:
I20260709 13:20:15.057731 17521 rpcz_store.cc:276] 0709 13:20:14.010148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.010292 (+   144us) service_pool.cc:224] Handling call
0709 13:20:15.033330 (+1023038us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b54004f3154. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:15.033449 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112354560}
I20260709 13:20:15.057744 16775 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:15.059476 20901 raft_consensus.cc:2764] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:20:15.057811 16885 rpcz_store.cc:276] 0709 13:20:13.500489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.502589 (+  2100us) service_pool.cc:224] Handling call
0709 13:20:15.057131 (+1554542us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b5400343354. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:15.057267 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1517255552}
I20260709 13:20:15.060288 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.060611 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:15.061031 17519 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 12: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:15.061321 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.038365 16801 raft_consensus.cc:1240] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:15.062032 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:15.062779 16801 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:15.039338 16959 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:15.040112 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.042640 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:15.042842 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:15.043358 16810 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:15.043282 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:15.044492 16877 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:20:15.066283 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:15.045667 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:15.042640 21341 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.052345 21344 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:15.054456 21226 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:15.039057 21220 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:15.055032 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:14.988768 16876 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:15.016952 21167 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:15.026961 21359 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:15.033634 17527 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:15.058179 16850 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.063040 16808 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:20:15.070199 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:15.107312 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 51259.8us
I20260709 13:20:15.108083 16808 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:20:15.069432 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:15.069583 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:15.108765 16877 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:15.100283 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 60226.1us
I20260709 13:20:15.070664 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:15.084705 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:15.109676 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.086854 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:15.076040 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:15.105305 21234 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:15.057613 21368 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:15.158047 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:15.076120 21191 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:15.062211 21348 raft_consensus.cc:697] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:15.163623 16876 raft_consensus.cc:1275] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:15.067802 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.110498 16950 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.111159 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.071523 21091 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:15.165098 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 54001us
I20260709 13:20:15.165427 16885 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:15.077009 21362 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:20:15.167006 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 99298.6us
I20260709 13:20:15.087831 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:15.160023 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:15.162921 21272 consensus_queue.cc:1059] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:20:15.169552 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:15.169770 21272 raft_consensus.cc:3055] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:15.170171 21272 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:15.170697 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:15.170902 21272 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:15.169595 21348 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:15.172605 21272 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:15.174273 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:15.175168 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:15.168979 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.176774 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:15.069103 20901 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:15.099740 21341 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.068809 21363 raft_consensus.cc:697] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:15.076746 21282 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:15.070999 21369 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:15.159875 21191 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:15.177491 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:15.202730 16955 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:15.202955 16959 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:15.108650 21359 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.111749 21141 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:15.112335 21344 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:15.112069 21295 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:15.182644 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.085275 21287 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:15.110811 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.165678 21074 consensus_queue.cc:1059] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:20:15.204799 21191 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:15.206126 21141 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.167543 21254 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:15.211071 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.181625 20901 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:15.222612 16950 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
W20260709 13:20:15.223241 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 112516us
I20260709 13:20:15.186218 21167 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:15.203800 16951 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:15.183861 21091 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 13:20:15.358668 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 192466us
I20260709 13:20:15.222119 21147 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:15.376310 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.159816 21368 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:20:15.372643 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 161617us
I20260709 13:20:15.378664 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:15.327934 16697 maintenance_manager.cc:419] P c8653aabbcbd4e268c41b15906779d0b: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033403
I20260709 13:20:15.380388 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.229019 21294 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:15.381954 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.362890 21141 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.388825 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.390705 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:15.371482 20901 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:15.397934 21375 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:20:15.395644 16850 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:15.404484 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:15.404735 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:15.393527 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:15.406764 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:15.372038 21167 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:15.399430 21360 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:15.381879 21344 raft_consensus.cc:3055] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:15.454838 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:15.387334 21091 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:15.385418 21357 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:15.496191 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 102743us
W20260709 13:20:15.496642 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 88549.2us
I20260709 13:20:15.400851 21254 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:15.452155 21358 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.461319 21167 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:15.596879 17492 leader_election.cc:336] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.670s (SENT)
I20260709 13:20:15.540127 21091 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:15.496027 21344 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:15.391932 21147 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:15.614395 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:15.542968 21357 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:15.621562 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:15.604271 21360 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:15.593863 21226 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:15.631642 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:15.622174 21091 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:15.635926 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 104169us
I20260709 13:20:15.636714 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:15.637645 16801 raft_consensus.cc:2410] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 13 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:20:15.638669 16955 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:15.625072 21357 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:15.626592 21360 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:15.641346 21371 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:15.382580 21363 consensus_queue.cc:237] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:15.648787 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 75802.1us
I20260709 13:20:15.637629 21217 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:15.636027 21147 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:15.623800 21358 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:15.645404 21360 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.658797 16802 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:15.634799 21254 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:15.648020 21344 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:15.636653 21364 consensus_queue.cc:1059] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:20:15.650907 21287 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:15.665228 21364 raft_consensus.cc:3055] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:15.665580 21364 raft_consensus.cc:740] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:15.666385 21364 consensus_queue.cc:260] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:15.669087 21358 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:15.669783 21370 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:15.670281 21370 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:15.660184 21074 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:15.672431 21370 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:15.672188 21074 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:15.673431 21380 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:20:15.674299 21286 consensus_meta.cc:287] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.000s
I20260709 13:20:15.674566 21074 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:15.674666 21286 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:15.667599 21364 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:15.678306 21316 consensus_meta.cc:287] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.000s
I20260709 13:20:15.659622 21147 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:15.712919 16879 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 642) took 1345 ms (client timeout 1670 ms). Trace:
W20260709 13:20:15.713547 16879 rpcz_store.cc:269] 0709 13:20:14.367758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.371394 (+  3636us) service_pool.cc:224] Handling call
0709 13:20:15.712692 (+1341298us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b54000ee7d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:15.712846 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68675328}
W20260709 13:20:15.716953 16877 consensus_meta.cc:287] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.002s
I20260709 13:20:15.718668 16877 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:15.658368 21379 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:15.722848 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:15.723201 16884 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:15.726224 16879 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.723713 21219 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:15.720239 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:15.726250 21379 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:15.710726 21316 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:15.741577 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:15.738389 21348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.002s	sys 0.016s
I20260709 13:20:15.746675 21379 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:15.755959 21341 consensus_meta.cc:287] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.559s	user 0.001s	sys 0.008s
W20260709 13:20:15.756474 21381 log.cc:927] Time spent T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:20:15.756651 21314 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 1.736s	user 0.003s	sys 0.028s
I20260709 13:20:15.757931 16879 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:15.758494 21141 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:15.749697 21191 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:15.741405 21219 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.760730 21286 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:15.762351 21316 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:15.808504 21370 consensus_queue.cc:1059] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:15.809396 21370 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:15.809759 21370 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:15.809900 16775 leader_election.cc:336] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Timed out: RequestConsensusVote RPC to 127.15.90.3:33725 timed out after 1.716s (SENT)
I20260709 13:20:15.762959 16880 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:15.810627 21370 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:15.765743 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:15.766471 21360 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:15.775099 21348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.003s	sys 0.017s
I20260709 13:20:15.784348 21394 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:20:15.795133 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:15.795454 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 391001us
I20260709 13:20:15.798350 21392 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 13:20:15.821602 21220 consensus_meta.cc:287] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.001s
I20260709 13:20:15.816319 16850 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:15.837706 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:15.816720 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:15.818518 21360 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:15.806440 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2048) took 1408 ms. Trace:
I20260709 13:20:15.857301 16876 rpcz_store.cc:276] 0709 13:20:14.397869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.170910 (+773041us) service_pool.cc:224] Handling call
0709 13:20:15.171193 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:15.175738 (+  4545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.175767 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:15.184341 (+  8574us) log.cc:844] Serialized 26 byte log entry
0709 13:20:15.523532 (+339191us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:15.523575 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:15.523641 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.806208 (+282567us) raft_consensus.cc:1685] finished
0709 13:20:15.806229 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.806381 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4195,"raft.queue_time_us":9314,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":11896,"thread_start_us":307353,"threads_started":1,"wal-append.queue_time_us":420840}
I20260709 13:20:15.858616 21141 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:15.856441 16879 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:15.859408 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:15.830600 21272 consensus_meta.cc:287] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.000s
I20260709 13:20:15.832211 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2011) took 2127 ms. Trace:
I20260709 13:20:15.861925 16804 rpcz_store.cc:276] 0709 13:20:13.705190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:13.808818 (+103628us) service_pool.cc:224] Handling call
0709 13:20:13.809190 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:13.813229 (+  4039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:13.813271 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:13.813847 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:20:14.200704 (+386857us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b1800462d60. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeeec3e4bc 00007feeebf8c48b 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec360d1
0709 13:20:14.200835 (+   131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:14.200870 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:14.200929 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:15.756111 (+1555182us) spinlock_profiling.cc:243] Waited 4.99 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:15.832020 (+ 75909us) raft_consensus.cc:1685] finished
0709 13:20:15.832040 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:15.832158 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21788,"raft.queue_time_us":9462,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2725,"spinlock_wait_cycles":23534080,"thread_start_us":13119,"threads_started":1,"wal-append.queue_time_us":129727}
I20260709 13:20:15.771262 21357 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:15.824442 20901 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:15.829244 21366 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.878s	user 0.010s	sys 0.003s
I20260709 13:20:15.852444 21316 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:15.854316 16954 raft_consensus.cc:2368] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13.
I20260709 13:20:15.842015 21220 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:15.871519 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 71483.1us
I20260709 13:20:15.849781 21091 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:15.851871 21384 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:15.841137 21359 consensus_meta.cc:287] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
I20260709 13:20:15.863801 16876 raft_consensus.cc:2393] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:15.781332 21341 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:15.833699 21370 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:15.864971 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:15.879343 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:15.880944 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:15.867533 21316 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:15.919512 16885 raft_consensus.cc:1240] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:15.877408 16879 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:15.925652 21286 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:15.926106 21286 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:15.926498 21286 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:15.926893 21220 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:15.925402 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 44570.3us
I20260709 13:20:16.046181 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.047154 16879 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:16.047858 16877 raft_consensus.cc:2368] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13.
I20260709 13:20:15.992794 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:20:16.050467 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 57806.4us
I20260709 13:20:16.052564 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:15.927948 21384 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:16.056437 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:16.058276 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.059156 16879 raft_consensus.cc:2368] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:20:16.061204 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.062829 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.063885 16876 raft_consensus.cc:2393] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:16.067116 16775 leader_election.cc:400] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11.
I20260709 13:20:16.072499 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.073277 16809 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:15.938108 21316 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:15.928334 21363 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.083209 21379 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:16.084409 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:16.085438 20901 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.076898 21360 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:15.925390 21401 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:16.094521 21191 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.103471 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.133473 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.275097 16879 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:16.135857 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:16.074813 21371 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:15.877849 21359 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:16.284899 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 149228us
I20260709 13:20:16.286437 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.294708 16876 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:16.287413 16879 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:16.297744 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2052) took 1610 ms. Trace:
I20260709 13:20:16.292605 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:16.299005 16879 rpcz_store.cc:276] 0709 13:20:14.686821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.286984 (+1600163us) service_pool.cc:224] Handling call
0709 13:20:16.287239 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.297438 (+ 10199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.297683 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:20:16.255872 21368 consensus_meta.cc:287] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.649s	user 0.005s	sys 0.005s
I20260709 13:20:16.253415 21360 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.308982 21360 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.310213 21359 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:16.311290 16952 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:16.139240 21228 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:16.253157 21394 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:16.344311 16876 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:16.282665 21361 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:16.302708 20901 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.347649 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:16.311816 21401 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:16.345592 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.359783 16801 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:16.310874 21338 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.352841 16809 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:16.362689 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.349361 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2053) took 1662 ms. Trace:
I20260709 13:20:16.364092 16876 rpcz_store.cc:276] 0709 13:20:14.687125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.296236 (+1609111us) service_pool.cc:224] Handling call
0709 13:20:16.344145 (+ 47909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.349038 (+  4893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.349294 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:16.323531 21371 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:16.327210 21220 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.254935 21363 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.263015 21219 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:16.372074 21091 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:16.376168 21399 log.cc:927] Time spent T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:20:16.376518 21371 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:16.378582 21341 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.325191 21368 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.379868 21220 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.382345 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:16.415577 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.421705 16801 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:16.356001 21361 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.423184 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:16.423555 21379 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.364498 21401 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.425316 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.426115 16801 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.426846 21363 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.345742 21228 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:16.436339 16805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 2120) took 2429 ms (client timeout 2904 ms). Trace:
W20260709 13:20:16.437176 16805 rpcz_store.cc:269] 0709 13:20:14.006857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.408584 (+401727us) service_pool.cc:224] Handling call
0709 13:20:16.436091 (+2027507us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54000997d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:16.436265 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992658176}
I20260709 13:20:16.444792 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:16.446182 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.446929 16809 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.446374 16801 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:16.421562 21357 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.452461 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.431710 21324 raft_consensus.cc:3055] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:20:16.462530 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 278493us
I20260709 13:20:16.350759 21394 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:16.445802 21167 consensus_meta.cc:287] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.822s	user 0.010s	sys 0.000s
I20260709 13:20:16.463387 21324 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:16.483563 21370 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.484505 21272 consensus_queue.cc:1059] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:20:16.476662 21167 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:16.483384 21338 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:20:16.512328 16775 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:20:16.552927 21286 consensus_meta.cc:287] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.001s
I20260709 13:20:16.553129 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.553413 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:16.553918 16806 raft_consensus.cc:2393] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:16.555873 21226 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:16.556377 21226 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:16.556767 21226 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:16.559754 16954 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 2245) took 1518 ms (client timeout 2020 ms). Trace:
W20260709 13:20:16.560151 16954 rpcz_store.cc:269] 0709 13:20:15.041374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.087579 (+ 46205us) service_pool.cc:224] Handling call
0709 13:20:16.559554 (+1471975us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54002d3f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:16.559699 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548750720}
W20260709 13:20:16.518049 21404 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:20:16.561259 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:16.562348 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:16.562774 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:16.563709 16955 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:16.545593 16952 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 2378) took 1504 ms. Trace:
I20260709 13:20:16.565734 16952 rpcz_store.cc:276] 0709 13:20:15.041091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.201946 (+160855us) service_pool.cc:224] Handling call
0709 13:20:15.202296 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.311804 (+1109508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.545378 (+233574us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000528d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:16.545535 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2549803776}
I20260709 13:20:16.566299 16806 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:16.548462 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.563421 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:16.534475 21396 log.cc:927] Time spent T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:20:16.672948 16806 raft_consensus.cc:1240] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:16.611224 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:16.675390 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:16.537659 21403 log.cc:927] Time spent T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:20:16.610140 16850 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.1:46655 timed out after 2.904s (SENT) [suppressed 17 similar messages]
W20260709 13:20:16.681142 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 71042.6us
I20260709 13:20:16.507665 16809 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:16.683881 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:16.684295 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:16.567811 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:16.686110 16882 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:16.517959 21077 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:16.713425 16882 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:16.714720 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.716109 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:16.547309 21167 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.539942 21220 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.539219 21228 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:16.721771 21149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.188s	user 0.015s	sys 0.028s
I20260709 13:20:16.672817 21295 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.674657 21191 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:16.547219 21147 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.538409 21401 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.529141 21141 raft_consensus.cc:3055] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:16.540727 21344 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.674448 21204 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.545759 21368 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.540587 21338 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:16.535892 21357 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:16.746025 21357 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.545197 21394 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.583249 20901 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:16.544204 21361 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:16.739775 21149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.204s	user 0.016s	sys 0.029s
I20260709 13:20:16.536824 21360 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:16.720455 21157 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.553431 21286 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:16.723189 21312 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.753995 21157 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.754715 21312 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.755308 21360 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.756286 21157 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.756654 21312 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.544227 21370 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.757081 21286 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.757323 21226 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.545948 21324 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.745395 21338 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:16.743196 21316 consensus_meta.cc:287] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.003s
W20260709 13:20:16.745395 21369 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.014s	sys 0.027s
I20260709 13:20:16.744272 21204 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.725419 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:16.742405 21141 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:16.821919 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.820873 16801 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:16.830803 16957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 522) took 1424 ms. Trace:
I20260709 13:20:16.821588 16809 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:16.825505 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 2104) took 2131 ms. Trace:
W20260709 13:20:16.822970 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 101592us
I20260709 13:20:16.723835 21254 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:16.866247 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:16.742651 21295 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.868363 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:16.869465 16882 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:16.869589 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.870532 21286 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:16.871044 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:16.871347 21295 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.842957 21226 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.873826 21204 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:16.844666 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:16.844488 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:16.759238 21316 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:16.840672 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:16.760746 21324 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.876185 16958 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:16.877197 21316 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.759757 21338 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:16.877099 21141 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:16.878865 21141 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.879076 21338 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:16.865293 16876 rpcz_store.cc:276] 0709 13:20:14.693659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.365239 (+1671580us) service_pool.cc:224] Handling call
0709 13:20:16.389692 (+ 24453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.409111 (+ 19419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.409138 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:16.409586 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:20:16.700151 (+290565us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:16.700207 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.700302 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:16.824730 (+124428us) raft_consensus.cc:1685] finished
0709 13:20:16.824783 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.825140 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23749,"raft.queue_time_us":19104,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":16136,"thread_start_us":251894,"threads_started":1,"wal-append.queue_time_us":311760}
I20260709 13:20:16.880079 16955 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:16.754037 21357 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.828887 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:16.759500 21369 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.014s	sys 0.027s
I20260709 13:20:16.847637 21143 raft_consensus.cc:3055] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:16.860383 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:16.872218 21286 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:16.759291 21235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.807s	user 0.009s	sys 0.022s
I20260709 13:20:16.911711 21143 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:20:16.912432 21235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.960s	user 0.009s	sys 0.023s
I20260709 13:20:16.760878 21370 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.868432 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:16.913966 21143 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.871315 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.880899 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.916144 16809 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:16.888010 16804 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:16.916433 21144 raft_consensus.cc:3055] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:16.916875 21144 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:16.918181 16804 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:16.918264 21144 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.853652 21360 consensus_queue.cc:1059] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:20:16.889937 16803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2033) took 2011 ms. Trace:
I20260709 13:20:16.919989 16803 rpcz_store.cc:276] 0709 13:20:14.878664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.181240 (+302576us) service_pool.cc:224] Handling call
0709 13:20:15.205356 (+ 24116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.368808 (+163452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.368851 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:15.368906 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:15.368948 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.889434 (+1520486us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54002a7954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:16.889518 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.889751 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375387904}
I20260709 13:20:16.922722 16804 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:16.891760 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 2129) took 2432 ms. Trace:
I20260709 13:20:16.923900 16810 rpcz_store.cc:276] 0709 13:20:14.459123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.769466 (+310343us) service_pool.cc:224] Handling call
0709 13:20:14.776472 (+  7006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.064966 (+288494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.891158 (+1826192us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54001897d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:16.891538 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613358976}
I20260709 13:20:16.916293 16876 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:16.925719 16810 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:16.925765 21075 raft_consensus.cc:3055] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:16.926194 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:16.893060 16877 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 2121) took 1517 ms (client timeout 2020 ms). Trace:
I20260709 13:20:16.897015 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:16.927184 16876 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:16.927814 16806 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:16.928756 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:16.929482 16876 raft_consensus.cc:2376] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12. Re-sending same reply.
W20260709 13:20:16.927039 16877 rpcz_store.cc:269] 0709 13:20:15.376027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.741327 (+365300us) service_pool.cc:224] Handling call
0709 13:20:16.892683 (+1151356us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54000b4854. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:16.892880 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688134912}
I20260709 13:20:16.930537 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:16.931309 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:16.896133 16880 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 2099) took 2220 ms (client timeout 2892 ms). Trace:
I20260709 13:20:16.897620 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:16.901084 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2051) took 2214 ms. Trace:
I20260709 13:20:16.910422 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2046) took 2512 ms. Trace:
I20260709 13:20:16.912567 16952 raft_consensus.cc:2393] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 12: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:16.865089 16957 rpcz_store.cc:276] 0709 13:20:15.406444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.407089 (+   645us) service_pool.cc:224] Handling call
0709 13:20:15.552117 (+145028us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:15.725179 (+173062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:15.725209 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:16.556690 (+831481us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b2c0012df38. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:20:16.557258 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 13:20:16.725951 (+168693us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:16.725986 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.726049 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:16.830064 (+104015us) raft_consensus.cc:1685] finished
0709 13:20:16.830102 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.830474 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31118,"raft.queue_time_us":50484,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":4657,"spinlock_wait_cycles":5237504,"thread_start_us":285375,"threads_started":2,"wal-append.queue_time_us":191685}
I20260709 13:20:16.926329 21075 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:16.899250 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.935861 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:16.938357 16881 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:16.938541 16883 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:16.939466 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.940029 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.940855 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.941000 16883 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:16.933297 16885 rpcz_store.cc:276] 0709 13:20:14.397287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.167688 (+770401us) service_pool.cc:224] Handling call
0709 13:20:15.172060 (+  4372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.919997 (+747937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.902102 (+982105us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54000b5254. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:16.902417 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718485248}
W20260709 13:20:16.932816 16880 rpcz_store.cc:269] 0709 13:20:14.676426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:14.993321 (+316895us) service_pool.cc:224] Handling call
0709 13:20:16.895690 (+1902369us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54003f3754. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:16.895951 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669817728}
I20260709 13:20:16.933192 16884 rpcz_store.cc:276] 0709 13:20:14.686516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.171242 (+484726us) service_pool.cc:224] Handling call
0709 13:20:15.171476 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.724911 (+553435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.900552 (+1175641us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540041a5d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:16.900858 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268368640}
I20260709 13:20:16.931497 21092 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.946877 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:16.948194 21357 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:16.954152 16880 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 13. Current term is 14. Ops: [12.9-13.10]
W20260709 13:20:16.936335 21149 consensus_queue.cc:1175] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" responder_term: 11 status { last_received { term: 10 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:16.954707 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 649) took 1904 ms. Trace:
I20260709 13:20:16.954993 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 2110) took 2166 ms. Trace:
I20260709 13:20:16.955753 21144 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:16.956566 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:16.957116 21191 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:16.957695 21191 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:16.957950 16924 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:16.955435 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:16.960484 20770 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:16.961207 20770 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:16.962296 21093 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:16.963894 21297 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:16.964092 21143 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.964418 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2054) took 2277 ms. Trace:
I20260709 13:20:16.964622 21284 raft_consensus.cc:3055] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:16.964690 21297 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.965305 21284 raft_consensus.cc:740] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:16.966733 21284 consensus_queue.cc:260] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:16.968303 21284 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:16.962960 21280 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:16.969442 21280 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:16.969946 21280 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:16.970572 21316 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:16.955156 16885 rpcz_store.cc:276] 0709 13:20:15.049902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.949949 (+1900047us) service_pool.cc:224] Handling call
0709 13:20:16.950458 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.954281 (+  3823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.954329 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:16.954410 (+    81us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:16.954464 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.954521 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.954635 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:16.955420 16880 rpcz_store.cc:276] 0709 13:20:14.788361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.949461 (+2161100us) service_pool.cc:224] Handling call
0709 13:20:16.953690 (+  4229us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:16.954688 (+   998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.954924 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:16.959586 16877 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:16.952837 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:16.955137 21075 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.973196 21316 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.976657 21075 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:16.963315 21093 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.971848 16879 rpcz_store.cc:276] 0709 13:20:14.690584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.300044 (+1609460us) service_pool.cc:224] Handling call
0709 13:20:16.300363 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.300613 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:16.348630 (+ 48017us) log.cc:844] Serialized 14 byte log entry
0709 13:20:16.894874 (+546244us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b1800484180. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec3623a 00007feeef0a0a2a
0709 13:20:16.948167 (+ 53293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:16.948260 (+    93us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:16.951333 (+  3073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.952696 (+  1363us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.964248 (+ 11552us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4113,"prepare.queue_time_us":47746,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2537,"raft.queue_time_us":9374,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":2907,"spinlock_wait_cycles":48439552,"thread_start_us":15061,"threads_started":1,"wal-append.queue_time_us":565922}
I20260709 13:20:16.967427 21297 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:16.978996 16881 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:20:16.979666 16924 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:16.980670 16807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 644) took 2433 ms. Trace:
I20260709 13:20:16.981531 21093 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:16.983980 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 155408us
I20260709 13:20:16.985922 16805 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:16.962904 20770 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:16.987696 16879 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:16.987776 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 2105) took 2289 ms. Trace:
I20260709 13:20:16.988917 16881 rpcz_store.cc:276] 0709 13:20:14.695279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.941834 (+2246555us) service_pool.cc:224] Handling call
0709 13:20:16.948470 (+  6636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:16.982456 (+ 33986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.984620 (+  2164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:16.990361 21370 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:16.982358 16807 rpcz_store.cc:276] 0709 13:20:14.546808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.019809 (+473001us) service_pool.cc:224] Handling call
0709 13:20:15.020321 (+   512us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:15.020850 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:20:15.068526 (+ 47676us) log.cc:844] Serialized 14 byte log entry
0709 13:20:16.564306 (+1495780us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b180043d9e0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec3623a 00007feeef0a0a2a
0709 13:20:16.951854 (+387548us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:16.955293 (+  3439us) log.cc:844] Serialized 513 byte log entry
0709 13:20:16.955506 (+   213us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:16.955542 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.955639 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:16.971743 (+ 16104us) raft_consensus.cc:1685] finished
0709 13:20:16.974952 (+  3209us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.980425 (+  5473us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46922,"prepare.queue_time_us":85694,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2511,"raft.queue_time_us":31251,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":24572,"spinlock_wait_cycles":19011328,"thread_start_us":331238,"threads_started":2,"wal-append.queue_time_us":1751864}
I20260709 13:20:16.991653 16804 raft_consensus.cc:1240] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:16.991007 21370 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:16.993856 21370 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:16.992583 16884 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:16.996433 21373 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 1.942s	user 0.017s	sys 0.028s
I20260709 13:20:16.997704 21316 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:16.998266 16881 raft_consensus.cc:1240] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:16.999471 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 655) took 1948 ms. Trace:
I20260709 13:20:16.999943 16877 rpcz_store.cc:276] 0709 13:20:15.050793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.974077 (+1923284us) service_pool.cc:224] Handling call
0709 13:20:16.998814 (+ 24737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.999135 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:16.999164 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:16.999229 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:16.999263 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:16.999324 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:16.999408 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.001845 16877 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:20:17.003558 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.005537 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.007184 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 2109) took 2252 ms. Trace:
I20260709 13:20:17.007447 16884 rpcz_store.cc:276] 0709 13:20:14.754450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.950570 (+2196120us) service_pool.cc:224] Handling call
0709 13:20:16.984085 (+ 33515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.006975 (+ 22890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.007144 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.011569 21287 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:17.015691 21337 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.016507 21337 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.016328 21361 raft_consensus.cc:2955] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Committing config change with OpId 11.9: config changed from index 3 to 9, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:17.019119 21337 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:17.020255 16957 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:17.015602 21090 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:17.035575 21377 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 1.689s	user 0.000s	sys 0.018s
I20260709 13:20:17.011221 21389 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:17.038000 21389 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:17.040416 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 105123us
I20260709 13:20:17.040896 21389 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:17.041787 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.041905 21090 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.041528 16850 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:17.043839 21287 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:17.044291 21287 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.044332 21090 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:17.044876 21287 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.045262 21123 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:17.046324 21235 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:20:17.046649 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.046818 21235 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:17.048055 21257 consensus_queue.cc:1059] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:17.049149 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.049588 21257 consensus_queue.cc:1059] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:17.049862 17519 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:17.046319 16809 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
W20260709 13:20:17.050793 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.050028 21297 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:17.051821 21257 raft_consensus.cc:3055] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:17.051945 21297 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.052939 21316 raft_consensus.cc:3055] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:17.054715 21297 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:17.055433 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.056169 17518 raft_consensus.cc:2376] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10. Re-sending same reply.
W20260709 13:20:17.056499 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.053385 21316 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:17.052413 21257 raft_consensus.cc:740] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:17.064477 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.066125 16950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 524) took 1658 ms. Trace:
I20260709 13:20:17.066953 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.071833 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:17.074546 16879 raft_consensus.cc:1240] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:17.078286 16807 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:17.078653 21357 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.079267 21357 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.079797 21360 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:17.048120 21235 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.080511 21360 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.081089 21235 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.081261 16807 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:17.081805 21357 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.080518 16801 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:17.058961 21123 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:17.082856 21360 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:17.083058 21330 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 2.696s	user 0.015s	sys 0.026s
I20260709 13:20:17.083065 21123 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.083969 16878 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:17.084420 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:17.085232 16878 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:17.085687 21123 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.083724 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:17.086644 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.086787 16803 raft_consensus.cc:2393] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 15: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:17.087227 16878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efa1a19816094c78802287ff39e74b62"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44070
I20260709 13:20:17.091068 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:17.090762 21257 consensus_queue.cc:260] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.092001 16805 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:17.092262 21257 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:17.093412 16952 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 12: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:17.094146 21398 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.094853 21398 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.068584 16950 rpcz_store.cc:276] 0709 13:20:15.407828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.420328 (+ 12500us) service_pool.cc:224] Handling call
0709 13:20:15.596467 (+176139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:15.680072 (+ 83605us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:15.680349 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:20:15.741779 (+ 61430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:15.742017 (+   238us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:15.742074 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.065775 (+1323701us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b54002085d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:17.065831 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.065961 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6249,"prepare.queue_time_us":670,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4585,"raft.queue_time_us":7031,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":9949,"spinlock_wait_cycles":191703296,"thread_start_us":54696,"threads_started":1,"wal-append.queue_time_us":112770,"wal-append.run_cpu_time_us":1127,"wal-append.run_wall_time_us":1062194}
I20260709 13:20:17.096979 21398 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.097225 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:17.097508 21287 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.098201 21316 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.098898 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:17.099566 21316 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.106417 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:17.107179 16953 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:17.112404 16775 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:17.103854 16878 raft_consensus.cc:606] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Received request to transfer leadership
I20260709 13:20:17.115525 16878 raft_consensus.cc:614] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:17.116468 16802 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:17.117579 16881 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:17.110674 21287 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.120266 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44070 (request call id 97) took 1268 ms. Trace:
I20260709 13:20:17.120740 21317 consensus_queue.cc:1059] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:17.126224 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:17.126461 21317 raft_consensus.cc:3055] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:17.127179 16957 raft_consensus.cc:2393] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 15: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:17.130688 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 654) took 2080 ms. Trace:
W20260709 13:20:17.122539 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 162904us
I20260709 13:20:17.127032 21317 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:17.135215 21317 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:17.136370 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 68242us
I20260709 13:20:17.137152 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.139050 21357 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:17.139241 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.139631 21357 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:17.141115 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.141518 20901 consensus_queue.cc:1059] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:17.142498 21147 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.142719 21226 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:17.141139 21357 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.121670 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:17.139328 21123 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:17.146087 21167 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:17.146548 21167 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:17.142519 20901 consensus_queue.cc:1243] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer ca1b60a074dc47cd8e68cc57a33a94a3 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:20:17.147816 21167 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.148793 21147 raft_consensus.cc:3055] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:17.149278 21147 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:17.150590 16878 rpcz_store.cc:276] 0709 13:20:15.847452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.087041 (+1239589us) service_pool.cc:224] Handling call
0709 13:20:17.116043 (+ 29002us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.149288 21167 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.160202 17519 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:17.131194 16885 rpcz_store.cc:276] 0709 13:20:15.050656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.129532 (+2078876us) service_pool.cc:224] Handling call
0709 13:20:17.129988 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.130254 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.130290 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:17.130365 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:17.130426 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.130495 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.130625 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.167378 21219 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:14.990037 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:17.151607 21191 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.157224 16802 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 2142) took 1198 ms. Trace:
I20260709 13:20:17.158288 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.169438 16802 rpcz_store.cc:276] 0709 13:20:15.958758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:15.958942 (+   184us) service_pool.cc:224] Handling call
0709 13:20:17.096942 (+1138000us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b58001d0498. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf71a22 00007feef4e8ac09 00007feef3fe4ee0 00007feef40ae0ab 00007feef40ae131 00007feef405c0a0 00007feef405b984 00007feeed5d66d4 00007feeed5d6662
0709 13:20:17.157116 (+ 60174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200256256}
I20260709 13:20:17.150231 21147 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.171489 21147 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:17.155099 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:17.176738 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.187661 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.193367 17524 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:17.190169 16956 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:17.201035 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:17.206053 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:20:17.207942 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 66968.1us
I20260709 13:20:17.208465 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:17.209091 16959 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:17.215706 21342 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:17.216549 21342 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.217195 16885 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:20:17.218550 21317 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:17.220140 21418 consensus_queue.cc:1059] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:20:17.209654 21219 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:17.221426 21219 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:17.223832 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.224327 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 2113) took 1850 ms. Trace:
I20260709 13:20:17.224679 16880 rpcz_store.cc:276] 0709 13:20:15.373486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.197701 (+1824215us) service_pool.cc:224] Handling call
0709 13:20:17.211326 (+ 13625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:17.223985 (+ 12659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.224019 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:17.224068 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:17.224108 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.224162 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.224278 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:20:17.226871 16806 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:17.228976 16775 leader_election.cc:400] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13.
I20260709 13:20:17.229390 16775 leader_election.cc:403] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:20:17.233889 21167 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13.
W20260709 13:20:17.239804 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.241708 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.242689 21157 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:17.243288 21157 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.243963 21324 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:17.243201 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:17.245734 21157 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:17.246668 17521 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:17.219292 21342 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:17.252319 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.252555 21418 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.253070 21418 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.253487 17527 raft_consensus.cc:1240] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:17.255949 21219 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:17.246376 21157 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:17.265429 17524 raft_consensus.cc:1240] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:17.262264 16775 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.273628 21191 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:17.275815 21157 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:17.260429 21418 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.281265 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.288087 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.289083 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.290367 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.280232 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:17.297173 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 89981us
I20260709 13:20:17.297639 16808 raft_consensus.cc:1240] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:17.300057 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:17.300841 16802 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:17.299547 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:17.304649 21418 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:17.305183 21418 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:17.305212 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:17.306278 21418 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.308250 21342 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:17.308871 21342 raft_consensus.cc:697] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:17.309970 21342 consensus_queue.cc:237] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.315917 21338 consensus_queue.cc:1059] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:17.317705 21284 raft_consensus.cc:3055] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:17.318172 21284 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:17.319283 21284 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.321116 21284 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.323217 17527 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:17.293406 21219 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:17.332718 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 84213.6us
I20260709 13:20:17.332648 21075 consensus_queue.cc:1059] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:20:17.332579 21157 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.335791 21075 raft_consensus.cc:3055] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:17.336180 21075 raft_consensus.cc:740] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:17.337119 21075 consensus_queue.cc:260] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.338800 21075 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:17.344354 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.332789 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:17.355777 21235 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.360983 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:17.361100 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.361658 16952 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:20:17.361801 17524 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
W20260709 13:20:17.367449 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.367734 21369 raft_consensus.cc:3055] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:17.368183 21369 raft_consensus.cc:740] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:17.369493 21369 consensus_queue.cc:260] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.371016 21369 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.373152 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:17.376098 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:17.362946 16704 catalog_manager.cc:5697] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 4 to 9, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 9 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:17.381471 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 48733.6us
I20260709 13:20:17.392637 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 652) took 2342 ms. Trace:
I20260709 13:20:17.393214 16876 rpcz_store.cc:276] 0709 13:20:15.050364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.161687 (+2111323us) service_pool.cc:224] Handling call
0709 13:20:17.162120 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:17.162546 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:17.162574 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:17.163001 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:20:17.210792 (+ 47791us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:17.392091 (+181299us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.392335 (+   244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.392408 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:17.392447 (+    39us) raft_consensus.cc:1685] finished
0709 13:20:17.392459 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.392583 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3639,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":224529,"threads_started":2,"wal-append.queue_time_us":114649}
I20260709 13:20:17.403230 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:17.404630 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:17.405332 16952 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:17.402195 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.409224 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:17.410475 16806 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:20:17.422588 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.414145 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 134572us
I20260709 13:20:17.425004 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.423360 16959 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:17.412712 21370 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:17.429531 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:17.437109 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:17.431577 21317 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.440987 21317 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.443285 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 651) took 2393 ms. Trace:
I20260709 13:20:17.448557 16952 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:17.430749 21235 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.446530 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:17.438936 16773 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.450131 16775 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:17.453436 16956 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:17.456385 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.445343 16883 rpcz_store.cc:276] 0709 13:20:15.050221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:16.982062 (+1931841us) service_pool.cc:224] Handling call
0709 13:20:16.997358 (+ 15296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:16.997879 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:20:17.075854 (+ 77975us) log.cc:844] Serialized 14 byte log entry
0709 13:20:17.442959 (+367105us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:17.443024 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:17.443076 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:17.443137 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:17.443237 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":251379,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":67,"raft.queue_time_us":7346,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":336036,"threads_started":2}
I20260709 13:20:17.438618 21370 raft_consensus.cc:697] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:17.459857 21316 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:17.462070 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 132282us
I20260709 13:20:17.462118 21316 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.462620 21219 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:17.463124 21191 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:17.463450 21219 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:17.464057 21219 raft_consensus.cc:697] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:17.463562 21191 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:17.464980 21191 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:17.465567 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.465013 21219 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:17.466694 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.451277 21317 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.469928 16773 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.457537 21235 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.475770 21316 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:17.480135 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.480602 21075 consensus_queue.cc:1059] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:17.486629 21075 raft_consensus.cc:3055] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:17.486862 21075 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:17.487298 21235 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.487612 21075 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.488183 21235 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:17.488896 21075 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:17.490615 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.475286 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.483996 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.481843 16924 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:17.437551 21280 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.492237 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.493731 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.493861 16704 catalog_manager.cc:5697] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 10, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 10 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.493546 21172 consensus_queue.cc:1059] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:20:17.493327 17524 raft_consensus.cc:2376] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15. Re-sending same reply.
I20260709 13:20:17.497537 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.497989 17519 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.499918 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.499864 16704 catalog_manager.cc:5697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 6 to 8, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 8 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.501730 16950 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:17.494472 21357 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:17.507037 21280 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.506716 21191 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.508186 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.509215 21257 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:17.509713 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.501703 16704 catalog_manager.cc:5697] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.510557 21257 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:17.511027 21191 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.511147 21257 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:17.512341 21257 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.511080 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.499195 21317 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:17.499814 21418 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:17.519402 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 44204.8us
I20260709 13:20:17.508249 21172 raft_consensus.cc:3055] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:17.521759 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:17.522145 16704 catalog_manager.cc:5697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.522665 16775 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:20:17.523772 16706 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58310 (request call id 267) took 19901 ms (client timeout 15000 ms). Trace:
I20260709 13:20:17.525182 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:17.524593 21407 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:17.531560 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.528247 21144 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:17.520869 21418 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.533998 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.525991 21191 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:17.533458 16950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6455509d1ac14e1d961f38607a869924"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:17.524884 21172 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:17.536952 16924 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:17.527001 21357 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:17.537607 17519 raft_consensus.cc:2410] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:20:17.538677 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.535275 21191 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:17.541961 17527 raft_consensus.cc:1240] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:17.538564 16950 raft_consensus.cc:606] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:17.534626 21361 consensus_meta.cc:287] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.006s
I20260709 13:20:17.538857 21357 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.544934 16704 catalog_manager.cc:5697] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.533646 21144 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:17.549134 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.537269 21418 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.544437 21280 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:17.532646 21370 consensus_queue.cc:237] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.555927 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:17.543823 21191 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.554818 16773 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.557636 16956 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:17.558718 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.557374 17524 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:17.550416 21357 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.559518 16704 catalog_manager.cc:5697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:17.557804 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.540407 21342 consensus_queue.cc:1059] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:20:17.552223 21144 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:17.553396 21407 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:17.562363 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.560776 16957 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:17.545217 21338 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:20:17.556318 21280 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.576097 17518 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:17.577414 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.569290 20770 raft_consensus.cc:3055] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:17.578195 20770 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:17.579079 16957 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:17.568060 21147 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.570458 21280 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.584635 16799 tablet_service.cc:1558] Processing DeleteTablet for tablet 78ca000fd50c4b38bfdd60badc024845 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:43930
I20260709 13:20:17.579080 20770 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.589622 21143 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:17.590157 16957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:17.590373 20770 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:17.590730 16957 raft_consensus.cc:606] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:17.591068 16957 raft_consensus.cc:614] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:17.591832 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.588940 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:17.603924 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 49138.4us
W20260709 13:20:17.605551 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.591529 21167 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:20:17.612921 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.573995 21172 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.614375 21361 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36958 (request call id 1) took 9549 ms. Trace:
I20260709 13:20:17.615271 21284 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:17.591666 21407 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:20:17.617532 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:17.524245 16706 rpcz_store.cc:269] 0709 13:19:57.583835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.585764 (+  1929us) service_pool.cc:224] Handling call
0709 13:19:57.719397 (+133633us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b5400037fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeef000090 00007feeef09ef3a 00007feef4e551cc 00007feef4f5337e 00007feef34142a4 00007feef3414232 00007feef3414161 00007feef34140dc 00007feef3413392 00007feeed3d148c 00007feeed3d08c6
0709 13:20:17.460780 (+19741383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:13.308828 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:13.309542 (+   714us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:13.309590 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:20:13.309615 (+    25us) tablet.cc:662] Decoding operations
0709 13:20:13.343472 (+ 33857us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:13.343560 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:13.343592 (+    32us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:20:13.349204 (+  5612us) tablet.cc:701] Row locks acquired
0709 13:20:13.349227 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:20:13.349370 (+   143us) write_op.cc:270] Start()
0709 13:20:13.349504 (+   134us) write_op.cc:276] Timestamp: P: 1783603213349324 usec, L: 0
0709 13:20:13.349533 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:20:13.407847 (+ 58314us) log.cc:844] Serialized 3619 byte log entry
0709 13:20:14.347656 (+939809us) op_driver.cc:464] REPLICATION: finished
0709 13:20:14.465999 (+118343us) write_op.cc:301] APPLY: starting
0709 13:20:14.495959 (+ 29960us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:14.584793 (+ 88834us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:14.594952 (+ 10159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:14.642881 (+ 47929us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:14.643076 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:20:14.643121 (+    45us) write_op.cc:312] APPLY: finished
0709 13:20:14.643383 (+   262us) log.cc:844] Serialized 71 byte log entry
0709 13:20:14.643561 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:14.643710 (+   149us) write_op.cc:454] Released schema lock
0709 13:20:14.643755 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:14.656371 (+ 12616us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:14.656419 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":814148,"reported_tablets":49,"spinlock_wait_cycles":95979392,"child_traces":[["op",{"apply.queue_time_us":83200,"apply.run_cpu_time_us":6743,"apply.run_wall_time_us":185734,"num_ops":9,"prepare.queue_time_us":71964,"prepare.run_cpu_time_us":23723,"prepare.run_wall_time_us":253614,"raft.queue_time_us":146830,"raft.run_cpu_time_us":5848,"raft.run_wall_time_us":63514,"replication_time_us":979910,"thread_start_us":297292,"threads_started":4,"wal-append.queue_time_us":270517,"wal-append.run_cpu_time_us":17278,"wal-append.run_wall_time_us":1975286}]]}
I20260709 13:20:17.621554 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.622542 17518 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:17.631016 21235 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:17.632133 21357 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.595304 21316 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.655895 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.656066 16956 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
W20260709 13:20:17.656981 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.611083 21143 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:20:17.666610 21191 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.667222 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:17.667189 21407 consensus_queue.cc:1059] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:17.668633 21407 raft_consensus.cc:3055] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:17.669095 21407 raft_consensus.cc:740] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:17.670269 21407 consensus_queue.cc:260] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.672204 21257 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.672915 21257 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.676432 21257 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.678608 17519 raft_consensus.cc:2955] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 4 to 9, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:20:17.682811 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.661948 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:17.683324 16959 raft_consensus.cc:606] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:17.683522 16952 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.683759 16959 raft_consensus.cc:614] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:17.662794 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.649546 21357 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.690084 17518 raft_consensus.cc:2410] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:20:17.621109 21361 rpcz_store.cc:276] 0709 13:20:08.065243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:08.065407 (+   164us) service_pool.cc:224] Handling call
0709 13:20:08.137260 (+ 71853us) log.cc:844] Serialized 487 byte log entry
0709 13:20:08.805108 (+667848us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b54005f3320. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef00f142 00007feeeefefeaa 00007feeeeff6d53 00007feeeeff6cd9 00007feeeeff6c69 00007feeeeff6c31 00007feeeeff5dfd 000000000038f354 000000000038f199 00007feeebfa9475
0709 13:20:17.614271 (+8809163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261312,"raft.queue_time_us":272165,"raft.run_cpu_time_us":7262,"raft.run_wall_time_us":414007,"spinlock_wait_cycles":11028352,"thread_start_us":250299,"threads_started":2,"wal-append.queue_time_us":286433,"wal-append.run_cpu_time_us":2027,"wal-append.run_wall_time_us":1155968}
I20260709 13:20:17.691376 21398 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.691517 16692 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:20:17.691965 21398 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.694245 21398 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.694777 21398 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:17.694810 21191 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.692647 21316 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.696723 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.697422 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:17.697968 16959 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.702597 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.703516 17518 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 11: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:17.705689 16775 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:17.707572 16951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:17.708324 16951 raft_consensus.cc:606] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:17.695367 21398 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:17.724885 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 153711us
I20260709 13:20:17.730170 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.730050 21317 consensus_queue.cc:1059] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:17.701025 21284 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:17.734833 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.736094 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:17.712574 21407 raft_consensus.cc:3060] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:17.736964 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:17.743470 16959 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:17.724476 21172 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.746315 17518 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:17.764850 16809 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:17.764706 16775 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:17.765619 21357 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:17.766124 21357 raft_consensus.cc:697] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:17.766228 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:17.731600 21191 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:17.773888 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:17.775704 16802 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 12: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:20:17.780011 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:17.773408 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:17.780778 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 50684.8us
I20260709 13:20:17.781468 16952 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:17.784137 16883 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caf243a747f348a29b25b4642b64788e"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:37974
I20260709 13:20:17.784837 16883 raft_consensus.cc:606] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:17.785256 16883 raft_consensus.cc:614] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:17.787106 21217 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:17.788764 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:17.791087 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:17.791834 16848 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.796032 21217 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.797119 21217 consensus_queue.cc:1059] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:17.798439 21217 raft_consensus.cc:3055] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:17.767148 21144 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.798970 21217 raft_consensus.cc:740] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:17.801191 21144 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:17.801348 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 54294.6us
I20260709 13:20:17.802397 16924 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:17.803879 21338 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:17.804297 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 160378us
I20260709 13:20:17.806197 16775 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:17.795270 16848 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:17.817234 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:17.819612 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:17.807119 21338 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:17.806833 21191 raft_consensus.cc:697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:17.767138 21357 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.812546 21144 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:17.807219 21284 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.827741 16922 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:17.835171 21370 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.837404 21284 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:17.825604 21338 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.844126 21191 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.847040 21398 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.833424 21144 raft_consensus.cc:697] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:20:17.852337 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 50094.5us
I20260709 13:20:17.862346 21451 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:17.864625 21451 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.866935 21451 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:17.867384 21316 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:17.867239 16694 catalog_manager.cc:5028] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): tablet 78ca000fd50c4b38bfdd60badc024845 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:20:17.868180 21280 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.873548 21316 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:17.875567 21316 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:17.876780 16950 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:17.878705 21143 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:17.871704 16924 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:17.884739 21257 raft_consensus.cc:3055] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:17.885273 21257 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:17.885848 21280 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.886472 21257 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.822496 21217 consensus_queue.cc:260] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:17.895342 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 100144us
I20260709 13:20:17.897663 21087 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:20:17.897866 21361 consensus_queue.cc:1059] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:17.848403 21144 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.899014 21361 raft_consensus.cc:3055] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:20:17.899371 21361 raft_consensus.cc:740] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:17.900194 21361 consensus_queue.cc:260] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.901259 21361 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:17.896672 21451 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:17.902864 21451 raft_consensus.cc:697] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:17.906805 16952 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:17.908108 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:17.910300 21143 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:17.893314 21418 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.908504 21324 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 13:20:17.912256 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 48223.8us
I20260709 13:20:17.910873 21143 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:20:17.913462 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 93977.1us
I20260709 13:20:17.907467 21370 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:17.916025 21143 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:17.918066 21450 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.082s	user 0.003s	sys 0.000s
W20260709 13:20:17.924665 21449 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:20:17.929822 21418 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.914938 21257 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:17.930776 21217 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:17.940654 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:17.931305 16924 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:17.941664 21370 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:17.942451 21370 consensus_queue.cc:1059] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:17.903196 21338 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.944833 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:17.946811 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:17.932209 21451 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:17.947402 16883 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:17.945176 21338 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:17.948792 21453 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:17.943499 21370 raft_consensus.cc:3055] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:17.952000 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:17.957543 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 43644.7us
W20260709 13:20:17.960426 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 56144.4us
I20260709 13:20:17.962170 16922 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:17.913421 21317 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:17.963758 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:17.968367 21418 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:17.970510 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:17.975980 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:17.977031 16876 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:17.961405 21453 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:17.979884 21453 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:17.967080 21324 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:20:17.986979 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:17.987552 16880 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:17.989089 16881 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:17.988950 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:17.990070 16879 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:17.990253 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:17.990761 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:17.991086 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:17.991503 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:17.991935 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:17.992158 16879 raft_consensus.cc:2410] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:20:17.992791 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:17.993062 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:17.993692 16879 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:17.994171 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:17.991351 16877 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:17.990931 16881 raft_consensus.cc:2368] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13.
I20260709 13:20:17.992338 16885 raft_consensus.cc:2393] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:18.001614 16880 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
W20260709 13:20:18.006107 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 44040.7us
I20260709 13:20:18.010375 16957 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:17.959873 21370 raft_consensus.cc:740] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:18.011056 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.010386 16877 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:18.012535 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:18.013608 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 45510.9us
I20260709 13:20:18.015980 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:18.017388 16956 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:18.017545 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.017434 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:18.018710 16957 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:20:18.019338 16883 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:18.017434 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.021494 16951 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:18.023079 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:18.024519 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.030004 16952 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:18.005849 21338 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:18.038851 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:20:18.042937 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.043919 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.044550 21087 consensus_queue.cc:1059] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:18.044955 21361 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:18.045454 21361 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.045811 21361 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.045991 21418 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:18.046501 21418 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.046917 21418 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.052521 21157 raft_consensus.cc:3055] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:18.052990 21157 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:18.053946 21157 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.002446 21317 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.061539 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:20:18.065487 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 49595.4us
I20260709 13:20:18.067603 21370 consensus_queue.cc:260] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.069007 21370 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:18.069442 17519 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:18.069638 21284 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:18.078612 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.079666 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.079999 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:18.082330 21317 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.083220 16956 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:18.082412 21157 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:18.091022 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:18.092381 16804 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:18.093927 21316 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:18.096971 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.104054 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.100428 21219 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 13:20:18.116000 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.121500 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:18.122220 16951 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 12: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:18.122723 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:18.118592 21284 consensus_queue.cc:1059] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:20:18.127501 21284 raft_consensus.cc:3055] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:18.127923 21284 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:18.128285 21316 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:18.127815 21087 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:18.125917 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.128841 21284 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.129637 21087 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.130458 21284 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.131877 21087 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:18.136678 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 52497.3us
I20260709 13:20:18.136508 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.137646 16953 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:18.139573 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:18.142221 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.142339 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.143312 16802 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:18.142319 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.144191 16806 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:18.144194 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:18.143414 16753 connection.cc:573] client connection to 127.15.90.2:33931 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:20:18.118832 21418 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:18.152037 16756 auto_rebalancer.cc:893] Removing replace marker failed: recv error from unknown peer: Transport endpoint is not connected
W20260709 13:20:18.152428 16756 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:20:18.154489 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.154726 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.155202 16877 raft_consensus.cc:2393] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 15: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:18.155339 16880 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:18.156876 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.157410 16877 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
W20260709 13:20:18.152676 16756 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:20:18.171340 16876 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:18.172240 16877 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 7. Current term is 8. Ops: []
I20260709 13:20:18.176029 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.176297 16883 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:18.176695 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.177386 16959 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 12: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:18.192310 21418 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:18.194624 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:18.199167 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.195761 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.196734 16882 raft_consensus.cc:1275] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:20:18.197300 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.197707 21361 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:18.199095 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 50408.5us
I20260709 13:20:18.202075 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:18.195705 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.202780 16957 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.200718 16882 pending_rounds.cc:85] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 10
I20260709 13:20:18.152710 21451 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.203567 16882 pending_rounds.cc:107] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:20:18.206267 16882 raft_consensus.cc:2889] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:18.207573 16959 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:18.208556 16924 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:18.209060 21280 consensus_queue.cc:1059] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:18.210451 21338 consensus_queue.cc:1059] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:18.210690 21172 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:18.210839 16924 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:18.211310 21172 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:18.211638 21369 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:18.212203 21361 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.205128 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.216569 16951 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:18.212502 21172 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.221475 16850 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:18.222604 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.216647 21217 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:18.224362 21172 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.230041 16957 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:18.233197 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.234308 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:18.231009 21280 raft_consensus.cc:2764] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:18.239161 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.239804 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.239302 16885 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:18.241070 16802 raft_consensus.cc:1240] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:18.241523 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.241976 16880 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:18.242105 16882 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:18.239807 16878 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:18.243273 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.244030 16808 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:18.241071 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.245608 16881 raft_consensus.cc:2410] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:20:18.248302 16850 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:18.251705 16803 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:18.215171 21451 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:18.255923 21457 log.cc:927] Time spent T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:20:18.247334 21217 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:18.259548 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.263147 16802 raft_consensus.cc:1240] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:18.252256 21257 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:18.265232 21257 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.265564 21257 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.267992 21418 raft_consensus.cc:3055] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:18.268353 21418 raft_consensus.cc:740] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:18.269169 21418 consensus_queue.cc:260] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.270352 21418 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:18.259883 16850 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.279909 16884 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:18.282459 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:18.283049 16880 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:20:18.286567 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 221660us
I20260709 13:20:18.287281 16850 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:18.305133 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 45646.6us
I20260709 13:20:18.284940 21338 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.286355 21316 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.287281 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:18.340570 16884 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:18.288108 16801 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:18.346079 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.343711 21454 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.348428 21454 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.350095 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:18.350476 21454 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.350674 16809 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.351862 21280 consensus_queue.cc:1059] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:18.352741 21280 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:18.353133 21280 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:18.353084 21338 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.354058 21280 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.355132 21338 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:18.355291 21280 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.341337 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:18.355862 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 68648us
W20260709 13:20:18.345142 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.352829 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:20:18.345213 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 58008.5us
I20260709 13:20:18.359225 16809 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:18.359230 21361 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:18.360829 21361 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.361151 21361 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.362833 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:18.359824 21454 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:18.364131 21284 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:18.364675 21284 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:18.365064 21284 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:18.365340 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.364161 21454 raft_consensus.cc:697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:18.368297 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:18.369020 16802 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:18.372529 16775 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:18.373696 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.368595 21454 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.374325 16806 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:20:18.375658 16806 pending_rounds.cc:85] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 9
I20260709 13:20:18.376032 16806 pending_rounds.cc:107] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:20:18.376282 16806 raft_consensus.cc:2889] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:18.376236 21357 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:18.377033 21144 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.372567 21191 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:18.377560 21172 consensus_queue.cc:1059] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:18.384136 21370 raft_consensus.cc:3055] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:18.384519 21370 raft_consensus.cc:740] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:18.374755 16801 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:18.385416 21370 consensus_queue.cc:260] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.386166 21284 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.388371 21284 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:18.340099 21143 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.400364 21235 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:18.401412 21235 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:18.402273 21235 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:18.406384 17492 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.407948 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:18.409240 21338 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:18.411427 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.378638 21369 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:18.434305 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 44789.4us
I20260709 13:20:18.436008 16802 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:18.379261 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.436231 21167 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:18.440258 21167 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.440650 17518 raft_consensus.cc:3055] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:18.440822 21191 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.441126 17518 raft_consensus.cc:740] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:18.441854 17518 consensus_queue.cc:260] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.442957 17518 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.379784 21219 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:18.383281 17519 raft_consensus.cc:3055] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:18.443941 17519 raft_consensus.cc:740] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:18.427594 21370 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.445091 17519 consensus_queue.cc:260] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.446008 17519 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.341619 21217 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
W20260709 13:20:18.450901 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 92259.3us
I20260709 13:20:18.442303 21167 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:18.468271 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 111467us
I20260709 13:20:18.468958 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.452705 21324 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:18.466982 21453 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:18.480240 21453 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.464035 21257 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.483469 21257 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:18.484058 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 104846us
I20260709 13:20:18.485045 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:18.486485 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:18.487885 21468 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:18.489885 21143 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:18.490832 21143 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:18.493538 17527 raft_consensus.cc:3055] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:18.493921 17527 raft_consensus.cc:740] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:18.494832 17527 consensus_queue.cc:260] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.495965 17527 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:18.452746 21144 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:18.476459 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:18.497637 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:18.501958 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.506266 17518 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:20:18.507179 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 55474.8us
I20260709 13:20:18.504863 17519 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:20:18.507972 17519 pending_rounds.cc:85] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 8
I20260709 13:20:18.508348 17519 pending_rounds.cc:107] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:20:18.508126 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:18.503871 16924 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:18.511591 17519 raft_consensus.cc:2889] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:18.515389 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 46499.5us
I20260709 13:20:18.516357 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.519337 16775 leader_election.cc:400] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13.
I20260709 13:20:18.501058 21453 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:18.520228 21284 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:20:18.508881 21418 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:18.516656 21257 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:18.520366 21470 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:18.530639 21470 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.530309 21257 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.530977 21470 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:18.532622 21257 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:18.522209 21219 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:18.520347 21167 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.534627 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:18.506150 21144 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.518677 21143 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:20:18.535876 21324 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:18.536772 21144 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.496835 21338 consensus_queue.cc:1059] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:20:18.537598 21338 raft_consensus.cc:3055] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:18.537949 21338 raft_consensus.cc:740] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:18.538748 21316 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:18.538815 21338 consensus_queue.cc:260] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.540174 21338 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.510154 21317 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:18.519153 21369 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:18.544395 21369 raft_consensus.cc:697] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:18.545367 21369 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.516134 21361 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.513070 21280 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:18.548592 21361 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.517879 16924 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:18.549700 21361 raft_consensus.cc:2764] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:20:18.550262 21280 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:18.551007 21280 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:18.552529 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.554322 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.557240 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.528292 17527 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:18.528535 21191 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:18.534557 21157 consensus_queue.cc:1059] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:18.524189 21451 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.553674 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:18.559751 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:18.561286 16952 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.563186 21157 raft_consensus.cc:3055] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:18.564086 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.565342 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:18.566289 16804 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:18.564831 16805 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:20:18.572444 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:18.575099 21451 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:18.577772 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:18.556830 21361 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:18.563565 21157 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:18.579753 16775 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:18.581261 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:18.581564 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:18.560312 21370 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.585457 17520 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.585680 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:18.586277 17524 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.587229 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.587965 16881 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:20:18.571355 21087 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:18.582535 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.587801 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:18.551924 21280 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.597748 16806 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:20:18.605212 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.610842 16803 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 14.
I20260709 13:20:18.614794 16952 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:18.561720 21144 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:20:18.566721 21284 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:20:18.571194 21143 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:20:18.623521 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.625047 16804 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:20:18.630678 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.569561 21418 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:20:18.584651 21398 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:18.625998 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:18.636278 16803 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 12: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:18.626492 16807 raft_consensus.cc:1240] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:18.584518 21191 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:18.585465 21454 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.577112 21324 consensus_queue.cc:1059] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:20:18.648810 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.585673 21407 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.598553 21087 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:18.641319 21317 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:18.642242 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.642784 21167 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:18.619413 21219 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:18.645247 16805 raft_consensus.cc:1240] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 13. Current term is 14. Ops: []
W20260709 13:20:18.652485 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.609200 21370 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.653399 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:18.653970 21191 raft_consensus.cc:697] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:18.661304 21407 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.667369 21191 consensus_queue.cc:237] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.667635 16775 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:18.668797 21407 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.669634 21407 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:18.654474 21454 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.673827 21454 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:18.662230 21087 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:18.675266 21480 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:18.676023 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.677284 16959 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:18.677516 16950 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:18.678159 21370 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:18.632411 21316 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:18.668048 21219 raft_consensus.cc:697] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:18.679363 21316 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.680227 21475 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.680120 21219 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.680753 21475 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.681396 21316 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.638348 21398 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.682230 21398 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:18.675408 16957 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:18.632839 21476 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:18.688167 21470 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.688838 21476 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.665868 21317 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.690308 21470 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.667959 21167 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:18.664014 17520 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:18.682837 21475 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.687875 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:18.670102 21407 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.696583 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.701946 16952 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:18.712854 16951 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:20:18.714174 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:18.714677 16951 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:18.715372 16922 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:20:18.726769 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 137320us
I20260709 13:20:18.733352 16922 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:18.711356 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.736421 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.742316 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.743000 16807 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:18.749920 16950 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:18.750192 16952 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 14.
W20260709 13:20:18.760377 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:18.764297 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.774382 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:18.776603 16804 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:18.775305 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.777508 16810 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:18.781152 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:18.782001 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 138681us
I20260709 13:20:18.736830 21370 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:18.773200 21480 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.779454 21316 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:18.775971 21317 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.801808 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.780236 21453 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:18.803996 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.784142 21468 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:18.810626 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.811192 16952 raft_consensus.cc:1813] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Handling vote request from an unknown peer 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:18.811736 16952 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 14: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:18.814435 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.818859 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.819406 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.816835 16950 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:18.820293 16953 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:18.819458 16957 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:18.822548 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.822808 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.823035 16850 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:18.823408 16877 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:18.824707 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.798183 21370 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.826537 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:18.827387 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.829741 21167 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:18.830631 16884 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:18.831530 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:18.832017 21476 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:18.832068 16884 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:18.832350 21087 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.832767 21454 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:18.833344 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:18.836020 17521 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:18.835078 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:18.838496 21485 log.cc:927] Time spent T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:20:18.838814 16958 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:18.844485 21407 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:18.846997 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.851030 17524 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:18.856494 21087 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:18.857904 21317 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:18.857933 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.858609 21317 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:18.859057 21317 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:18.862604 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.864609 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.864926 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.858404 16808 raft_consensus.cc:1240] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:20:18.866541 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.867483 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:18.868278 16802 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:18.805590 21316 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.811302 21453 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.876957 16951 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
W20260709 13:20:18.872489 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 51790.7us
I20260709 13:20:18.863826 21407 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:18.797542 21480 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.837291 21370 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:18.847210 21167 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:20:18.834587 16876 raft_consensus.cc:2955] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 4 to 9, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:20:18.898262 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.947712 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:18.905668 21143 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:18.949069 21490 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:18.949672 21491 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:18.996666 21493 log.cc:927] Time spent T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:18.944737 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:18.874658 21219 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:20:18.998752 21316 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.001484 21157 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.003171 21157 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:19.005321 21398 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.006184 21143 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.011426 21480 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:19.011574 21143 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.014096 21370 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:18.989128 21235 consensus_meta.cc:287] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.001s
I20260709 13:20:19.015002 21235 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.015733 21398 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:19.017071 21235 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:18.987151 21191 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.018008 21191 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.019845 21453 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:19.020073 21191 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.021373 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:18.996644 21491 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:19.023969 21491 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:18.949738 21317 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:18.984436 21407 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:19.034126 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:18.984762 16885 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
W20260709 13:20:19.036962 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 173249us
I20260709 13:20:19.043767 21317 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:19.038509 21470 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:19.045459 21470 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:19.045840 21470 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:19.047326 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:19.047592 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:19.048678 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:19.051824 16885 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:19.047959 17518 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:20:19.053409 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:19.053987 16885 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:19.054374 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 106751us
I20260709 13:20:19.058480 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:19.055895 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:19.038698 21407 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:19.063845 16773 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:19.063906 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:19.066957 16885 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:19.069880 21361 raft_consensus.cc:3055] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:19.070271 21361 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:19.071200 21361 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.072288 21361 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:19.073153 21501 log.cc:927] Time spent T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 13:20:19.064996 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:19.077008 21144 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:19.077423 21144 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.077772 21144 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:19.082278 16808 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:19.082958 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:19.083658 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.085052 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:19.084718 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:19.086562 16806 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:19.086798 16807 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:19.089922 16802 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:20:19.090157 16878 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:19.091611 16885 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:19.091976 16850 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:19.070327 21494 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:19.093653 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:19.098614 16881 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:19.095568 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:19.100773 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:19.102885 16850 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:19.120591 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:19.124152 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:19.088277 21324 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:19.132732 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:19.097376 21217 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:19.079941 21157 consensus_queue.cc:1059] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:20:19.102211 21257 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:19.145680 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:19.168510 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.110071 21316 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:19.120059 21475 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:19.242270 16959 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:20:19.138042 21454 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:19.245546 16806 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
W20260709 13:20:19.223928 16704 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51366 (request call id 188) took 22114 ms (client timeout 15000 ms). Trace:
I20260709 13:20:19.136600 21172 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:19.250412 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.263377 16959 pending_rounds.cc:85] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 6
W20260709 13:20:19.219955 21482 log.cc:927] Time spent T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:20:19.277151 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 156550us
W20260709 13:20:19.282436 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.285568 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:19.220799 21317 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:19.240056 21487 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:19.308619 16959 pending_rounds.cc:107] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:20:19.313174 16959 raft_consensus.cc:2889] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:19.253387 21453 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:19.262358 21324 raft_consensus.cc:3055] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:19.178215 21451 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.178536 21473 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:20:19.269688 16704 rpcz_store.cc:269] 0709 13:19:57.109296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:57.109512 (+   216us) service_pool.cc:224] Handling call
0709 13:20:19.223850 (+22114338us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:17.959113 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:17.968932 (+  9819us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:17.968984 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:20:17.969004 (+    20us) tablet.cc:662] Decoding operations
0709 13:20:18.000625 (+ 31621us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:18.000712 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:18.000746 (+    34us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:20:18.001407 (+   661us) tablet.cc:701] Row locks acquired
0709 13:20:18.001472 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:20:18.001638 (+   166us) write_op.cc:270] Start()
0709 13:20:18.001765 (+   127us) write_op.cc:276] Timestamp: P: 1783603218001577 usec, L: 0
0709 13:20:18.001804 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:20:18.059054 (+ 57250us) log.cc:844] Serialized 2793 byte log entry
0709 13:20:18.096915 (+ 37861us) spinlock_profiling.cc:243] Waited 8.46 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeebf8c0ac 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b
0709 13:20:18.542501 (+445586us) op_driver.cc:464] REPLICATION: finished
0709 13:20:18.806258 (+263757us) write_op.cc:301] APPLY: starting
0709 13:20:18.821864 (+ 15606us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:18.841154 (+ 19290us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:18.841198 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:18.841879 (+   681us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:18.842179 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:20:18.842243 (+    64us) write_op.cc:312] APPLY: finished
0709 13:20:18.842572 (+   329us) log.cc:844] Serialized 59 byte log entry
0709 13:20:18.842750 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:18.842861 (+   111us) write_op.cc:454] Released schema lock
0709 13:20:18.842926 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:18.843294 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:18.843324 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41018,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":235277,"apply.run_cpu_time_us":3122,"apply.run_wall_time_us":53187,"num_ops":7,"prepare.queue_time_us":156615,"prepare.run_cpu_time_us":12213,"prepare.run_wall_time_us":191965,"raft.queue_time_us":252901,"raft.run_cpu_time_us":8821,"raft.run_wall_time_us":88198,"replication_time_us":540491,"spinlock_wait_cycles":19452800,"thread_start_us":404678,"threads_started":4,"wal-append.queue_time_us":144995}]]}
I20260709 13:20:19.314720 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:19.138470 21468 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.174s
I20260709 13:20:19.272500 21475 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.175562 21369 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:19.239866 21462 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:19.318697 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:19.318608 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:19.319689 21172 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:19.244117 21235 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.325383 17527 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:19.243491 21157 consensus_queue.cc:1048] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:20:19.222630 21470 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.312615 21317 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:19.354540 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 102429us
I20260709 13:20:19.356769 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:19.359078 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:19.359326 21172 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.359802 21491 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.361919 21491 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.355398 21317 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:19.352952 21235 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.313102 21487 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.325873 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:19.320147 21324 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:19.377631 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:19.381755 16801 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:19.381831 17523 raft_consensus.cc:2410] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:20:19.336802 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:19.156637 21507 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.186s
I20260709 13:20:19.342965 21476 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:20:19.347517 21418 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.331252 21475 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:19.349056 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 172679us
I20260709 13:20:19.332859 21369 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.312186 21144 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.326587 21451 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:19.327111 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 194426us
I20260709 13:20:19.375808 16957 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:19.376104 16848 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:19.376327 16806 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:19.323928 21453 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:19.383299 16922 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:19.384097 17526 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 12: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:19.337117 21462 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.407281 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:19.408092 16954 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:19.408459 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:19.408670 21451 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:19.409588 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:19.409893 21508 log.cc:927] Time spent T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:20:19.410218 21462 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.410449 21520 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.352401 21257 raft_consensus.cc:697] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:19.388757 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:19.391106 17527 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:19.413803 16922 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:19.413215 16881 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:20:19.415108 16775 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:19.391013 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:19.391856 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.381496 21487 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:19.417169 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:19.393959 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:19.416460 16957 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:19.417484 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:19.420396 17522 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:19.396000 21369 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:19.396258 21087 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.417693 17527 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:19.392314 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:19.421058 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:19.424208 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 48188.4us
I20260709 13:20:19.425985 17518 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:20:19.411480 21453 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:19.421864 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:19.433933 17527 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:19.437590 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:19.413522 21284 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:19.439971 16956 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:19.418848 21316 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:19.441195 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:19.421592 21480 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:19.395354 21418 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.451094 16958 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:20:19.467281 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:19.465651 17526 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:20:19.423523 21219 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:19.474869 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:19.427783 21519 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.435153 21490 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.418646 21191 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:20:19.442775 21357 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:19.481564 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:19.424940 21462 consensus_queue.cc:1059] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:20:19.423034 21451 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:20:19.485915 16952 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:19.492470 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:19.410966 21520 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.465550 21513 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:19.467341 21480 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:20:19.534597 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 120859us
W20260709 13:20:19.549491 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.536466 16881 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:19.439707 21087 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:19.551195 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 132403us
I20260709 13:20:19.537611 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:19.475368 21398 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:19.480512 21157 consensus_queue.cc:1059] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:20:19.549978 16952 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:19.553315 16881 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:20:19.560017 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.567400 16848 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:19.569341 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:19.572855 21316 consensus_queue.cc:1059] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:19.493444 21257 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.575201 16848 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:19.552471 21480 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:20:19.577827 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 110610us
I20260709 13:20:19.486515 21519 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.585350 21528 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:19.486135 21490 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.594532 21529 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:19.595719 16692 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 599f9a88b6cd4e818a1c59a0b4522480 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:19.575874 21491 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:19.582459 21157 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:19.579078 21470 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.618294 16881 raft_consensus.cc:1240] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:20:19.588006 21338 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.589506 21316 raft_consensus.cc:3055] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:19.588130 21498 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.590895 21505 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:19.602610 21518 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:19.621562 21491 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:19.621146 21235 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.645160 21519 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.647130 21520 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:19.647383 21507 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:19.623358 21316 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:19.657971 16801 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:19.641628 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:19.631559 21518 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:19.626492 21338 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:19.669646 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 248614us
W20260709 13:20:19.669947 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 108715us
I20260709 13:20:19.665740 21518 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:19.673943 16775 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:19.668015 21505 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:19.661917 21317 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.691917 21491 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:19.693168 21407 consensus_meta.cc:287] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.632s	user 0.007s	sys 0.004s
I20260709 13:20:19.693465 21317 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.694205 21505 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.696489 21505 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:19.631058 21498 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.677114 21468 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:19.681242 21338 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:19.684149 21517 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:20:19.688287 21524 log.cc:927] Time spent T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:19.698563 21143 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:19.704799 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:19.674368 21513 raft_consensus.cc:697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:19.657610 21451 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:20:19.672597 21418 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:19.673121 21454 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:19.656690 21507 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.705546 21517 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:19.716327 21517 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:19.717517 21507 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.713258 21235 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:19.720067 21143 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:19.722716 21143 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:19.623178 21191 raft_consensus.cc:2955] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 LEADER]: Committing config change with OpId 11.9: config changed from index 3 to 9, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:19.703347 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:19.724701 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:19.733142 21498 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.674701 21527 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:20:19.707507 21316 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.740744 21316 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:19.741014 21507 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:19.743352 21509 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.429s	user 0.003s	sys 0.000s
I20260709 13:20:19.749791 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:19.750236 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:19.750777 16801 raft_consensus.cc:2393] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:19.753986 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:19.754442 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:19.755244 16885 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:20:19.755826 16808 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:19.754632 16802 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:19.756229 16807 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:19.759658 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:19.727896 21361 consensus_meta.cc:287] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.655s	user 0.006s	sys 0.006s
I20260709 13:20:19.703466 21407 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:19.766865 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 182127us
I20260709 13:20:19.723403 21143 consensus_queue.cc:1243] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer 4b60b701acc7473e87e3e529a2a34689 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:20:19.768785 16877 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:19.784230 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:19.789250 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:19.789551 16885 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:19.784511 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:19.786162 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:19.767655 21534 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:19.787959 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:19.722740 21490 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:19.798431 16879 raft_consensus.cc:2368] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12.
I20260709 13:20:19.802824 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:19.805143 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:19.806110 16806 raft_consensus.cc:2393] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:19.806416 16802 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:19.808418 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2103) took 1072 ms. Trace:
I20260709 13:20:19.808773 16880 rpcz_store.cc:276] 0709 13:20:18.735750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.736291 (+   541us) service_pool.cc:224] Handling call
0709 13:20:18.782660 (+ 46369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.782961 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:18.782986 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.018926 (+235940us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b2c00000e98. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:20:19.019303 (+   377us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.065921 (+ 46618us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:19.065954 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.066015 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.742711 (+676696us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:19.808204 (+ 65493us) raft_consensus.cc:1685] finished
0709 13:20:19.808224 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.808358 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22402,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":6770,"spinlock_wait_cycles":26622720,"thread_start_us":46214,"threads_started":1,"wal-append.queue_time_us":159285}
I20260709 13:20:19.811013 16922 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:19.812049 21462 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:19.812323 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:19.813205 21534 raft_consensus.cc:697] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:19.814118 21534 consensus_queue.cc:237] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.817251 17525 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:19.817581 21087 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.818791 21480 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.819343 16881 raft_consensus.cc:1240] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:19.820429 21462 raft_consensus.cc:697] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:19.821733 21462 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.761224 21517 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.828903 16801 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:20:19.829633 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:19.826453 16848 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:19.830196 16810 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:19.830739 21491 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:19.831115 21491 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:19.831462 21491 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:19.832947 16922 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:19.835567 16808 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:19.835785 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:19.833904 21520 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:19.837565 21526 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:19.838259 21527 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:19.838629 16756 auto_rebalancer.cc:629] Failed to schedule move for tablet 6455509d1ac14e1d961f38607a869924: Illegal state: Replica ca1b60a074dc47cd8e68cc57a33a94a3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
W20260709 13:20:19.839022 21539 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:20:19.841498 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 2146) took 1020 ms. Trace:
I20260709 13:20:19.839813 21144 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:19.850822 16810 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:19.768518 21518 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.854414 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:19.854893 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:19.855559 16959 raft_consensus.cc:2368] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 12. Current term is 13.
I20260709 13:20:19.856092 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:19.771740 21475 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:19.861136 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:19.834466 21486 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:19.874948 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:19.875969 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:19.875824 17518 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:19.864796 21087 consensus_queue.cc:1059] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:19.865535 16707 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 7 to 10, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 10 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:19.866750 16802 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:19.868857 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:19.870626 21529 consensus_queue.cc:1059] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:19.842017 16876 rpcz_store.cc:276] 0709 13:20:18.821099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.821218 (+   119us) service_pool.cc:224] Handling call
0709 13:20:18.827328 (+  6110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:18.834459 (+  7131us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:19.475323 (+640864us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.780920 (+305597us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.796533 (+ 15613us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.796758 (+   225us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:19.840821 (+ 44063us) log.cc:844] Serialized 14 byte log entry
0709 13:20:19.841122 (+   301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.841213 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:19.841266 (+    53us) raft_consensus.cc:1685] finished
0709 13:20:19.841283 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:19.841427 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13807,"prepare.queue_time_us":37556,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":47091,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":6765,"thread_start_us":220693,"threads_started":2,"wal-append.queue_time_us":37223}
I20260709 13:20:19.802983 21361 consensus_queue.cc:1059] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:20:19.896927 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:19.878656 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:19.879220 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:19.855531 21527 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.965847 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 97089.5us
I20260709 13:20:19.889046 21520 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.891935 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:19.966718 17527 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
W20260709 13:20:19.967330 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 89460.7us
I20260709 13:20:19.931932 16707 catalog_manager.cc:5697] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 7, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:19.966161 16807 raft_consensus.cc:2368] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 14. Current term is 15.
I20260709 13:20:19.775347 21513 consensus_queue.cc:237] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:19.851771 21490 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:20:19.903093 21172 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.968632 21531 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:20:19.860827 21505 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:20:19.991302 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:20.005995 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:19.971452 21526 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:19.980805 21497 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:20:19.972505 21167 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:20.110131 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 230997us
I20260709 13:20:19.875044 21453 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.133723 21453 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:19.981310 21514 raft_consensus.cc:3055] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:20.134367 21514 raft_consensus.cc:740] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:20:20.005813 21487 consensus_meta.cc:287] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.006s
I20260709 13:20:20.135310 21514 consensus_queue.cc:260] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:20.135958 21487 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.136807 21514 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.138695 21487 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:20.126392 21167 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.144104 21167 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:19.999398 21357 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:20.149865 21357 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.124169 16707 catalog_manager.cc:5697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 8 to 11, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 11 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:20.110114 21418 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:19.989990 21219 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:20.131878 17492 leader_election.cc:400] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 12. Current term is 13.
W20260709 13:20:20.132014 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.264521 17492 leader_election.cc:403] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:20:20.155490 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:20.265277 17525 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:20.266978 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 139080us
I20260709 13:20:19.975941 21527 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.008117 21172 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.129347 21143 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:19.997195 21520 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:20.175825 21418 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.237924 21514 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:20.233791 16707 catalog_manager.cc:5697] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 8 to 11, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 11 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:20.231936 21515 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:20:20.259452 21369 consensus_meta.cc:287] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.814s	user 0.012s	sys 0.004s
I20260709 13:20:20.269070 16848 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:20.287654 17525 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:20:20.292618 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:20.294598 16810 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:20:20.305264 21172 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:20.305567 17524 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:20:20.306257 21541 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.277s	user 0.000s	sys 0.000s
W20260709 13:20:20.307789 21544 log.cc:927] Time spent T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 13:20:20.126515 21526 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:20.310271 21526 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:20.303455 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:20.331380 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:20.329758 16707 catalog_manager.cc:5697] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:20.335912 16801 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:20.336997 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:20.275360 21257 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:20.333060 16810 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:20.295235 21418 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:20.293910 21515 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.388095 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:20.388907 16804 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 11: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:20:20.385761 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 417802us
I20260709 13:20:20.278914 21476 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:20.274360 21219 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.326627 21480 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:20.419564 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:20.382025 16707 catalog_manager.cc:5697] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 11 to 12, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3), now has a pending config: VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1), VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2), VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3), VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 12 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:20.280049 21143 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.444654 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:20.390672 21515 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:20.335582 21514 consensus_queue.cc:1059] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:20:20.476468 16801 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:20:20.473292 17527 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:20.327921 21369 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.486481 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:20.442327 21454 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:20.385883 21257 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.487259 16959 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:20.492880 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:20.391258 21361 consensus_queue.cc:1059] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:20:20.445986 21398 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.456763 21475 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:20.461954 21480 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.493243 16707 catalog_manager.cc:5697] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 7, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 7 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:20.554437 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:20.555725 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:20.556039 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:20.604254 16885 raft_consensus.cc:2393] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:20.556865 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:20.605427 16958 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:20.567302 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:20.601990 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:20.603564 16878 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:20.573591 16954 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:20.612041 16876 raft_consensus.cc:1217] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[8.5-13.7]   Dedup: 8.5->[10.6-13.7]
I20260709 13:20:20.612664 16876 pending_rounds.cc:85] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 5
I20260709 13:20:20.612926 16876 pending_rounds.cc:107] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:20:20.619138 16876 raft_consensus.cc:2889] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:20.491990 21490 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:20.425155 21476 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.490108 21514 consensus_queue.cc:1243] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer 96eaa6dafb3e4bbe914e54dc12507912 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:20:20.552125 21516 log.cc:927] Time spent T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:20:20.642976 16924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.012s	sys 0.016s
W20260709 13:20:20.694542 16924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.012s	sys 0.016s
W20260709 13:20:20.694921 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 576443us
I20260709 13:20:20.599952 21530 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:20.680299 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 113115us
I20260709 13:20:20.497123 21454 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.497411 21559 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:20.693056 16707 catalog_manager.cc:5697] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:20.608083 21357 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:20.700215 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06e6de173e42433e8df1572e54437e03"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:20.716100 16959 raft_consensus.cc:606] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:20.716511 16959 raft_consensus.cc:614] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:20.682235 21490 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:20.611196 21370 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:20.611514 21507 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:20.716094 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 412638us
I20260709 13:20:20.692668 21087 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:20.614902 21398 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.695427 21538 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.629033 21480 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.711970 21454 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.720109 21563 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.729122 21490 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:20.735764 21551 log.cc:927] Time spent T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:20:20.718446 21536 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:20.760036 16707 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 11 to 12, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 12 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:20.767500 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 210727us
I20260709 13:20:20.733642 21087 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:20.761986 21552 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.435s	user 0.001s	sys 0.000s
I20260709 13:20:20.796525 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:20.820227 16959 raft_consensus.cc:606] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:20.820706 16959 raft_consensus.cc:614] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:20.735430 21370 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.823782 21526 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.824337 21526 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.775815 21527 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:20.723238 21559 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:20.790391 21553 log.cc:927] Time spent T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260709 13:20:20.778874 21357 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.742094 21507 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.827947 21537 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.850165 16707 catalog_manager.cc:5697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:20.793627 21087 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:20.756955 21538 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:20.805930 21191 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:20.851879 16707 catalog_manager.cc:5697] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:20.857403 16849 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.027s	sys 0.043s
W20260709 13:20:20.861447 16849 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.027s	sys 0.043s
I20260709 13:20:20.831074 21172 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:20.877218 16707 catalog_manager.cc:5697] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 11 to 12, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 12 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:20.778038 21546 consensus_queue.cc:1059] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:20:20.883317 16707 catalog_manager.cc:5697] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 4 to 9, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 9 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.839735 21527 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.883361 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 2180) took 1127 ms. Trace:
W20260709 13:20:20.891645 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 155732us
I20260709 13:20:20.889508 16809 rpcz_store.cc:276] 0709 13:20:19.755861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.756436 (+   575us) service_pool.cc:224] Handling call
0709 13:20:19.756631 (+   195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.763247 (+  6616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.763289 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.763864 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:20:19.881128 (+117264us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:19.881197 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.881291 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.883152 (+1001861us) raft_consensus.cc:1685] finished
0709 13:20:20.883175 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.883303 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6297,"raft.queue_time_us":6961,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":6290,"thread_start_us":29045,"threads_started":1,"wal-append.queue_time_us":328149}
I20260709 13:20:20.857199 21219 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:20.895805 16707 catalog_manager.cc:5697] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 9 to 10, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 10 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:20.900542 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
W20260709 13:20:20.903600 16773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.012s	sys 0.018s
W20260709 13:20:20.904036 16773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.012s	sys 0.018s
I20260709 13:20:20.879546 21143 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:20.776214 21563 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.887372 21235 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.904343 16707 catalog_manager.cc:5697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 7 to 8, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 8 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:20.888537 21369 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:20.854259 21357 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:20.915385 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:20.857903 21537 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.880800 21191 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:20.884729 21172 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:20.939234 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 106917us
I20260709 13:20:20.943131 21574 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:20.943914 21574 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:20.944597 21172 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:20.945923 21538 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:20.908203 21476 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:20.898080 21527 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:20.947552 16707 catalog_manager.cc:5697] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 11 to 13, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 13 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:20.910488 21257 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:20.917608 21219 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.971190 16707 catalog_manager.cc:5697] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 10 to 11, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 11 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:20.973212 16956 raft_consensus.cc:2955] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 3 to 9, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:20.979028 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:20.979368 16959 raft_consensus.cc:606] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:20.979806 16959 raft_consensus.cc:614] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:20.917392 21235 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.986409 21559 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:20.987303 21235 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:20.988111 21572 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:20:20.976734 21398 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:20.992656 21577 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:20.979393 21569 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.993506 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 738) took 1137 ms. Trace:
I20260709 13:20:20.993225 21577 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.993881 21569 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:20.995304 21577 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:20.980655 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:20.978751 21574 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:20.984730 21418 consensus_meta.cc:287] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.002s
I20260709 13:20:20.971354 21480 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:20.985486 21568 log.cc:927] Time spent T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:20:20.965346 21369 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:20.948246 21538 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:20.995729 21567 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.996032 21589 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.996512 21587 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:20.948818 21578 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:20:20.997294 21580 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:20:20.997460 21583 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:20.998085 21564 log.cc:927] Time spent T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:20:20.998310 21514 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:21.088713 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.088858 21514 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.089612 17519 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:21.091074 21514 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:20.999585 21527 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:20.999866 21582 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:21.082293 21507 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.091970 21582 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.095114 21582 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.000697 21563 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:20.977072 21219 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.096200 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:20.993904 17521 rpcz_store.cc:276] 0709 13:20:19.856762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.857107 (+   345us) service_pool.cc:224] Handling call
0709 13:20:19.890987 (+ 33880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:19.891421 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.891461 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:19.913836 (+ 22375us) log.cc:844] Serialized 26 byte log entry
0709 13:20:20.514409 (+600573us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:20.514466 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:20.514567 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:20.993264 (+478697us) raft_consensus.cc:1685] finished
0709 13:20:20.993284 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:20.993424 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5122,"raft.run_cpu_time_us":3709,"raft.run_wall_time_us":83114,"thread_start_us":398491,"threads_started":1,"wal-append.queue_time_us":920593}
I20260709 13:20:21.004025 21569 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:21.097570 21530 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 12. Current term is 13.
I20260709 13:20:21.012733 16953 raft_consensus.cc:2393] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:20.967324 21172 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.100050 21172 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.100525 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:21.100481 21454 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.101372 16953 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:21.101851 16883 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:20.981886 16707 catalog_manager.cc:5697] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 9, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 9 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:21.102711 21582 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.103525 21515 consensus_meta.cc:287] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.004s
I20260709 13:20:21.057394 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:21.104130 16952 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.104002 21515 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.100042 21583 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.106082 21515 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:21.073949 21594 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.060377 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:21.107458 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:21.107303 21594 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.108078 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:21.108651 21172 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.109359 21594 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.095227 21490 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.059595 16879 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:20:21.065554 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 123019us
I20260709 13:20:21.056102 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:21.043707 21167 consensus_meta.cc:287] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.899s	user 0.006s	sys 0.006s
I20260709 13:20:21.112462 21167 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.113379 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:21.071171 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:21.114532 21167 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.044265 21577 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.083220 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.085425 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
W20260709 13:20:21.087083 16696 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.645s	user 0.008s	sys 0.039s
I20260709 13:20:21.088227 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.086478 21578 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.102783 16707 catalog_manager.cc:5697] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:21.118602 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.119469 16707 catalog_manager.cc:5697] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:21.120081 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.040634 16878 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:20.970371 21570 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:21.106783 21583 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.114858 16806 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.078532 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:21.115823 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:21.075287 21574 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.007513 21257 consensus_queue.cc:1059] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:20:21.118265 16954 raft_consensus.cc:2393] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 12: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:21.056353 21418 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.120443 16952 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:21.117338 17526 raft_consensus.cc:2376] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12. Re-sending same reply.
W20260709 13:20:21.117686 21491 consensus_meta.cc:287] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 1.286s	user 0.010s	sys 0.002s
I20260709 13:20:21.121340 16880 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.103389 21582 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.072415 21369 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.134431 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:21.074553 21538 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.102743 21454 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.122067 21515 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.148594 17526 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:21.151373 16707 catalog_manager.cc:5697] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 9, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 9 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.127458 21574 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.153983 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:21.154141 21561 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:21.154675 21561 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.155440 21574 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.156137 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.156738 16954 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:21.130431 21491 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.157644 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.158231 16954 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:21.159058 21491 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.159394 16880 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:21.160190 21191 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.143968 21172 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:21.164322 21172 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.165169 21369 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.166401 21583 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:21.166821 21172 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:21.166970 21583 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.077242 21567 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.118156 21594 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:20:21.172847 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.173887 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.176529 16806 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:21.176272 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:21.144217 21490 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.187390 16707 catalog_manager.cc:5697] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:21.193116 16707 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 9 to 11, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 11 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:21.121776 21577 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.197882 21577 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:21.168329 21579 log.cc:927] Time spent T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:20:21.146224 21570 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:21.171213 21491 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:21.169389 21567 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.195586 16707 catalog_manager.cc:5697] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 7, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 7 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:21.167637 21573 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.078682 21589 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.081640 21587 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.200985 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.215970 16707 catalog_manager.cc:5697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:21.217160 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.220952 17526 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:21.179450 21515 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.223107 16955 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:21.312551 21157 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:21.314253 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:21.309803 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 76557.5us
I20260709 13:20:21.307853 21597 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:21.307904 21577 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:21.311405 16951 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:21.215896 21491 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:21.218627 21583 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.315924 21567 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:21.243304 21537 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:21.316308 21451 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:21.318804 21589 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.319903 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.320993 21370 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:21.321539 21418 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:21.322034 21407 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.323047 21514 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.358385 21219 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.339607 21567 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:21.364445 16692 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 599f9a88b6cd4e818a1c59a0b4522480 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:21.363075 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.370394 21574 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.380187 21574 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:21.365021 21602 log.cc:927] Time spent T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.104s	user 0.000s	sys 0.003s
I20260709 13:20:21.222630 21573 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.381278 16803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2094) took 1051 ms. Trace:
I20260709 13:20:21.382261 21574 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.382972 21573 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.359668 21529 raft_consensus.cc:3055] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:21.334151 21577 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.383744 21529 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:21.385335 21577 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.384827 21529 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.361862 21491 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.386276 21529 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.383193 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.322924 21538 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.340929 21451 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.381688 16803 rpcz_store.cc:276] 0709 13:20:20.329811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.331783 (+  1972us) service_pool.cc:224] Handling call
0709 13:20:20.382768 (+ 50985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.709713 (+326945us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:20.739226 (+ 29513us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.122357 (+383131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.122405 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:21.122450 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.380575 (+258125us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b18003cf880. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf772a6 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419
0709 13:20:21.381067 (+   492us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54000992d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:21.381119 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.381224 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9314,"prepare.queue_time_us":81055,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1283,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3223,"spinlock_wait_cycles":749615488,"thread_start_us":381513,"threads_started":1,"wal-append.queue_time_us":450238}
I20260709 13:20:21.374361 21324 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.393605 21451 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.393772 21324 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.399093 16809 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:21.377640 21518 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.403378 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:21.403736 16951 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:21.404294 16922 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:21.405406 16951 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:21.406526 21361 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:21.409989 21361 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.407403 16848 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:21.332758 21597 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.376648 16696 maintenance_manager.cc:643] P c8653aabbcbd4e268c41b15906779d0b: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.881s	user 0.174s	sys 0.089s Metrics: {"bytes_written":29663,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":12941,"dirs.run_cpu_time_us":362,"dirs.run_wall_time_us":2026,"drs_written":1,"lbm_read_time_us":356,"lbm_reads_lt_1ms":4,"lbm_write_time_us":163029,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":6,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":394800,"threads_started":2,"update_count":7,"wal-append.queue_time_us":534936}
I20260709 13:20:21.418032 16807 raft_consensus.cc:1217] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Deduplicated request from leader. Original: 7.8->[9.9-11.10]   Dedup: 9.9->[11.10-11.10]
I20260709 13:20:21.418717 16807 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: [9.9-11.10]
W20260709 13:20:21.419801 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 304022us
I20260709 13:20:21.308416 21488 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:21.315263 21561 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.329028 17526 raft_consensus.cc:2410] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:20:21.309367 21087 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.332718 16953 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:21.334002 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:21.314109 21582 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.339447 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.427356 17524 raft_consensus.cc:2410] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:20:21.380327 21567 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.387707 17525 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:21.342072 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.389497 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43934 (request call id 2097) took 1058 ms. Trace:
I20260709 13:20:21.405330 16922 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:21.429225 16807 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:21.430816 16922 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:21.367954 21357 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.344663 21587 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.363442 16955 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:20:21.428632 16801 rpcz_store.cc:276] 0709 13:20:20.330597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.336729 (+  6132us) service_pool.cc:224] Handling call
0709 13:20:21.389348 (+1052619us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54003e80d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:21.389443 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319150848}
I20260709 13:20:21.432783 16955 pending_rounds.cc:85] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 10
I20260709 13:20:21.433120 16955 pending_rounds.cc:107] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:20:21.433403 16955 raft_consensus.cc:2889] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:21.307833 21490 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:21.329130 16773 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:21.415050 16848 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:21.412390 21361 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.370725 21515 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.422638 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:21.424803 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.420500 16850 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:21.336887 21578 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.427913 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.451206 17526 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 15: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:21.451395 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:21.441015 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.452481 17524 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 15: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:21.453699 21407 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:21.454586 21407 raft_consensus.cc:697] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:21.455771 21407 consensus_queue.cc:237] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.458142 21543 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:21.458619 21543 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.459005 21543 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.441434 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:21.442927 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.332495 21157 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.466733 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.467522 16953 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:21.468681 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.445400 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:21.445626 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 116624us
I20260709 13:20:21.469388 16953 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:21.469692 17522 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:20:21.470674 16773 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:21.471594 21476 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:21.472093 21476 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.472515 21476 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.436914 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.444396 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:21.476064 16803 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:21.470350 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:21.484563 16953 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.496915 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.498422 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.504518 21561 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:21.505520 21284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.399s	user 0.011s	sys 0.012s
I20260709 13:20:21.394542 21514 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:21.569171 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.569308 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.570089 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:21.567864 17521 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 12: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:21.510140 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:21.574007 16951 raft_consensus.cc:3060] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:21.505328 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.444013 21589 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:21.438817 21418 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:21.505147 21561 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.507787 16697 maintenance_manager.cc:419] P c8653aabbcbd4e268c41b15906779d0b: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10709 bytes on disk
W20260709 13:20:21.509351 21548 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 1.118s	user 0.000s	sys 0.009s
I20260709 13:20:21.581082 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.597834 16956 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:20:21.597797 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.568768 21573 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.505957 21284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.399s	user 0.011s	sys 0.012s
I20260709 13:20:21.607506 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:21.450028 21357 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:21.503068 21476 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.583997 17525 raft_consensus.cc:2410] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:20:21.446795 21468 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:21.589763 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2098) took 1258 ms. Trace:
I20260709 13:20:21.503984 21361 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:21.593665 16803 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 15.
I20260709 13:20:21.598767 16955 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:21.507318 21087 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.568846 21515 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.449141 21451 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:21.423561 21488 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.571782 21583 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:21.445358 21582 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:20:21.582239 21540 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 1.693s	user 0.004s	sys 0.011s
I20260709 13:20:21.444325 21597 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.614264 16810 rpcz_store.cc:276] 0709 13:20:20.330816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.341234 (+ 10418us) service_pool.cc:224] Handling call
0709 13:20:20.341567 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:20.341790 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:20.393344 (+ 51554us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.348265 (+954921us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b18001d8600. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeebf8be07 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec3623a 00007feeef0a0a2a
0709 13:20:21.589336 (+241071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:21.589402 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:21.589461 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.589547 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.589692 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49739,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":102,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4616,"spinlock_wait_cycles":22631296,"thread_start_us":240780,"threads_started":1}
I20260709 13:20:21.618271 16951 raft_consensus.cc:2468] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 15.
I20260709 13:20:21.622535 16885 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:21.588711 21518 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:21.623436 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.623385 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.634408 16955 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:21.598304 21475 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:21.605358 21546 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:20:21.626835 16696 maintenance_manager.cc:643] P c8653aabbcbd4e268c41b15906779d0b: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.017s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":335,"lbm_reads_lt_1ms":4}
I20260709 13:20:21.448704 21490 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.629199 16880 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:20:21.630322 16953 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:21.635082 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.581723 21418 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.623934 21357 raft_consensus.cc:697] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:21.492378 21588 consensus_queue.cc:1059] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 13:20:21.627575 21468 raft_consensus.cc:697] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:21.649772 16850 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.3:33725 timed out after 1.805s (SENT) [suppressed 11 similar messages]
I20260709 13:20:21.610904 21573 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.626209 21470 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:20:21.668578 16877 raft_consensus.cc:1217] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[9.9-11.10]   Dedup: 9.9->[11.10-11.10]
I20260709 13:20:21.669623 16877 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:20:21.626451 21361 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.649303 21451 raft_consensus.cc:697] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:21.673632 21598 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:21.674458 21536 raft_consensus.cc:3055] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:21.675400 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2100) took 1344 ms. Trace:
W20260709 13:20:21.676169 21609 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:20:21.678601 21570 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.684202 21476 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.629410 21515 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.686172 21561 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.686481 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 680) took 1193 ms. Trace:
I20260709 13:20:21.684248 21532 raft_consensus.cc:3055] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:21.636075 21583 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.635598 21518 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.651901 21582 raft_consensus.cc:697] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:21.691499 21157 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:21.692159 21520 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.695196 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2110) took 1970 ms. Trace:
I20260709 13:20:21.695945 17520 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:20:21.650684 21597 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.696285 21357 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:21.675326 21615 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:20:21.700497 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:21.737421 17527 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:21.716413 16804 rpcz_store.cc:276] 0709 13:20:20.331279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.402111 (+ 70832us) service_pool.cc:224] Handling call
0709 13:20:20.475926 (+ 73815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.889018 (+413092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.889046 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:20.894126 (+  5080us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.044868 (+150742us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:21.044922 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.674940 (+630018us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54002a8d54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:21.675001 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.675057 (+    56us) raft_consensus.cc:1685] finished
0709 13:20:21.675076 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.675331 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21892,"raft.queue_time_us":16344,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":5589,"spinlock_wait_cycles":949064064,"thread_start_us":121076,"threads_started":1,"wal-append.queue_time_us":172154}
I20260709 13:20:21.716365 21536 raft_consensus.cc:740] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:21.701179 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.701529 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 2161) took 1915 ms. Trace:
I20260709 13:20:21.731083 21573 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:21.702358 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:21.700546 21526 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:21.659621 21418 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:21.707755 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.752365 16954 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 15.
I20260709 13:20:21.725118 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.726157 16883 rpcz_store.cc:276] 0709 13:20:20.493212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.493327 (+   115us) service_pool.cc:224] Handling call
0709 13:20:21.686244 (+1192917us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54001284d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:21.686414 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1138388224}
I20260709 13:20:21.730767 21515 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:21.731839 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:21.707976 21612 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:20:21.735347 16881 rpcz_store.cc:276] 0709 13:20:19.724925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.725096 (+   171us) service_pool.cc:224] Handling call
0709 13:20:19.725504 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:19.819886 (+ 94382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.694930 (+1875044us) spinlock_profiling.cc:243] Waited 93.6 ms on lock 0x7b5400025b54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:21.695127 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215256448}
I20260709 13:20:21.735916 17520 pending_rounds.cc:85] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 9
I20260709 13:20:21.689278 21468 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.744060 16955 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:21.728120 21532 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:21.649514 21475 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.745595 16884 rpcz_store.cc:276] 0709 13:20:19.786013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.786128 (+   115us) service_pool.cc:224] Handling call
0709 13:20:19.804229 (+ 18101us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:19.812783 (+  8554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:19.812815 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:19.813413 (+   598us) log.cc:844] Serialized 52 byte log entry
0709 13:20:19.980708 (+167295us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:19.980753 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:19.980819 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.508729 (+1527910us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:21.668118 (+159389us) raft_consensus.cc:1685] finished
0709 13:20:21.668141 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.701472 (+ 33331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90,"raft.queue_time_us":9669,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":60,"spinlock_wait_cycles":40463488,"thread_start_us":166924,"threads_started":1,"wal-append.queue_time_us":478226}
I20260709 13:20:21.845569 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.864213 16958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 2433) took 2234 ms. Trace:
I20260709 13:20:21.876003 21361 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:21.876197 16958 rpcz_store.cc:276] 0709 13:20:19.629914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.630009 (+    95us) service_pool.cc:224] Handling call
0709 13:20:19.633096 (+  3087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.611797 (+978701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.863840 (+1252043us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54002099d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:21.864132 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235380608}
I20260709 13:20:21.876694 21589 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.867242 17527 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:21.877285 21589 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:21.869568 17520 pending_rounds.cc:107] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:20:21.878142 17520 raft_consensus.cc:2889] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:21.878842 21556 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.879573 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 1166) took 2618 ms. Trace:
I20260709 13:20:21.879307 21556 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.879922 17520 rpcz_store.cc:276] 0709 13:20:19.261717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.262248 (+   531us) service_pool.cc:224] Handling call
0709 13:20:19.301916 (+ 39668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:21.878697 (+2576781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.879343 (+   646us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b540055e954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:21.879498 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5504703872}
I20260709 13:20:21.731244 21570 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:21.882395 21570 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:21.882612 21621 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:20:21.882893 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:21.883116 21556 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:21.884938 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 2164) took 1331 ms. Trace:
I20260709 13:20:21.720851 21598 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:21.889155 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 305652us
I20260709 13:20:21.885558 16876 rpcz_store.cc:276] 0709 13:20:20.553656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.553773 (+   117us) service_pool.cc:224] Handling call
0709 13:20:20.611763 (+ 57990us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:21.147082 (+535319us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:20:21.204594 (+ 57512us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.457614 (+253020us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:21.458345 (+   731us) log.cc:844] Serialized 52 byte log entry
0709 13:20:21.458537 (+   192us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:21.460883 (+  2346us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.461927 (+  1044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.462023 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.884684 (+422661us) raft_consensus.cc:1685] finished
0709 13:20:21.884712 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.884872 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":197619,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":294454,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":64521,"thread_start_us":596608,"threads_started":3,"wal-append.queue_time_us":494892}
I20260709 13:20:21.868288 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 737) took 2012 ms. Trace:
I20260709 13:20:21.739499 21597 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.067638 16959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50296 (request call id 41) took 1174 ms. Trace:
I20260709 13:20:22.050894 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:21.890071 17523 rpcz_store.cc:276] 0709 13:20:19.855629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:19.855798 (+   169us) service_pool.cc:224] Handling call
0709 13:20:19.896539 (+ 40741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:21.005932 (+1109393us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800496f60. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeeec3e4bc 00007feeebf8c48b 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa6455 00007feeef08e060 00007feeef08ebfb 00007feeef09964b
0709 13:20:21.006117 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:21.006149 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.006683 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.330074 (+323391us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:21.330116 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.330177 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.845785 (+515608us) raft_consensus.cc:1685] finished
0709 13:20:21.845805 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:21.868220 (+ 22415us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45261,"raft.queue_time_us":226662,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":59922,"spinlock_wait_cycles":30714752,"thread_start_us":577862,"threads_started":2,"wal-append.queue_time_us":502714}
I20260709 13:20:22.052032 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.053407 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:22.114796 16806 raft_consensus.cc:2368] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
I20260709 13:20:22.049338 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.074955 16775 leader_election.cc:400] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12.
W20260709 13:20:22.063163 17491 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.051267 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:22.116012 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.117221 16803 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:22.117326 16807 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:20:22.052357 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.051622 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.100737 16924 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:22.118862 16801 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:22.067170 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 681) took 1573 ms. Trace:
I20260709 13:20:22.119488 16877 rpcz_store.cc:276] 0709 13:20:20.493557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.493662 (+   105us) service_pool.cc:224] Handling call
0709 13:20:21.668405 (+1174743us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:21.669951 (+  1546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.066948 (+396997us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001455d0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:22.067103 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2425665792}
I20260709 13:20:22.048237 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:21.869987 21476 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.868615 21191 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.120689 16809 raft_consensus.cc:2393] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:22.121120 16804 raft_consensus.cc:2393] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:22.052697 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.121974 16775 leader_election.cc:403] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:22.114229 16959 rpcz_store.cc:276] 0709 13:20:20.893005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.893296 (+   291us) service_pool.cc:224] Handling call
0709 13:20:22.067418 (+1174122us) spinlock_profiling.cc:243] Waited 78.1 ms on lock 0x7b54002e3bd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef090853 00007feef405e60a 00007feeed5e47d4 00007feeed5e4762 00007feeed5e4691 00007feeed5e460c 00007feeed5e38c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:22.067551 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179649280}
I20260709 13:20:21.871992 21514 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:21.936882 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 287093us
I20260709 13:20:22.002331 16950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34330 (request call id 2296) took 1034 ms. Trace:
W20260709 13:20:22.138465 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 63705.9us
I20260709 13:20:22.088578 21556 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.141919 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.137326 16808 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:22.139251 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.140133 16802 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
W20260709 13:20:22.012951 21624 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:20:21.965911 21490 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.118243 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.141243 17492 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.141507 21219 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 11. Current term is 12.
I20260709 13:20:22.054697 21518 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.055555 21598 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:22.139197 21453 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:22.005226 21625 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.097909 21594 raft_consensus.cc:3055] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:22.060400 21517 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.028366 21583 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:22.138063 16950 rpcz_store.cc:276] 0709 13:20:20.967892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.968109 (+   217us) service_pool.cc:224] Handling call
0709 13:20:20.968496 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:20.996932 (+ 28436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:20.996965 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:21.324469 (+327504us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b2c0012df38. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:20:21.324896 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:20:21.661933 (+337037us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:21.672834 (+ 10901us) log.cc:844] Serialized 14 byte log entry
0709 13:20:21.705654 (+ 32820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:21.705781 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:21.997626 (+291845us) raft_consensus.cc:1685] finished
0709 13:20:22.002033 (+  4407us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:22.002256 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42710,"prepare.queue_time_us":10535,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":65311,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":14443,"spinlock_wait_cycles":9608448,"thread_start_us":336712,"threads_started":1,"wal-append.queue_time_us":622459}
I20260709 13:20:21.950439 21488 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:22.143218 16775 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:22.178535 21219 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:22.178812 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:22.113843 21398 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:20:22.156291 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:22.132413 21526 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:22.154036 16807 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:22.142373 21191 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.164630 16958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:22.186071 16958 raft_consensus.cc:606] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:22.151875 21569 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:22.191246 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:21.874154 21451 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.891886 21536 consensus_queue.cc:260] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.202105 21518 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:22.174715 21453 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.140831 21476 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:21.960264 21532 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.253130 21532 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:22.204020 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.207788 21219 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:22.208173 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.258031 16957 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:22.258795 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:22.260056 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.260289 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:22.260697 16809 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:22.260818 16885 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:22.261168 21526 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.164597 21594 raft_consensus.cc:740] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:22.261611 21526 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.262425 21594 consensus_queue.cc:260] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.210450 21418 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.164461 21625 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.263978 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.209065 21597 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.149550 21556 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.265436 21418 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:22.265646 21625 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.161800 21530 raft_consensus.cc:2804] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:22.213238 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:22.268988 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.211351 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.218026 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.270716 16951 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:22.218664 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:21.892700 21582 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.273519 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.220772 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:22.223395 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.274890 16878 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
W20260709 13:20:22.275137 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 54427.5us
I20260709 13:20:22.220578 16959 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 9.
I20260709 13:20:22.231822 16881 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:20:22.276250 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:22.237648 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.277230 16807 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:22.238627 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:22.237705 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.240273 21538 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:22.243388 21536 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:22.282769 16809 raft_consensus.cc:1240] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:22.282984 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.243081 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.243525 21578 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.247738 21144 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:22.249452 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.292500 16952 raft_consensus.cc:2393] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:22.202675 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.253012 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.254463 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.256527 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.293188 16883 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:22.253928 16954 raft_consensus.cc:2376] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12. Re-sending same reply.
I20260709 13:20:22.266237 16956 raft_consensus.cc:2368] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13.
I20260709 13:20:22.237989 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:22.267544 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.278441 16808 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
W20260709 13:20:22.288148 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 69598.7us
W20260709 13:20:22.289592 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.261515 21280 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:22.284970 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.292317 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:22.324853 16810 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:22.273083 16885 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:22.328339 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.328931 16885 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:22.329676 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.330178 16885 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:22.330873 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.285980 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.291437 21505 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:22.263588 21526 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:22.293821 16882 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:22.282941 21530 raft_consensus.cc:697] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:22.299649 16773 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:22.300745 21144 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:22.312268 21628 log.cc:927] Time spent T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.161s	user 0.001s	sys 0.001s
I20260709 13:20:22.304085 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:22.354833 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:22.355356 16884 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:22.304812 16809 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:20:22.355866 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.313339 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.306315 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.356796 16950 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:20:22.313992 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.306574 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.358374 16876 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:22.314802 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.315395 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.359939 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.360282 17526 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:22.360464 16956 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:22.361258 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.361569 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:22.361846 16956 raft_consensus.cc:2368] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10.
I20260709 13:20:22.315780 21191 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:22.306574 16924 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.256475 21569 raft_consensus.cc:697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:22.306787 21534 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:20:22.316646 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.369985 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.370141 16803 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:22.316746 21476 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:22.370446 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:22.317037 21594 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:22.370566 16950 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:22.373508 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.374881 16956 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:22.299970 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.318027 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.315418 21556 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.292953 21518 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:22.318529 21475 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.385298 21475 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:22.385756 21475 raft_consensus.cc:697] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:22.386508 21475 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.284466 21625 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:22.319125 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.307220 21418 consensus_queue.cc:1059] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:20:22.393100 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.319638 21578 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.319835 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.321786 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.324666 21538 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.328413 21453 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:22.297724 21558 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:22.402989 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.292068 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.403939 16951 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
W20260709 13:20:22.319073 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.340801 16955 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
I20260709 13:20:22.405198 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.405689 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.406379 16951 raft_consensus.cc:2410] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:20:22.406432 16955 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:20:22.342867 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.336040 16810 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:22.345541 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:22.408456 16807 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:20:22.408851 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.410174 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.410434 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:22.254060 21470 consensus_queue.cc:1175] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "96eaa6dafb3e4bbe914e54dc12507912" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:22.349051 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.331410 16885 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
W20260709 13:20:22.350278 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 54507.1us
I20260709 13:20:22.350216 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:22.318066 21543 consensus_meta.cc:287] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.859s	user 0.011s	sys 0.000s
W20260709 13:20:22.352355 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 52795.1us
I20260709 13:20:22.358819 17522 raft_consensus.cc:2393] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 10: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:22.363178 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:22.363343 17526 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:20:22.363765 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:22.364694 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 58204.4us
I20260709 13:20:22.364962 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:22.366029 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:22.240698 21324 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:20:22.371558 17525 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:20:22.348471 21514 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:22.372707 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.373476 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:22.426383 17521 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.306970 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.377044 16952 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:22.376039 16804 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:22.388453 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.393721 16950 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:22.394003 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:22.374521 21526 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:22.426266 16809 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:22.431943 16883 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:22.402758 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:22.433120 16959 raft_consensus.cc:2393] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:22.344233 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.433141 16802 raft_consensus.cc:1240] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:22.436661 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.411326 16955 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
W20260709 13:20:22.395287 21589 consensus_meta.cc:287] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 13:20:22.411504 16810 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 15: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:22.416917 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.412508 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:22.440719 16953 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:22.421703 17520 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:22.424412 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:22.420413 17527 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:22.441803 16958 raft_consensus.cc:2393] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 15: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:22.393550 21418 raft_consensus.cc:3055] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:22.427460 16884 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:22.422663 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.430625 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:22.404014 16806 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:20:22.438705 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.420725 17526 pending_rounds.cc:85] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 10
I20260709 13:20:22.441742 16881 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:20:22.444963 17526 pending_rounds.cc:107] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:20:22.445395 17526 raft_consensus.cc:2889] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:22.449263 17523 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:20:22.450906 16850 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.453596 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:22.455317 17527 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:22.454691 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.459760 16924 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:22.419009 21536 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.466368 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.463346 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:22.467557 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.469285 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:22.470427 21556 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:22.470810 21515 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:22.471278 21488 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:22.471431 21515 raft_consensus.cc:697] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:22.416505 21144 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.473131 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:22.476995 16959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:22.477773 16959 raft_consensus.cc:606] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:22.431631 21526 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.448938 21418 raft_consensus.cc:740] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:22.479707 16924 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.451906 21453 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:22.477280 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.456777 21614 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.487306 16850 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:22.447554 21589 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.491109 16924 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:22.491854 21589 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:22.426503 21558 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.499317 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:22.476325 21454 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.494535 16924 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:22.431464 21543 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.462242 21398 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:22.506300 16807 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:22.457016 21534 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:20:22.506721 16848 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:22.445715 21476 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:20:22.485311 21526 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:22.440049 21514 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.510598 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.462046 21597 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:20:22.457823 21610 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:20:22.491981 21488 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:22.523504 16850 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:22.493893 21520 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:22.487092 21505 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:22.525852 16924 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:22.509480 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.496289 21517 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:22.526854 16808 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:22.498591 21453 raft_consensus.cc:697] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:22.577466 16880 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:20:22.577744 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 68324.6us
I20260709 13:20:22.440299 21530 consensus_queue.cc:237] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.495064 21614 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:22.580693 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 57134.1us
I20260709 13:20:22.476420 21536 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:22.582963 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 57211.5us
I20260709 13:20:22.587606 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.511292 21578 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:22.521601 21589 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:22.522383 21324 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.572901 21280 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:22.600673 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.603052 17492 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:22.513902 21454 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:22.603996 21454 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.515872 21591 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.607982 21591 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.608475 21591 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.611763 21324 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.614516 21324 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.615182 21324 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.620555 21418 consensus_queue.cc:260] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.622253 21418 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.625062 21558 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.626055 17526 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:20:22.627259 21536 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:22.627966 21536 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.628399 21536 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.628782 21536 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.632319 21538 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.634337 21543 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.635046 21543 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:22.576431 21520 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.635900 21520 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.599534 21361 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:22.572783 21488 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:22.638268 21361 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:22.638670 21488 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:22.638878 21361 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:22.584367 21583 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:20:22.643792 21453 consensus_queue.cc:237] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.590970 21614 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.648083 21505 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:22.588290 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.648739 21505 raft_consensus.cc:697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:20:22.649154 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 60935.2us
I20260709 13:20:22.650082 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.649876 21505 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.590584 21599 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:20:22.457540 21569 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.652657 21599 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:22.653254 21599 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.515625 21398 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.572531 21571 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:22.579540 21517 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.572997 21316 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:22.573143 21570 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:20:22.593879 21587 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:22.651235 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:22.695470 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 92517.1us
I20260709 13:20:22.656456 21280 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.662194 21634 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:22.662562 21517 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:22.658232 21398 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.694324 21589 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:22.668632 21219 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:22.660989 21370 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:22.698885 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 47743.7us
I20260709 13:20:22.615630 21324 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.635591 21543 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.662317 21316 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:22.697238 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:22.706813 21280 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.702960 21470 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:22.722487 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:22.741766 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 164004us
I20260709 13:20:22.594482 21515 consensus_queue.cc:237] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:22.734323 16692 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 599f9a88b6cd4e818a1c59a0b4522480 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:22.746960 21546 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:22.747816 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 50658.2us
I20260709 13:20:22.715927 21589 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:22.730439 21324 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.724959 21370 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.730103 21587 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:22.749325 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:22.741531 21316 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:22.788818 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.788630 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:22.794423 17521 raft_consensus.cc:2468] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:22.780856 21589 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.712080 21634 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.788442 21598 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.791944 21587 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.791793 21370 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:22.793923 21532 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.829264 21534 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:22.844157 21470 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.835161 21587 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:22.847237 21470 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.842033 21532 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:22.851583 21514 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.850132 21599 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:22.855324 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 267847us
I20260709 13:20:22.862980 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.864750 17520 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:22.879329 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:22.879484 17521 raft_consensus.cc:1240] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:22.903069 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:22.881402 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 357932us
I20260709 13:20:22.882503 17527 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:22.866248 16922 consensus_peers.cc:597] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9f7a2a0447a4956b36d1e9902e62f56. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:22.909107 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 390920us
W20260709 13:20:22.905287 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:22.907624 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.917016 16850 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:22.924268 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:22.925704 16922 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:22.925928 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:22.830891 21219 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.853847 21534 raft_consensus.cc:697] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:22.929700 16773 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:20:22.855077 21235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.004s	sys 0.015s
W20260709 13:20:22.906744 21581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.004s	sys 0.018s
I20260709 13:20:22.954802 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:22.955425 16806 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 8.
I20260709 13:20:22.878652 21599 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:22.865121 21532 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:22.877772 21470 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:23.004534 16850 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:22.857475 21644 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:23.004663 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 71883.2us
W20260709 13:20:22.953884 21581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.004s	sys 0.021s
I20260709 13:20:23.008373 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:23.017715 17525 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
W20260709 13:20:22.951169 21235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.004s	sys 0.015s
I20260709 13:20:23.011466 17520 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:22.881042 21520 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.932978 21451 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:22.952381 21594 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:22.978034 21476 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:22.879910 21614 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:22.870077 21591 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:23.088153 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 338899us
I20260709 13:20:23.091342 16775 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:23.106177 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:23.107059 17524 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:23.004487 21570 consensus_queue.cc:1059] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:20:23.075773 21543 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:23.014091 21599 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:23.085827 21476 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.083937 21594 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.079558 21451 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:23.181838 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 75752.8us
W20260709 13:20:23.184727 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 66906.6us
I20260709 13:20:23.192504 16773 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:23.192512 16775 leader_election.cc:400] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10.
I20260709 13:20:23.196972 16775 leader_election.cc:403] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:23.194674 21543 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:23.186167 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 260415us
I20260709 13:20:23.199221 16922 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:23.185438 21582 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:23.214140 21582 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:23.216830 21582 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:23.218124 21652 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:20:23.222359 21517 consensus_meta.cc:287] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.007s
I20260709 13:20:23.222550 21614 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:23.195580 21451 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:23.190668 21594 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.187196 21476 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:23.188786 21475 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:23.110777 21583 consensus_queue.cc:1059] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
W20260709 13:20:23.205396 21569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.010s	sys 0.021s
W20260709 13:20:23.229663 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 225192us
I20260709 13:20:23.317678 16850 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:23.222764 21517 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:23.248984 21598 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:23.255254 21582 raft_consensus.cc:3055] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:20:23.346822 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 340230us
W20260709 13:20:23.410143 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 92537.3us
I20260709 13:20:23.411204 16850 leader_election.cc:400] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13.
I20260709 13:20:23.413355 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:23.264607 21634 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:23.397114 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 204761us
I20260709 13:20:23.261996 21191 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:23.222783 21280 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:23.177815 21534 consensus_queue.cc:237] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:23.318293 21569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.010s	sys 0.021s
I20260709 13:20:23.318614 21453 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:23.201363 21662 consensus_queue.cc:1059] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.120s
I20260709 13:20:23.346951 21678 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:23.427896 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:23.401230 21647 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.447s	user 0.001s	sys 0.000s
I20260709 13:20:23.316135 21475 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:23.408087 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 207773us
I20260709 13:20:23.474767 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:23.508308 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 312464us
I20260709 13:20:23.563186 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:23.401345 21639 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10.
W20260709 13:20:23.555003 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 127177us
W20260709 13:20:23.551600 16807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.004s	sys 0.027s
I20260709 13:20:23.409878 21598 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.273878 21658 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.209s
W20260709 13:20:23.475597 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 62316.4us
W20260709 13:20:23.565718 16807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.005s	sys 0.027s
I20260709 13:20:23.565425 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:23.562366 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:23.409557 21582 raft_consensus.cc:740] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:23.433588 21191 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.456800 21515 raft_consensus.cc:2804] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:23.645689 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:23.648339 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:23.661837 16955 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:23.461373 21657 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:23.466144 21597 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:23.432364 21610 raft_consensus.cc:3055] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:23.646394 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:23.666052 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:23.672097 16956 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:23.690507 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:23.663116 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:23.565403 21678 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.560762 21475 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:23.569227 21634 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:23.703568 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 246149us
I20260709 13:20:23.713973 21634 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.714398 21634 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:23.716034 16925 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.004s	sys 0.047s
W20260709 13:20:23.723822 16925 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.004s	sys 0.047s
W20260709 13:20:23.715001 16923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.001s	sys 0.018s
W20260709 13:20:23.742172 16923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.002s	sys 0.018s
I20260709 13:20:23.748503 21538 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:23.749193 21538 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.749586 21538 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:23.716881 21530 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:23.713069 16850 connection.cc:256] RPC call timeout handler was delayed by -1.3071736520000741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260709 13:20:23.774886 16850 connection.cc:256] RPC call timeout handler was delayed by -1.2666736520000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 13:20:23.756907 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:23.758455 17521 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:20:23.661015 21191 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:23.507045 21453 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:23.663223 21520 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:23.790655 17527 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:23.674638 21657 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.713307 21610 raft_consensus.cc:740] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:23.701267 21678 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:23.782857 21677 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.774772 21530 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:23.718504 21597 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:23.823619 21655 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.592s	user 0.001s	sys 0.000s
W20260709 13:20:23.839856 21370 consensus_meta.cc:287] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.998s	user 0.001s	sys 0.009s
I20260709 13:20:23.819499 21657 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:23.871920 16957 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:20:23.873240 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:23.849216 21656 log.cc:927] Time spent T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.426s	user 0.000s	sys 0.001s
I20260709 13:20:23.833468 21685 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:23.851596 17519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.000s	sys 0.010s
I20260709 13:20:23.857554 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:23.858417 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:23.881392 16955 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:23.881645 17519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.000s	sys 0.010s
W20260709 13:20:23.884390 16692 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 599f9a88b6cd4e818a1c59a0b4522480 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:23.885927 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:23.886636 16953 raft_consensus.cc:2368] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:23.889117 16955 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
W20260709 13:20:23.858857 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 293552us
I20260709 13:20:23.859117 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:23.839756 21530 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:23.866289 21664 log.cc:927] Time spent T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.593s	user 0.001s	sys 0.000s
I20260709 13:20:23.891022 16775 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:23.846956 21569 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:23.846982 21520 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:23.866940 21587 consensus_meta.cc:287] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.962s	user 0.006s	sys 0.010s
I20260709 13:20:23.846481 21696 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:23.848340 21599 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:23.901059 21675 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 13:20:23.901750 21673 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.319s	user 0.000s	sys 0.000s
I20260709 13:20:23.839684 21677 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:23.902750 21665 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
W20260709 13:20:23.903837 21667 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:20:23.904527 21650 log.cc:927] Time spent T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
W20260709 13:20:23.907373 21398 consensus_meta.cc:287] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 1.177s	user 0.009s	sys 0.008s
W20260709 13:20:23.908285 21688 log.cc:927] Time spent T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:20:23.909106 21674 log.cc:927] Time spent T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:23.974785 21468 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:23.975348 16808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42344 (request call id 706) took 1219 ms. Trace:
I20260709 13:20:23.975961 16808 rpcz_store.cc:276] 0709 13:20:22.756047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.756211 (+   164us) service_pool.cc:224] Handling call
0709 13:20:22.756523 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.756814 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.756858 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.882112 (+125254us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b2c000264b8. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:20:22.882488 (+   376us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.116820 (+234332us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:23.116853 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.116920 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:23.975036 (+858116us) raft_consensus.cc:1685] finished
0709 13:20:23.975066 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:23.975291 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5383,"raft.queue_time_us":80347,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":2010,"spinlock_wait_cycles":7331584,"thread_start_us":233928,"threads_started":1,"wal-append.queue_time_us":589591}
W20260709 13:20:23.964968 21361 consensus_meta.cc:287] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 1.325s	user 0.010s	sys 0.004s
I20260709 13:20:23.978422 21361 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:23.956318 21587 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:23.980381 21361 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:23.980515 21587 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:23.980968 21361 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:23.956513 21520 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:23.981436 21361 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:23.983197 21361 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:23.911473 21324 consensus_meta.cc:287] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 1.110s	user 0.005s	sys 0.006s
I20260709 13:20:23.912699 21280 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:23.913625 21666 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:20:23.927224 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:23.910825 21488 consensus_meta.cc:287] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 1.271s	user 0.009s	sys 0.002s
I20260709 13:20:23.855790 21690 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:23.867270 21517 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:23.870774 21370 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:23.866649 21654 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:23.923424 21316 consensus_meta.cc:287] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 1.095s	user 0.005s	sys 0.006s
I20260709 13:20:23.973563 21677 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:23.983229 21520 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:23.944585 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 53625.1us
I20260709 13:20:23.893513 21689 raft_consensus.cc:2764] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:20:23.892364 21526 consensus_meta.cc:287] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 1.317s	user 0.004s	sys 0.008s
I20260709 13:20:24.009423 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2147) took 1584 ms. Trace:
I20260709 13:20:24.054970 16877 rpcz_store.cc:276] 0709 13:20:22.424641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.424901 (+   260us) service_pool.cc:224] Handling call
0709 13:20:22.451924 (+ 27023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.452344 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.452383 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.473732 (+ 21349us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.825056 (+351324us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:22.825113 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.825186 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.009119 (+1183933us) raft_consensus.cc:1685] finished
0709 13:20:24.009148 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.009349 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5110,"raft.queue_time_us":592,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7834,"thread_start_us":248402,"threads_started":1,"wal-append.queue_time_us":750355}
I20260709 13:20:24.049033 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:23.961262 21691 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:20:23.975304 21468 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.078308 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:24.081367 21663 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:20:24.015106 21361 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:23.895287 21685 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.026183 21280 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:20:24.062227 21665 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:20:24.061060 21673 log.cc:927] Time spent T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:23.985528 21398 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:23.893280 21610 consensus_queue.cc:260] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:23.960649 21696 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.014984 21324 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.095232 16804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2124) took 1796 ms. Trace:
I20260709 13:20:24.056365 21517 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.060868 21515 raft_consensus.cc:697] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:24.105891 21689 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.117957 21658 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:24.218217 21689 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.219503 21324 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:24.194437 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.108755 21370 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.109337 21597 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.221022 21696 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.113796 21574 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:24.218752 21658 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.121699 17520 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44648 (request call id 757) took 1363 ms. Trace:
I20260709 13:20:24.222935 21597 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:24.222517 21574 raft_consensus.cc:493] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:24.223912 21658 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.122933 17522 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:20:24.103614 21538 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.226893 21574 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.133579 21475 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.232350 21639 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.227221 21597 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.220542 21689 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:24.223356 21398 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:24.234074 21654 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.234081 21591 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.246212 21654 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.246750 21597 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:24.236279 21235 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:20:24.248961 21594 consensus_meta.cc:287] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.930s	user 0.008s	sys 0.002s
I20260709 13:20:24.248875 21235 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.251044 21235 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.252079 21654 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.249285 21475 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:24.217430 16804 rpcz_store.cc:276] 0709 13:20:22.298526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.433568 (+135042us) service_pool.cc:224] Handling call
0709 13:20:22.457684 (+ 24116us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.457962 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.458002 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.473801 (+ 15799us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.802611 (+328810us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:20:22.802647 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.802721 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.091219 (+1288498us) raft_consensus.cc:1685] finished
0709 13:20:24.091238 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.095167 (+  3929us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":294842,"threads_started":1,"wal-append.queue_time_us":784746}
I20260709 13:20:24.224108 17520 rpcz_store.cc:276] 0709 13:20:22.757921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.758633 (+   712us) service_pool.cc:224] Handling call
0709 13:20:24.121488 (+1362855us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b540055f354. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:24.121606 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156331904}
I20260709 13:20:24.242163 16958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48222 (request call id 566) took 1938 ms. Trace:
I20260709 13:20:24.244705 21610 raft_consensus.cc:3060] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.253952 21468 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:24.254208 16958 rpcz_store.cc:276] 0709 13:20:22.308193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.457062 (+148869us) service_pool.cc:224] Handling call
0709 13:20:22.479690 (+ 22628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.484316 (+  4626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.484345 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.494851 (+ 10506us) log.cc:844] Serialized 26 byte log entry
0709 13:20:22.764458 (+269607us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:22.764517 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:22.764627 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.241936 (+1477309us) raft_consensus.cc:1685] finished
0709 13:20:24.241958 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.242095 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9213,"raft.queue_time_us":4688,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3498,"thread_start_us":239143,"threads_started":1,"wal-append.queue_time_us":1739870}
I20260709 13:20:24.256532 21658 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.237217 21538 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:24.232903 21639 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.245461 17522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 990) took 1329 ms. Trace:
I20260709 13:20:24.038267 21316 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.259986 17522 rpcz_store.cc:276] 0709 13:20:22.916061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.916252 (+   191us) service_pool.cc:224] Handling call
0709 13:20:24.122625 (+1206373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:24.227197 (+104572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.245270 (+ 18073us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540055f350. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:24.245406 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2692656896}
W20260709 13:20:24.225137 21681 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.474s	user 0.006s	sys 0.009s
I20260709 13:20:24.022782 21690 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.279516 21658 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:24.281786 21517 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.284883 21517 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.288645 17526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 986) took 1412 ms. Trace:
I20260709 13:20:24.288568 21574 raft_consensus.cc:515] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.289933 21316 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.289091 17526 rpcz_store.cc:276] 0709 13:20:22.875833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.910596 (+ 34763us) service_pool.cc:224] Handling call
0709 13:20:22.910977 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.911356 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.911381 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.930970 (+ 19589us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.223192 (+292222us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:23.223227 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.223285 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.224528 (+1001243us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:24.288361 (+ 63833us) raft_consensus.cc:1685] finished
0709 13:20:24.288384 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.288589 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2404,"raft.queue_time_us":765,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":7487,"spinlock_wait_cycles":8517376,"thread_start_us":146157,"threads_started":1,"wal-append.queue_time_us":543736}
I20260709 13:20:24.290575 21574 leader_election.cc:290] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:24.293954 21598 consensus_meta.cc:287] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.631s	user 0.004s	sys 0.004s
I20260709 13:20:24.294348 21598 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.296098 21678 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.302647 21191 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:24.308156 21634 consensus_meta.cc:287] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.000s
I20260709 13:20:24.309402 21515 consensus_queue.cc:237] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.310384 21653 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.310711 17519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44626 (request call id 987) took 1433 ms. Trace:
I20260709 13:20:24.156541 21582 consensus_queue.cc:260] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.100296 21280 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:24.312849 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.372393 17519 rpcz_store.cc:276] 0709 13:20:22.876820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.878072 (+  1252us) service_pool.cc:224] Handling call
0709 13:20:22.878398 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.878761 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.878791 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.896498 (+ 17707us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b2c000d0c08. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:20:22.896953 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.882116 (+985163us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:23.882163 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.882240 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.310346 (+428106us) raft_consensus.cc:1685] finished
0709 13:20:24.310374 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.310642 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1377,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":8180992,"thread_start_us":984786,"threads_started":1,"wal-append.queue_time_us":1352787}
I20260709 13:20:24.067304 21526 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.159020 16802 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:24.115893 16809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2126) took 1816 ms. Trace:
I20260709 13:20:24.385812 16809 rpcz_store.cc:276] 0709 13:20:22.299094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.449024 (+149930us) service_pool.cc:224] Handling call
0709 13:20:22.466870 (+ 17846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.694181 (+227311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:22.694212 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:22.710987 (+ 16775us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.090413 (+379426us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:23.090462 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.090549 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.115628 (+1025079us) raft_consensus.cc:1685] finished
0709 13:20:24.115655 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.115832 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23277,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":599931,"threads_started":2,"wal-append.queue_time_us":1346387}
W20260709 13:20:24.141770 21476 consensus_meta.cc:287] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.795s	user 0.011s	sys 0.000s
I20260709 13:20:24.162582 21453 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.143975 21685 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:24.153861 21454 consensus_meta.cc:287] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 1.549s	user 0.012s	sys 0.000s
W20260709 13:20:24.153345 21536 consensus_meta.cc:287] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 1.524s	user 0.007s	sys 0.004s
I20260709 13:20:24.112960 21668 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:24.099171 21451 consensus_meta.cc:287] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.000s
W20260709 13:20:24.123466 21589 consensus_meta.cc:287] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 1.287s	user 0.019s	sys 0.000s
W20260709 13:20:24.096060 21418 consensus_meta.cc:287] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 1.473s	user 0.013s	sys 0.000s
I20260709 13:20:24.014894 21488 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.249364 21594 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.415974 16959 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:24.100630 21691 raft_consensus.cc:697] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:24.287477 21690 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:24.324187 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 413863us
W20260709 13:20:24.324959 16924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.021s	sys 0.074s
I20260709 13:20:24.098188 21361 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.328200 17526 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:24.350605 21662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.010s	sys 0.086s
I20260709 13:20:24.355686 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:24.356973 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:24.440867 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.358211 17521 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:20:24.326437 21324 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:24.326927 21678 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.399643 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2128) took 1480 ms. Trace:
I20260709 13:20:24.351876 21657 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.454018 21657 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.454540 17523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 1193) took 1532 ms. Trace:
I20260709 13:20:24.456876 21280 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.389379 21653 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.398389 21454 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.400452 21536 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.414285 21520 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.398720 21582 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.414892 21703 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:20:24.418207 16924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.022s	sys 0.074s
I20260709 13:20:24.432154 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:24.434289 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:24.445369 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:24.473292 16808 raft_consensus.cc:3060] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.400825 21476 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.385555 21634 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.415323 21488 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:24.440635 21662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.010s	sys 0.086s
I20260709 13:20:24.447712 16810 rpcz_store.cc:276] 0709 13:20:22.919107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.919217 (+   110us) service_pool.cc:224] Handling call
0709 13:20:24.392740 (+1473523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:24.392949 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.392984 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:24.393038 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:24.393099 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:24.393165 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.399477 (+  6312us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540011b2d0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:24.399582 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3387997440}
I20260709 13:20:24.450353 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:24.450537 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:24.451216 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:24.452095 16804 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:20:24.392558 16802 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42344 (request call id 709) took 1530 ms (client timeout 1804 ms). Trace:
W20260709 13:20:24.487548 16802 rpcz_store.cc:269] 0709 13:20:22.862547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.862686 (+   139us) service_pool.cc:224] Handling call
0709 13:20:24.392354 (+1529668us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540011b2d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:24.392490 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2895465728}
I20260709 13:20:24.490211 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:24.455019 17523 rpcz_store.cc:276] 0709 13:20:22.922048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:22.923765 (+  1717us) service_pool.cc:224] Handling call
0709 13:20:22.953049 (+ 29284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:22.953527 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:20:23.015888 (+ 62361us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.323086 (+307198us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:23.398276 (+ 75190us) log.cc:844] Serialized 26 byte log entry
0709 13:20:23.398464 (+   188us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:23.398725 (+   261us) log.cc:844] Serialized 14 byte log entry
0709 13:20:23.408376 (+  9651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:23.408448 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:24.454284 (+1045836us) raft_consensus.cc:1685] finished
0709 13:20:24.454330 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:24.454476 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60616,"prepare.queue_time_us":71416,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":7659,"raft.queue_time_us":9671,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":72718,"thread_start_us":234425,"threads_started":1,"wal-append.queue_time_us":1312864}
W20260709 13:20:24.472692 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 782196us
W20260709 13:20:24.473718 21518 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.004s	sys 0.018s
I20260709 13:20:24.492466 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:24.492769 21518 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.004s	sys 0.018s
I20260709 13:20:24.445541 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:24.407253 21589 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.494544 16924 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:24.495441 21280 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:24.407609 21451 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.496100 21280 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:24.473906 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:24.497325 21451 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:24.497864 21451 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:24.498394 21280 consensus_queue.cc:1059] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:24.498315 21451 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.477133 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:24.498961 16924 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:24.499215 21280 raft_consensus.cc:3055] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:24.389580 21530 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.499665 17519 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 13: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:24.495843 21678 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:24.500339 21697 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:24.500533 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:24.499583 21280 raft_consensus.cc:740] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:24.501461 21488 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:24.501935 21488 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:24.495865 21589 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:24.502432 21488 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:24.502274 21280 consensus_queue.cc:260] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.501338 21530 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:24.503505 21280 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:24.504925 21530 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:24.505401 21530 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.507351 21530 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:24.509558 21451 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:24.472307 21490 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.291s	user 0.012s	sys 0.012s
I20260709 13:20:24.512838 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:24.443512 21574 consensus_queue.cc:1059] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:20:24.512105 17524 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
W20260709 13:20:24.517601 16850 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.045s	sys 0.042s
I20260709 13:20:24.519026 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:24.519755 17525 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 13: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:20:24.519960 16850 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.046s	sys 0.042s
W20260709 13:20:24.520284 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 744555us
I20260709 13:20:24.520411 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:24.463577 21324 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:24.473822 21661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.006s	sys 0.017s
I20260709 13:20:24.469410 21690 consensus_queue.cc:1059] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 13:20:24.516786 21490 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.405s	user 0.012s	sys 0.012s
I20260709 13:20:24.555491 16878 raft_consensus.cc:1275] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:20:24.555992 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:24.556522 16881 raft_consensus.cc:3060] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.556922 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:24.557317 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:24.557789 16878 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:20:24.522636 21219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.018s	sys 0.022s
I20260709 13:20:24.473830 21520 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.569070 16876 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:20:24.561141 16879 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:20:24.565322 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.570312 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:24.570643 16882 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:24.571277 16804 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:24.566015 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:24.473742 21698 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:20:24.553602 16773 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:24.574023 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:24.574880 16810 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:24.577304 16805 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:24.578982 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:24.581825 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.566821 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.584846 16878 raft_consensus.cc:3060] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:24.552284 21661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.007s	sys 0.017s
W20260709 13:20:24.591440 16775 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.014s	sys 0.045s
W20260709 13:20:24.592945 16775 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.014s	sys 0.045s
I20260709 13:20:24.594413 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:24.595083 16879 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:24.589354 16882 raft_consensus.cc:2368] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11.
I20260709 13:20:24.592825 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:24.594494 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 516243us
I20260709 13:20:24.588363 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.547408 21639 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:24.597903 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:24.475323 21703 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.603914 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:20:24.567368 21219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.018s	sys 0.022s
I20260709 13:20:24.601502 16881 raft_consensus.cc:2468] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:24.513434 21658 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:20:24.603634 16876 raft_consensus.cc:2393] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:24.605345 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:24.610656 16809 raft_consensus.cc:2393] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 9: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:20:24.599710 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 230762us
I20260709 13:20:24.607316 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.591200 21610 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:24.625981 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:24.631784 16804 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:24.628042 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:24.591480 21598 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.633425 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.593667 21686 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:24.629900 16775 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:24.632643 17524 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.634934 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.602226 21398 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.639971 16807 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:24.640194 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.640784 16885 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 15.
I20260709 13:20:24.641590 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.642555 16885 raft_consensus.cc:2410] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:20:24.643407 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.644317 16885 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
W20260709 13:20:24.647035 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.598959 21702 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:24.606995 21690 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.691699 16878 raft_consensus.cc:2468] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:24.651778 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:24.549479 21691 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.629179 21660 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:24.626530 21659 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:24.630792 21610 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:24.627398 21191 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.625470 21677 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:24.693894 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:24.645691 21316 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.689960 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:24.690562 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.623047 21689 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.634042 21526 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:24.639354 21686 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:24.708165 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 78416.8us
I20260709 13:20:24.701076 21536 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:24.708983 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:24.714762 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 229893us
W20260709 13:20:24.715147 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 66413.4us
I20260709 13:20:24.645526 21538 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:24.636447 21692 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:24.788879 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.789672 21454 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:24.823559 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:24.824244 16958 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:24.712383 21418 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:24.794011 21677 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.820124 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:24.795300 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.699442 21653 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:24.832360 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:24.796851 16959 raft_consensus.cc:1275] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:24.645123 21370 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:20:24.651105 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.835752 16885 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:24.835896 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.700598 21594 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.836760 16809 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:24.803803 17524 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:24.805738 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:24.822232 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:24.651836 21398 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.802676 16878 raft_consensus.cc:2410] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:20:24.813408 21686 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.844830 16954 raft_consensus.cc:2393] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 13: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:24.841410 16773 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:24.848992 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.852588 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:24.852831 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:24.854629 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:24.855715 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:24.857204 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.857965 16809 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:24.721537 21690 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.723224 21280 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:20:24.864738 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.865231 16885 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:24.870951 16951 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:24.820010 21692 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:24.824328 21476 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.877867 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:24.880656 16957 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:24.880714 16922 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:24.884111 21696 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:24.886229 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:24.702148 21702 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.840440 21661 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.803596 21316 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.798774 21488 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.896023 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.835413 21574 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.724143 21659 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.891897 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:24.901822 21677 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:24.902305 21534 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:24.873371 21538 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:20:24.937429 21708 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:20:24.903059 16922 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:24.937671 21538 raft_consensus.cc:697] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:24.847219 21684 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:20:24.813469 21689 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.842232 21361 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:24.912039 16879 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:24.726056 21660 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.913373 16958 raft_consensus.cc:2468] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:24.916440 16878 raft_consensus.cc:2368] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10.
W20260709 13:20:24.918071 16775 connection.cc:256] RPC call timeout handler was delayed by -1.2311464090000754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:20:24.918385 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:24.919154 16808 raft_consensus.cc:2468] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
W20260709 13:20:24.963716 16775 connection.cc:256] RPC call timeout handler was delayed by -1.2131464090000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 13:20:24.964099 16957 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:24.964427 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.965081 16808 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 8.
W20260709 13:20:24.965566 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:24.965909 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.919629 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:24.926882 21693 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:24.932587 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:24.933333 16956 raft_consensus.cc:2393] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:24.863499 21526 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:24.935775 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.903714 21705 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:24.894191 21692 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:24.938772 21538 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.833397 21418 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:24.968999 16954 raft_consensus.cc:2393] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:24.916195 21589 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:20:24.848183 21610 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.974799 16885 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:24.974817 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.975281 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.976311 16775 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:24.988161 16879 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:24.988252 16808 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:24.989050 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:24.981979 21518 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.989943 21398 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.990129 21518 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:24.992463 21712 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:24.992554 21518 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:24.994346 21599 raft_consensus.cc:3055] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:24.994758 21599 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:24.995492 21660 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.969000 21536 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:24.996537 21536 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:24.996932 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:24.980721 21526 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:24.998607 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:24.999145 21526 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:24.999989 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.000612 21476 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:25.001901 21476 consensus_queue.cc:1059] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:25.002897 21476 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:25.003255 21476 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:24.980285 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:25.004850 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:25.005528 16958 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 13: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:25.006002 21721 ts_tablet_manager.cc:933] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:25.006301 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:24.940287 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:24.934731 21324 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:24.968420 21693 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.008396 16959 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:24.953037 21370 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:25.000720 16883 raft_consensus.cc:2393] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 11: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:24.984423 16953 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:24.921960 21661 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:25.015626 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.021402 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:25.024266 16958 raft_consensus.cc:2368] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10.
I20260709 13:20:24.941259 21574 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:25.022485 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:25.042886 16808 raft_consensus.cc:3060] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:25.044160 16950 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52044 (request call id 2474) took 1176 ms. Trace:
I20260709 13:20:25.044509 16950 rpcz_store.cc:276] 0709 13:20:23.867709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:23.867923 (+   214us) service_pool.cc:224] Handling call
0709 13:20:23.891414 (+ 23491us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:20:23.972068 (+ 80654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:23.972097 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:20:24.114386 (+142289us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b2c0012df38. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:20:24.114933 (+   547us) log.cc:844] Serialized 52 byte log entry
0709 13:20:24.518988 (+404055us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:24.760357 (+241369us) log.cc:844] Serialized 14 byte log entry
0709 13:20:24.878317 (+117960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.043876 (+165559us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b540030a7d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:25.043922 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.043964 (+    42us) raft_consensus.cc:1685] finished
0709 13:20:25.043976 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.044108 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90252,"prepare.queue_time_us":456818,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":100325,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":184,"spinlock_wait_cycles":272796160,"thread_start_us":612643,"threads_started":2,"wal-append.queue_time_us":723550}
I20260709 13:20:24.980510 21361 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:20:25.047928 16809 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.026360 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:25.026533 21703 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:25.026501 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.056448 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:25.057122 16883 raft_consensus.cc:2393] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:25.057452 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.057859 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.058521 16883 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:25.059742 21614 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:25.060407 21614 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:25.061125 21690 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:25.021422 21693 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:25.028110 21582 consensus_meta.cc:287] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
I20260709 13:20:25.029323 21659 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:24.995523 21599 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:25.067772 21614 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:25.068066 21599 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:25.068848 21692 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:25.069515 21661 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:25.070825 21692 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:25.003536 21520 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:25.074368 21488 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:25.033030 21418 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:25.033969 21722 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:20:24.996958 21536 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.035230 21316 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:25.036548 21689 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:25.037374 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.038508 21610 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.130558 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:25.131179 17518 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.131664 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:25.131932 21634 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:25.053129 16808 raft_consensus.cc:2468] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:25.132575 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.133493 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:25.133740 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.134212 16808 raft_consensus.cc:2368] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:25.134333 16880 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:25.066010 16883 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:20:25.076618 16879 raft_consensus.cc:2410] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:25.111274 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:25.112373 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:25.136809 16805 raft_consensus.cc:2393] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 14: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:25.115823 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.078342 21476 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:25.119974 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.109422 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:25.138224 16881 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 8.
I20260709 13:20:25.133574 21574 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:25.063071 16958 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:25.136013 16801 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:25.138357 16803 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:25.121811 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:25.143126 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:25.144543 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.144901 16808 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:25.145835 16805 raft_consensus.cc:1240] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:20:25.148114 16804 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:25.143175 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.142763 16809 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:25.150211 16801 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:25.153693 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:25.155943 16808 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:25.156869 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.157056 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.157501 16880 raft_consensus.cc:2468] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:20:25.157667 16876 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:25.158833 17518 raft_consensus.cc:2410] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:20:25.161253 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.164484 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:25.169385 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 160721us
I20260709 13:20:25.169701 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.172709 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:25.186268 17521 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:25.190384 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:25.191169 17518 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:25.187991 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:25.193164 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:25.193899 17524 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:25.194723 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:25.195535 16958 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:25.195427 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:25.196668 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:25.203869 17522 raft_consensus.cc:2368] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
I20260709 13:20:25.204353 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:25.205370 16950 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:25.205817 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:25.206796 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:25.207428 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:25.207823 16807 raft_consensus.cc:2393] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 15: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:25.212103 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:25.211293 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:25.171167 21476 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:25.214257 17525 raft_consensus.cc:1240] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:25.214828 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.215319 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:25.217543 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.218335 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.220306 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:25.223223 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.224139 16885 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:25.225349 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:25.226482 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.227305 16885 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:25.227260 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:25.230894 16885 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:25.229611 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:25.232969 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:25.228122 17521 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:25.235074 17518 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:25.240545 17522 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:25.240895 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:25.241559 16885 raft_consensus.cc:2368] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10.
I20260709 13:20:25.247479 17492 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:25.250221 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:25.251065 16802 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:25.252727 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.256138 16881 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:25.262794 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:25.255045 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:25.264353 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:25.265196 17524 raft_consensus.cc:2376] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14. Re-sending same reply.
I20260709 13:20:25.265445 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:25.258555 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:25.269861 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:25.290426 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.290647 16924 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:25.291287 16877 raft_consensus.cc:1240] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:25.266239 16805 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
W20260709 13:20:25.295481 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 48323.7us
I20260709 13:20:25.244239 21530 raft_consensus.cc:2764] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:20:25.303689 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:25.296711 16924 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:25.302973 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:25.304930 16881 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:25.305260 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:25.260250 21709 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:25.311781 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:25.307873 21703 raft_consensus.cc:2804] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:25.298477 21520 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:25.312510 16877 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:25.289950 21488 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:25.259088 21361 consensus_queue.cc:1048] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:20:25.316805 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:25.317951 21725 log.cc:927] Time spent T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:20:25.317812 21703 raft_consensus.cc:697] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:25.329185 21703 consensus_queue.cc:237] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:25.331815 21702 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:25.333187 21536 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:25.314554 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:25.293869 21589 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:25.309890 21696 raft_consensus.cc:2804] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:25.417444 16884 raft_consensus.cc:2410] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:20:25.458570 16880 raft_consensus.cc:2410] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
W20260709 13:20:25.411365 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.413839 17527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 1203) took 1085 ms. Trace:
I20260709 13:20:25.377115 16877 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:20:25.314220 21669 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:20:25.934916 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.455313 17526 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
W20260709 13:20:25.408288 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.405979 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:25.926679 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:25.927016 16885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.007s	sys 0.014s
W20260709 13:20:25.936053 16885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.007s	sys 0.015s
W20260709 13:20:25.936132 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.936657 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.524113 21634 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:25.607232 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:25.932628 16877 pending_rounds.cc:85] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 8
I20260709 13:20:25.939522 16877 pending_rounds.cc:107] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:20:25.939860 16877 raft_consensus.cc:2889] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:25.348158 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:25.937155 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:25.941133 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 592993us
W20260709 13:20:25.454008 21737 log.cc:927] Time spent T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:20:25.945534 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:25.933048 17527 rpcz_store.cc:276] 0709 13:20:24.328623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.328728 (+   105us) service_pool.cc:224] Handling call
0709 13:20:24.356997 (+ 28269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.618163 (+261166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.618205 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.117808 (+499603us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b2c000d0c08. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed98fa11 00007feeed99f372 00007feeef0d1a01 00007feeef09643a 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2
0709 13:20:25.118231 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:20:25.266837 (+148606us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:20:25.266867 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:25.266928 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:25.413542 (+146614us) raft_consensus.cc:1685] finished
0709 13:20:25.413563 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:25.413776 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147434,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":15400320,"thread_start_us":409016,"threads_started":2,"wal-append.queue_time_us":293479}
W20260709 13:20:25.795655 21742 log.cc:927] Time spent T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
W20260709 13:20:25.792181 21726 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.738s	user 0.005s	sys 0.000s
I20260709 13:20:25.323163 21488 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:25.950320 21370 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:25.952589 16801 raft_consensus.cc:1240] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12. Ops: []
W20260709 13:20:25.950484 21476 consensus_meta.cc:287] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 0.729s	user 0.007s	sys 0.002s
I20260709 13:20:25.313985 21684 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.627s
I20260709 13:20:25.335556 21536 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:25.420048 21705 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:25.335985 21589 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:25.946257 21634 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:25.961064 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:25.961993 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:25.934706 21669 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:25.337606 21686 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:25.960633 21370 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.968387 16879 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:20:25.325642 21693 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:25.977254 21370 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.979151 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:25.992455 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:25.993108 16808 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:25.993423 16959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 582) took 1014 ms. Trace:
I20260709 13:20:25.993870 16959 rpcz_store.cc:276] 0709 13:20:24.979501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.996677 (+ 17176us) service_pool.cc:224] Handling call
0709 13:20:25.993239 (+996562us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54000537d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:25.993371 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24733056}
I20260709 13:20:25.968501 21589 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.959429 21488 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:25.984421 16692 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 599f9a88b6cd4e818a1c59a0b4522480 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:25.981923 16879 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:25.997256 21693 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:25.998049 16951 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:26.000845 16810 raft_consensus.cc:2368] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
I20260709 13:20:25.971180 21669 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:25.989190 21740 log.cc:927] Time spent T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.809s	user 0.000s	sys 0.024s
W20260709 13:20:26.003784 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 73358.2us
I20260709 13:20:26.006080 16955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34330 (request call id 2330) took 1152 ms. Trace:
I20260709 13:20:26.009783 16808 raft_consensus.cc:2468] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:26.010018 17492 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:26.011569 16956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 2328) took 1155 ms. Trace:
I20260709 13:20:26.001603 21589 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.011997 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:26.011992 16956 rpcz_store.cc:276] 0709 13:20:24.853110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.855423 (+  2313us) service_pool.cc:224] Handling call
0709 13:20:26.008824 (+1153401us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b54002094d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:26.008948 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176436096}
I20260709 13:20:26.013000 21703 raft_consensus.cc:2804] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:26.010452 21536 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.009593 16955 rpcz_store.cc:276] 0709 13:20:24.853716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.853867 (+   151us) service_pool.cc:224] Handling call
0709 13:20:24.854198 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:25.037774 (+183576us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:25.038102 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 13:20:25.228545 (+190443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:25.228584 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:25.228618 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.005865 (+777247us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54002ec554. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:26.005920 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.006030 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":198,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2897,"spinlock_wait_cycles":446280832,"thread_start_us":190099,"threads_started":1,"wal-append.queue_time_us":261361}
I20260709 13:20:25.967094 21705 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.022154 21716 consensus_queue.cc:1059] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:26.023133 21518 raft_consensus.cc:3055] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:26.023092 21370 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:26.026197 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:26.023699 21518 raft_consensus.cc:740] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:26.029206 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:26.029778 16808 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.031458 16805 raft_consensus.cc:3055] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:26.023166 21718 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:26.026892 21703 raft_consensus.cc:697] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:26.031833 16805 raft_consensus.cc:740] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:26.038548 16808 raft_consensus.cc:2468] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:26.032612 21718 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:26.034096 16805 consensus_queue.cc:260] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.025292 21536 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.041404 17492 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:26.043495 21716 raft_consensus.cc:2804] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:26.043282 21703 consensus_queue.cc:237] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.044203 21536 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:26.029510 21686 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:26.047890 16953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34330 (request call id 2342) took 1156 ms. Trace:
I20260709 13:20:26.032618 21518 consensus_queue.cc:260] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.048436 16953 rpcz_store.cc:276] 0709 13:20:24.891843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.932311 (+ 40468us) service_pool.cc:224] Handling call
0709 13:20:26.047739 (+1115428us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b54000528d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:26.047837 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39007488}
I20260709 13:20:26.042667 21718 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.062487 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.063141 16882 raft_consensus.cc:2410] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:26.064961 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.064744 21518 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.074322 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.075619 16882 raft_consensus.cc:2393] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:26.076885 21705 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:26.077315 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.078552 16878 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 2168) took 1273 ms. Trace:
I20260709 13:20:26.078912 16882 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:26.078969 16878 rpcz_store.cc:276] 0709 13:20:24.804748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.864471 (+ 59723us) service_pool.cc:224] Handling call
0709 13:20:26.078369 (+1213898us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b54000b5254. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:26.078503 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96570752}
I20260709 13:20:26.078795 16883 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:20:26.080355 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:26.080459 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.081212 16876 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:26.088636 16922 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:26.089958 21701 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.090114 21705 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:26.090692 21705 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.090471 21701 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.092283 21705 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:26.094628 16809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 2211) took 1277 ms (client timeout 1597 ms). Trace:
I20260709 13:20:26.096319 21370 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:26.095187 16809 rpcz_store.cc:269] 0709 13:20:24.817268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.897205 (+ 79937us) service_pool.cc:224] Handling call
0709 13:20:26.094430 (+1197225us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b54002a7954. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:26.094562 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91445120}
I20260709 13:20:26.097179 21634 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:26.103857 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:26.104190 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44084 (request call id 2177) took 1001 ms. Trace:
I20260709 13:20:26.104602 16880 rpcz_store.cc:276] 0709 13:20:25.102992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.164183 (+ 61191us) service_pool.cc:224] Handling call
0709 13:20:26.103968 (+939785us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400145ad4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:26.104134 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674113408}
I20260709 13:20:26.105360 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:26.105716 16881 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:20:26.106110 16881 pending_rounds.cc:85] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 11
I20260709 13:20:26.106319 16881 pending_rounds.cc:107] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:20:26.106525 16881 raft_consensus.cc:2889] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:26.107880 21536 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:26.108193 21536 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:26.108436 21536 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.109601 21701 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:26.110378 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.111052 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.111510 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.111799 16876 raft_consensus.cc:2393] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:26.112640 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.113168 16880 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:26.113888 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.115692 16880 raft_consensus.cc:2393] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:26.116209 16883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2169) took 1066 ms. Trace:
I20260709 13:20:26.116591 16883 rpcz_store.cc:276] 0709 13:20:25.049875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.261358 (+211483us) service_pool.cc:224] Handling call
0709 13:20:26.078496 (+817138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.080684 (+  2188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.116020 (+ 35336us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54000b5250. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0958ad 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:26.116153 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878300544}
I20260709 13:20:26.115491 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:26.117724 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:26.118579 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43950 (request call id 2204) took 1319 ms. Trace:
I20260709 13:20:26.118925 16810 rpcz_store.cc:276] 0709 13:20:24.798684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.998352 (+199668us) service_pool.cc:224] Handling call
0709 13:20:26.118423 (+1120071us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001a7f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:26.118533 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2303218944}
W20260709 13:20:26.114337 21751 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:20:26.120409 17490 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.121050 21705 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:26.116596 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:26.114639 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.123929 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.125061 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.125787 16881 raft_consensus.cc:2393] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:20:26.075747 21750 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:20:26.129194 17521 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:26.130296 16884 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42010 (request call id 699) took 1423 ms (client timeout 1872 ms). Trace:
W20260709 13:20:26.130676 16884 rpcz_store.cc:269] 0709 13:20:24.706810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.723118 (+ 16308us) service_pool.cc:224] Handling call
0709 13:20:26.130136 (+1407018us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b5400343354. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:26.130245 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350269184}
I20260709 13:20:26.132655 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:26.133282 17523 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:26.133409 21724 log.cc:927] Time spent T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 1.078s	user 0.008s	sys 0.015s
I20260709 13:20:26.135461 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.113910 16850 leader_election.cc:400] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
I20260709 13:20:26.136298 16876 raft_consensus.cc:2368] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10.
I20260709 13:20:26.114267 21536 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.137262 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:26.139235 16883 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:26.136216 16880 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:26.116899 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.140570 17526 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:26.141023 16882 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:26.122314 16922 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:26.143468 16922 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:26.146392 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:26.146265 21705 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:20:26.146844 16922 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:26.159360 16880 raft_consensus.cc:2410] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:20:26.135583 21589 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:26.144287 21598 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:26.144482 21701 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:26.162868 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:26.163393 16951 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:26.147807 21280 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:26.164476 21701 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:26.164063 21490 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:26.169274 16805 raft_consensus.cc:3060] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:26.169358 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:26.169643 21701 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:26.145529 21634 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:20:26.172204 16956 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:26.162354 21526 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:26.175227 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:26.164271 21598 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:26.165341 16951 raft_consensus.cc:1240] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:26.164685 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:26.184538 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:26.186005 16951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:26.186825 16951 raft_consensus.cc:606] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:26.187300 16951 raft_consensus.cc:614] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:26.193233 21589 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:26.198565 17523 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:26.179060 21280 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:26.200243 16773 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:26.200912 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:26.181664 21598 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.230541 21536 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:26.231562 21536 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:26.232309 21536 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:26.232431 21763 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:26.232898 21536 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.260244 21767 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:26.260944 21767 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:26.261389 21767 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:26.264137 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 174508us
I20260709 13:20:26.203747 21686 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:26.202232 21490 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:26.291381 16951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:26.292367 16951 raft_consensus.cc:606] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:26.294163 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 107675us
W20260709 13:20:26.302456 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 359705us
I20260709 13:20:26.228760 21696 raft_consensus.cc:697] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:26.281016 21490 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:26.316238 16848 leader_election.cc:400] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
W20260709 13:20:26.337934 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 137109us
I20260709 13:20:26.380496 16848 leader_election.cc:403] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:26.380988 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:26.381661 21773 consensus_queue.cc:1059] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:26.383065 16924 leader_election.cc:400] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11.
I20260709 13:20:26.383458 16924 leader_election.cc:403] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:20:26.384620 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 89246.3us
W20260709 13:20:26.391228 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 446735us
I20260709 13:20:26.394439 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:26.379572 21721 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 1.319s	user 0.012s	sys 0.018s
I20260709 13:20:26.228443 21280 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.306808 21716 raft_consensus.cc:697] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:26.304137 21686 raft_consensus.cc:697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:26.405504 21219 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.407146 16956 raft_consensus.cc:1240] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:26.411487 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.390971 21703 raft_consensus.cc:3055] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:26.413007 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:26.415978 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:26.379696 21538 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.383657 21490 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.423300 16956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6455509d1ac14e1d961f38607a869924"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
W20260709 13:20:26.424448 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.425649 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 114020us
I20260709 13:20:26.429659 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:26.426031 16775 leader_election.cc:400] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10.
W20260709 13:20:26.403776 21721 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 1.344s	user 0.013s	sys 0.018s
I20260709 13:20:26.430536 16775 leader_election.cc:403] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:20:26.439426 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.310444 21669 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:26.401484 21634 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:26.448031 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:26.456027 16924 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:26.456563 16775 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:26.457079 16924 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:26.458715 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 2199) took 1259 ms. Trace:
I20260709 13:20:26.459149 16879 rpcz_store.cc:276] 0709 13:20:25.199504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.002498 (+802994us) service_pool.cc:224] Handling call
0709 13:20:26.002768 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:26.002940 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:26.274986 (+272046us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.458365 (+183379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.458421 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:26.458472 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.458529 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.458653 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15082,"prepare.queue_time_us":261861,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"thread_start_us":438904,"threads_started":3,"wal-append.queue_time_us":105967}
I20260709 13:20:26.426638 21589 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:26.466346 16956 raft_consensus.cc:606] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:26.426715 21703 raft_consensus.cc:740] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:26.474442 16924 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:26.475598 16924 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:26.480500 16805 raft_consensus.cc:1275] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:26.482260 16956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:26.482885 16956 raft_consensus.cc:606] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:26.483263 16956 raft_consensus.cc:614] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:20:26.484623 21768 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.250s	user 0.001s	sys 0.002s
I20260709 13:20:26.487011 16956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:26.488801 16956 raft_consensus.cc:606] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:26.489236 16956 raft_consensus.cc:614] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:26.490424 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:26.494755 21574 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:26.421455 21774 consensus_queue.cc:1059] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:20:26.461076 21668 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:26.462565 21684 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:26.466081 21505 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
I20260709 13:20:26.462669 21526 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:26.453996 21727 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10.
I20260709 13:20:26.428345 21219 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:26.436533 21538 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:26.501190 21520 raft_consensus.cc:2804] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:26.502408 21685 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:20:26.513458 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.500615 21659 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:26.461333 21634 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:26.502882 21668 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:26.473110 21721 tablet_copy_client.cc:323] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.3:33725
I20260709 13:20:26.533357 16877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44084 (request call id 2197) took 1369 ms. Trace:
I20260709 13:20:26.533818 16877 rpcz_store.cc:276] 0709 13:20:25.164064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.995003 (+830939us) service_pool.cc:224] Handling call
0709 13:20:25.995286 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:25.995483 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:20:26.402693 (+407210us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.529424 (+126731us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.532988 (+  3564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:26.533039 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:26.533090 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.533175 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.533300 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3368,"prepare.queue_time_us":270727,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"thread_start_us":514739,"threads_started":3}
I20260709 13:20:26.515055 21774 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:20:26.529249 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.531240 21771 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:20:26.524044 21716 consensus_queue.cc:237] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.452018 21696 consensus_queue.cc:237] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:26.561821 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 80522.1us
I20260709 13:20:26.518188 21702 raft_consensus.cc:2804] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:26.565258 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 146434us
I20260709 13:20:26.535290 21668 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.529476 21520 raft_consensus.cc:697] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:26.574764 17492 leader_election.cc:336] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.631s (SENT)
I20260709 13:20:26.575294 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:26.576337 17492 leader_election.cc:336] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.654s (SENT)
I20260709 13:20:26.576721 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:26.555918 21774 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:26.579051 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 262967us
I20260709 13:20:26.511801 21686 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.579439 21659 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:26.583797 21774 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:26.557500 21703 consensus_queue.cc:260] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:26.714185 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 301241us
W20260709 13:20:26.629607 21783 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:20:26.724385 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 146230us
I20260709 13:20:26.624006 16848 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:26.582423 21702 raft_consensus.cc:697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:26.715221 16850 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:26.726824 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 102885us
I20260709 13:20:26.740731 16879 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:26.621258 21777 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:26.745584 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.721501 16885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2170) took 1671 ms. Trace:
I20260709 13:20:26.585134 21781 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:20:26.747960 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 272420us
I20260709 13:20:26.748929 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:26.750694 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 286561us
I20260709 13:20:26.747895 21781 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:20:26.743129 21771 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:20:26.736047 21780 raft_consensus.cc:3055] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:26.737552 21759 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.738864 21669 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:26.748907 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:26.743953 21703 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:26.785041 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:26.768031 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.792577 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:26.794462 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.795917 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.796131 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.796998 16880 raft_consensus.cc:2393] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 16: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:26.797863 16882 raft_consensus.cc:1275] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:20:26.798218 16882 pending_rounds.cc:85] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 10
I20260709 13:20:26.798409 16882 pending_rounds.cc:107] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 12.11
W20260709 13:20:26.798460 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 49632.1us
I20260709 13:20:26.798702 16882 raft_consensus.cc:2889] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:20:26.799113 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.799741 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:26.796370 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.800868 16878 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:26.726114 21659 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.752687 21789 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:26.746470 16885 rpcz_store.cc:276] 0709 13:20:25.050095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:25.257976 (+207881us) service_pool.cc:224] Handling call
0709 13:20:25.258355 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:25.272310 (+ 13955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:25.272341 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.272756 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:20:25.936393 (+663637us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:20:26.402339 (+465946us) log.cc:844] Serialized 14 byte log entry
0709 13:20:26.721192 (+318853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.721271 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:26.721317 (+    46us) raft_consensus.cc:1685] finished
0709 13:20:26.721331 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.721449 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1415,"prepare.queue_time_us":327853,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":139500,"raft.run_cpu_time_us":3613,"raft.run_wall_time_us":21372,"thread_start_us":1372616,"threads_started":3,"wal-append.queue_time_us":703633}
I20260709 13:20:26.773666 21780 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:26.774310 21755 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:26.755363 21763 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:26.828661 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 103518us
I20260709 13:20:26.754230 21781 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:20:26.836742 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 121622us
I20260709 13:20:26.837559 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:26.838771 16850 leader_election.cc:400] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:26.839007 16850 leader_election.cc:403] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:26.839460 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:26.840570 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.841193 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:26.842285 16885 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
W20260709 13:20:26.843596 17492 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.826507 21753 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:26.844202 17492 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.726s (SENT) [suppressed 31 similar messages]
I20260709 13:20:26.789672 21505 consensus_queue.cc:1059] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:20:26.747825 21520 consensus_queue.cc:237] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:26.848418 17492 leader_election.cc:336] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.795s (SENT)
I20260709 13:20:26.828821 21219 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:26.788985 21759 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:26.875408 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:26.851970 21789 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:26.826339 21797 consensus_queue.cc:1048] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:20:26.836306 21476 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:26.853793 21779 log.cc:927] Time spent T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.269s	user 0.000s	sys 0.000s
I20260709 13:20:26.853523 21669 raft_consensus.cc:2955] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:26.854526 21788 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:26.848878 21763 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.879424 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:26.863813 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.873082 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:26.918744 16883 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:26.873368 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:26.919629 16876 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.836659 21538 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:26.852140 21659 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:26.904428 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 152903us
W20260709 13:20:26.869913 21784 log.cc:927] Time spent T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:20:26.931577 16955 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:20:26.931984 21793 log.cc:927] Time spent T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:20:26.852211 21705 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.923358 16924 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:26.932717 21705 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:26.934432 21659 raft_consensus.cc:2804] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:20:26.870983 21758 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:20:26.934960 21659 raft_consensus.cc:697] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:26.915088 17520 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:26.915200 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:26.935702 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:20:26.871600 21764 log.cc:927] Time spent T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.341s	user 0.002s	sys 0.000s
I20260709 13:20:26.863425 21753 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:26.938724 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:26.836824 21755 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.920804 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:26.943181 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:26.948505 16807 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:26.922500 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 82105.7us
I20260709 13:20:26.830986 21702 consensus_queue.cc:237] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:26.926739 16969 tablet_copy_service.cc:140] P ca1b60a074dc47cd8e68cc57a33a94a3: Received BeginTabletCopySession request for tablet e9f7a2a0447a4956b36d1e9902e62f56 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:48222)
I20260709 13:20:26.928517 21763 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:26.929906 16802 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:20:26.870409 21790 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:20:26.932248 21718 consensus_meta.cc:287] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.868s	user 0.012s	sys 0.000s
I20260709 13:20:26.893956 21802 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:26.870617 16803 raft_consensus.cc:1275] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:20:26.920279 21767 consensus_meta.cc:287] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.003s
I20260709 13:20:26.940021 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:26.950500 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:26.951522 16924 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:20:26.959396 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:26.934971 21705 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:26.967617 16876 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:26.911656 21476 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:26.967770 16806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2147) took 2367 ms. Trace:
I20260709 13:20:26.976109 16804 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:26.979164 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:26.983243 17492 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:26.907786 21789 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.981293 16806 rpcz_store.cc:276] 0709 13:20:24.600007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.722908 (+122901us) service_pool.cc:224] Handling call
0709 13:20:24.796561 (+ 73653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:24.797110 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:24.797135 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:25.971198 (+1174063us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4c0004fa00. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeed362a20 00007feeed373a29 00007feeed339644 00007feeed360f2d 00007feeed360b93 00007feeef09118b 00007feeef091cb5 00007feeef093004 00007feeef092729 00007feeef097d96 00007feeef08cadb
0709 13:20:25.975704 (+  4506us) log.cc:844] Serialized 492 byte log entry
0709 13:20:26.401056 (+425352us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:26.401205 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:26.401437 (+   232us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:26.950367 (+548930us) raft_consensus.cc:1685] finished
0709 13:20:26.950387 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:26.967705 (+ 17318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23534464,"thread_start_us":424474,"threads_started":1,"wal-append.queue_time_us":740689}
W20260709 13:20:26.991772 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 49457.4us
I20260709 13:20:26.990577 16807 raft_consensus.cc:2468] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:26.992568 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:26.994813 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:26.995437 16802 raft_consensus.cc:3060] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:26.998498 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:26.920099 21788 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.969429 21786 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:27.002969 17492 leader_election.cc:336] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.663s (SENT)
I20260709 13:20:27.004254 21798 raft_consensus.cc:2764] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:20:27.011853 21813 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:27.008123 21659 consensus_queue.cc:237] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:27.008479 21538 consensus_queue.cc:1059] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:20:26.917806 21780 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:26.969980 16969 tablet_copy_service.cc:161] P ca1b60a074dc47cd8e68cc57a33a94a3: Beginning new tablet copy session on tablet e9f7a2a0447a4956b36d1e9902e62f56 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:48222: session id = 599f9a88b6cd4e818a1c59a0b4522480-e9f7a2a0447a4956b36d1e9902e62f56
I20260709 13:20:27.018009 17492 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:26.981263 21370 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:27.013510 21788 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:27.001454 21787 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:26.965495 21684 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:20:26.968060 21696 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:20:27.032253 17519 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:26.996376 21804 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:26.950143 21785 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
W20260709 13:20:27.007954 21701 consensus_meta.cc:287] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.832s	user 0.010s	sys 0.002s
I20260709 13:20:27.000758 21418 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:27.015683 21756 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:27.011852 21755 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:26.977612 21718 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.097576 17527 raft_consensus.cc:1240] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:27.098152 21476 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:27.025873 21753 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:26.981859 21767 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:27.004451 21526 consensus_queue.cc:1048] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:20:27.068446 21490 consensus_meta.cc:287] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.609s	user 0.005s	sys 0.005s
I20260709 13:20:27.045651 21716 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:27.004086 21791 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
W20260709 13:20:27.044176 21488 consensus_meta.cc:287] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 1.031s	user 0.010s	sys 0.002s
W20260709 13:20:27.082809 21792 log.cc:927] Time spent T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:20:27.041776 21697 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.113656 21697 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:27.114842 21781 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.115653 21697 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:27.084404 21536 consensus_meta.cc:287] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.004s
I20260709 13:20:27.116397 21536 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.110549 21490 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:27.075543 21786 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.094825 21589 consensus_meta.cc:287] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.001s
W20260709 13:20:27.099462 21598 consensus_meta.cc:287] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.832s	user 0.007s	sys 0.000s
I20260709 13:20:27.081028 21780 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:27.084606 21811 log.cc:927] Time spent T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:20:27.057490 21808 raft_consensus.cc:3055] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:27.106221 21797 consensus_queue.cc:1048] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:20:27.132768 21634 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:27.127490 21786 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.134860 21781 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:27.132179 21808 raft_consensus.cc:740] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:27.135885 21786 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:27.137176 21808 consensus_queue.cc:260] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.104022 21701 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:27.141618 21808 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.142378 21767 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:27.196358 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.198936 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 202914us
I20260709 13:20:27.209007 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.210656 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.211557 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.212222 16806 raft_consensus.cc:2410] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:27.212957 16807 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 9.
I20260709 13:20:27.215426 16806 raft_consensus.cc:1240] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:27.220501 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 269584us
W20260709 13:20:27.220842 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.221536 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.225646 16850 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:27.227001 16882 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:27.229662 16876 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:20:27.231863 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 229417us
I20260709 13:20:27.237468 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:27.239063 16924 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:27.243284 16924 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:27.240092 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:27.240100 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.244704 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.254555 16850 leader_election.cc:400] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12.
I20260709 13:20:27.246670 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.246996 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.247947 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.248931 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.261289 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:27.266374 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.266813 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:27.268245 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:27.268471 16807 raft_consensus.cc:2393] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 10: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:27.269855 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.270337 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.271054 16806 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:27.273969 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:27.274832 17520 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:27.276455 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:27.276866 17524 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:27.278484 16953 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:27.281940 21370 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:27.282939 21370 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.286741 21370 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:27.287930 16953 raft_consensus.cc:1240] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:20:27.291857 21370 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:27.292544 21370 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.293262 21370 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:27.293664 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.294628 16953 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:27.296154 21418 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:27.297371 21418 raft_consensus.cc:2804] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:27.297909 21418 raft_consensus.cc:697] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:27.299608 21418 consensus_queue.cc:237] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:27.301986 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:27.112156 21488 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:27.306325 21490 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:27.306986 21488 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:27.307649 21536 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:27.057175 21505 consensus_queue.cc:1175] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "96eaa6dafb3e4bbe914e54dc12507912" responder_term: 14 status { last_received { term: 11 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:27.307222 21490 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 13:20:27.310619 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.312614 21490 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:27.314275 21490 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:27.263496 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:27.353506 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.354799 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:27.354928 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:27.131652 21598 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.357004 16808 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:27.355644 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.358431 16806 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:27.358659 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:27.359040 21598 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:27.359478 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.360203 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.360406 21767 consensus_queue.cc:1059] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:27.362067 16951 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:27.362646 16848 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:27.356959 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.315008 21490 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:27.370491 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.373980 16876 raft_consensus.cc:1240] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:27.355726 21755 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.415968 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 50988.3us
I20260709 13:20:27.400945 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.130303 21589 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11.
I20260709 13:20:27.430603 16953 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:27.418646 16775 leader_election.cc:336] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.552s (SENT)
W20260709 13:20:27.446492 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.453312 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:27.460041 16954 raft_consensus.cc:1240] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:27.466482 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:27.472980 21490 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:27.474848 21787 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:27.475739 21684 consensus_queue.cc:1059] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 13:20:27.476977 21781 raft_consensus.cc:3055] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:27.477515 21781 raft_consensus.cc:740] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:27.477614 21684 raft_consensus.cc:3055] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:27.478219 21684 raft_consensus.cc:740] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:27.479959 21807 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.463701 16879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.000s	sys 0.008s
I20260709 13:20:27.480980 21807 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:27.481814 16879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.001s	sys 0.008s
I20260709 13:20:27.455098 21755 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.483819 21756 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:27.484766 21280 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:27.485494 21755 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:27.486106 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:27.486370 16959 raft_consensus.cc:1240] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:27.467216 16952 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:27.466964 21703 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:27.481010 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 217697us
I20260709 13:20:27.475425 21787 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.505026 16802 raft_consensus.cc:2468] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
W20260709 13:20:27.506407 21773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.003s	sys 0.020s
W20260709 13:20:27.506904 21773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.003s	sys 0.021s
I20260709 13:20:27.507332 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.507712 21806 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:27.508229 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 77430.7us
I20260709 13:20:27.489471 21684 consensus_queue.cc:260] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.511250 21684 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:27.507381 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 129093us
I20260709 13:20:27.516356 17523 raft_consensus.cc:1240] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:27.516937 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:27.520913 17492 leader_election.cc:336] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.975s (SENT)
I20260709 13:20:27.521543 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:27.522750 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:20:27.504892 21771 log.cc:927] Time spent T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:20:27.534682 16775 leader_election.cc:336] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.572s (SENT)
I20260709 13:20:27.535457 16775 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:27.536653 21475 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:20:27.537020 21759 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:27.537122 21669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48206 (request call id 8) took 7120 ms. Trace:
I20260709 13:20:27.538434 21718 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:27.537698 21669 rpcz_store.cc:276] 0709 13:20:20.420404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:20.445744 (+ 25340us) service_pool.cc:224] Handling call
0709 13:20:20.715725 (+269981us) log.cc:844] Serialized 492 byte log entry
0709 13:20:22.065824 (+1350099us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18000fc2a0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef0d2d01 00007feeef00f691 00007feeeefefeaa 00007feeeeff6d53 00007feeeeff6cd9 00007feeeeff6c69 00007feeeeff6c31 00007feeeeff5dfd 000000000038f354 000000000038f199
0709 13:20:27.536804 (+5470980us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2122,"raft.queue_time_us":194456,"raft.run_cpu_time_us":12023,"raft.run_wall_time_us":1183565,"spinlock_wait_cycles":37068160,"thread_start_us":352764,"threads_started":3,"wal-append.queue_time_us":178892,"wal-append.run_cpu_time_us":2978,"wal-append.run_wall_time_us":1276878}
I20260709 13:20:27.539436 16951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 592) took 1145 ms. Trace:
I20260709 13:20:27.539868 16951 rpcz_store.cc:276] 0709 13:20:26.394057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.394207 (+   150us) service_pool.cc:224] Handling call
0709 13:20:27.539217 (+1145010us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54000537d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:27.539372 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211223936}
I20260709 13:20:27.541929 17519 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44648 (request call id 781) took 1143 ms. Trace:
I20260709 13:20:27.542325 17519 rpcz_store.cc:276] 0709 13:20:26.398218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.398327 (+   109us) service_pool.cc:224] Handling call
0709 13:20:26.398581 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:27.067795 (+669214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.541423 (+473628us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54006428d4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:27.541726 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456776960}
I20260709 13:20:27.488305 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:27.543632 21798 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:27.544082 21798 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:27.545415 21798 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:27.546761 21798 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:27.547196 21806 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:27.551173 21789 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:27.551455 21774 consensus_meta.cc:287] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.809s	user 0.010s	sys 0.000s
I20260709 13:20:27.552018 21774 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:27.554320 21774 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:27.489266 21807 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:27.562151 16877 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:27.502543 21787 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:27.566445 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:27.581234 17527 raft_consensus.cc:2393] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:27.479177 21781 consensus_queue.cc:260] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.608245 21703 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:27.613014 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.582826 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 147317us
W20260709 13:20:27.620134 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 61240.4us
W20260709 13:20:27.629282 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.641773 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:27.655629 16952 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 13: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:27.656980 21785 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:27.657075 21781 raft_consensus.cc:3060] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:27.661576 21701 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:27.638005 21700 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:20:27.668049 16773 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:27.670604 16951 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:27.673311 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:27.685628 16756 auto_rebalancer.cc:629] Failed to schedule move for tablet 109354c29850459b80f792dad016fc0d: Illegal state: Replica 96eaa6dafb3e4bbe914e54dc12507912 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:27.696086 16956 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
W20260709 13:20:27.697451 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 162838us
I20260709 13:20:27.702549 16951 raft_consensus.cc:1240] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:27.707773 21703 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:27.700603 21685 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:27.711956 21520 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:27.714401 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.687916 21802 raft_consensus.cc:697] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:27.733210 21802 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:27.744133 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 88184.5us
I20260709 13:20:27.746170 16924 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:27.747524 21702 raft_consensus.cc:2804] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:27.748133 21702 raft_consensus.cc:697] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:27.748574 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 284705us
I20260709 13:20:27.749271 21702 consensus_queue.cc:237] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:27.757658 16756 auto_rebalancer.cc:629] Failed to schedule move for tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9: Illegal state: Replica ca1b60a074dc47cd8e68cc57a33a94a3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
W20260709 13:20:27.759541 17493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.756587 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:27.767021 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:27.767915 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:27.772095 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:27.780845 16775 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.876s (SENT)
I20260709 13:20:27.768967 21669 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:20:27.785377 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 117603us
I20260709 13:20:27.764679 21701 consensus_queue.cc:1059] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:20:27.784788 16952 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:27.794919 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.796082 21701 raft_consensus.cc:3055] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:27.796495 21701 raft_consensus.cc:740] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:27.783488 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:27.802424 16706 catalog_manager.cc:5697] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 10 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 11 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:27.804387 16706 catalog_manager.cc:5697] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 9 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:27.805968 16706 catalog_manager.cc:5697] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 9 to 11, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 11 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:27.809068 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.817287 16810 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:27.818382 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:27.819169 16807 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:27.820132 16773 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:27.821425 21685 raft_consensus.cc:3060] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.818413 21520 consensus_queue.cc:1059] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:20:27.824764 21520 consensus_queue.cc:1243] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer 599f9a88b6cd4e818a1c59a0b4522480 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:20:27.825234 21520 raft_consensus.cc:993] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:27.825673 21520 raft_consensus.cc:3055] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:27.826242 21598 raft_consensus.cc:1081] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:27.870056 21520 raft_consensus.cc:740] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:27.871529 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.827127 21669 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:27.834092 21668 consensus_meta.cc:287] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Time spent flushing consensus metadata: real 1.253s	user 0.011s	sys 0.007s
I20260709 13:20:27.872937 21668 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:27.874042 16804 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 13: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:27.874166 21669 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:27.875710 21668 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:27.843928 16969 tablet_copy_source_session.cc:215] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:27.876955 21598 raft_consensus.cc:493] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:27.797564 21701 consensus_queue.cc:260] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.877553 21598 raft_consensus.cc:515] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:27.878638 21701 raft_consensus.cc:3060] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:27.864014 21827 log.cc:927] Time spent T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.301s	user 0.003s	sys 0.003s
W20260709 13:20:27.866535 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 99334.7us
W20260709 13:20:27.880375 16775 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.887s (SENT)
I20260709 13:20:27.880779 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:27.882128 16775 leader_election.cc:336] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.888s (SENT)
I20260709 13:20:27.882506 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:27.867136 21806 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:27.884159 16924 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:27.807619 16706 catalog_manager.cc:5697] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:27.889542 21755 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:20:27.891072 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 111764us
I20260709 13:20:27.892220 21705 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:20:27.894104 21839 log.cc:927] Time spent T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.105s	user 0.003s	sys 0.000s
W20260709 13:20:27.895452 17492 leader_election.cc:336] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.182s (SENT)
W20260709 13:20:27.897209 17492 leader_election.cc:336] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.313s (SENT)
I20260709 13:20:27.897627 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:27.898527 21797 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:20:27.885111 21598 leader_election.cc:290] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:27.902161 21668 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:27.871975 21520 consensus_queue.cc:260] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:27.905164 21370 consensus_meta.cc:287] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.004s
W20260709 13:20:27.906248 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 45060us
I20260709 13:20:27.906167 16952 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:27.892220 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:27.907037 16775 leader_election.cc:336] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.890s (SENT)
I20260709 13:20:27.921522 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:27.937376 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 45313.6us
I20260709 13:20:27.938629 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.939391 16956 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:27.920727 21685 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:27.946168 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:27.950881 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.954073 21834 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:27.954552 21834 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.954922 21834 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:27.921064 21370 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:27.960819 21370 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:27.961197 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:27.962148 17526 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:27.961437 16706 catalog_manager.cc:5697] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 11 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:27.955003 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.969828 17525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:27.969450 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:27.972321 16957 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:27.970959 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:27.978150 16706 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 10 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:20:27.990681 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:27.991912 21763 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:20:27.993366 21716 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:27.993906 21716 raft_consensus.cc:493] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:27.994309 21716 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:27.970211 21668 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:27.996045 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:27.997190 16955 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:20:28.000319 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:28.001513 21280 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:28.001937 21280 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.002313 21280 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.004916 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:28.010468 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:28.011691 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 104663us
W20260709 13:20:28.012562 16775 leader_election.cc:336] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.900s (SENT)
I20260709 13:20:28.012989 16775 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:28.034863 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:28.036659 21520 raft_consensus.cc:3060] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:28.037004 21847 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:20:28.040143 16775 leader_election.cc:336] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.089s (SENT)
I20260709 13:20:28.040589 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:28.041853 16775 leader_election.cc:336] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.123s (SENT)
I20260709 13:20:28.044011 21668 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:28.044468 21831 log.cc:927] Time spent T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:20:28.048146 16956 raft_consensus.cc:2468] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
W20260709 13:20:28.043576 16775 leader_election.cc:336] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.187s (SENT)
I20260709 13:20:28.032968 21806 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:28.065055 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.086371 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 70569us
I20260709 13:20:28.089421 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:28.089455 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:28.091789 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2189) took 1182 ms. Trace:
I20260709 13:20:28.092175 16880 rpcz_store.cc:276] 0709 13:20:26.871440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:26.871988 (+   548us) service_pool.cc:224] Handling call
0709 13:20:26.872344 (+   356us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:20:27.224182 (+351838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:27.224247 (+    65us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:20:27.225707 (+  1460us) log.cc:844] Serialized 78 byte log entry
0709 13:20:27.371437 (+145730us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:20:27.371484 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:27.379039 (+  7555us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:28.053179 (+674140us) raft_consensus.cc:1685] finished
0709 13:20:28.053198 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:28.053350 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20042,"raft.queue_time_us":184437,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":14770,"thread_start_us":496300,"threads_started":2,"wal-append.queue_time_us":694673}
I20260709 13:20:28.094427 16882 raft_consensus.cc:1275] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:28.094908 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:28.095808 16883 raft_consensus.cc:2410] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:20:28.095896 21806 raft_consensus.cc:493] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.096590 21806 raft_consensus.cc:515] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.098321 16879 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:28.097062 16876 raft_consensus.cc:1275] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:20:28.099254 21806 leader_election.cc:290] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:28.124779 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.099804 21693 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.077680 16706 catalog_manager.cc:5697] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:28.107939 16707 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58336 (request call id 238) took 20198 ms (client timeout 15000 ms). Trace:
W20260709 13:20:28.118044 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 74510.7us
W20260709 13:20:28.126811 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.135731 16877 raft_consensus.cc:2468] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:28.071904 21475 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.158329 21475 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:28.161139 21475 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:28.140380 16878 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:28.141460 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:28.142182 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:28.142571 16879 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:28.143663 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:28.145097 21763 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:28.154214 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 68482.7us
I20260709 13:20:28.119158 21834 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:28.174700 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.176532 16876 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:28.182145 16954 raft_consensus.cc:1240] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 10. Ops: []
I20260709 13:20:28.182896 16809 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:28.183382 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.188095 16775 leader_election.cc:336] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.247s (SENT)
I20260709 13:20:28.189666 16706 catalog_manager.cc:5697] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 3 to 9, term changed from 11 to 13, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 13 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:28.137894 21787 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:28.170753 21763 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:28.203639 16804 raft_consensus.cc:1275] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:28.212590 16884 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:28.203642 21759 consensus_queue.cc:1059] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:20:28.212653 16802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:20:28.227753 16802 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:28.228156 16802 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.238160 21763 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:28.240001 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:28.242297 16876 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 16.
W20260709 13:20:28.242555 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.245138 17492 leader_election.cc:336] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.872s (SENT)
I20260709 13:20:28.222558 16706 catalog_manager.cc:5697] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 11, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 11 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:28.248464 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:28.254601 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:28.255429 16804 raft_consensus.cc:2393] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 12: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:28.256912 16809 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:28.260807 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:28.252411 21763 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:28.267280 16706 catalog_manager.cc:5697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 9, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 9 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:28.276386 16804 raft_consensus.cc:3060] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:28.280530 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "949d7afc13ea44af96dab1af3a1dd354" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:28.280318 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:28.276791 21848 log.cc:927] Time spent T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:20:28.253057 21280 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.292528 16809 raft_consensus.cc:1275] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:28.297644 21822 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:28.298306 21822 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.300521 21822 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:28.302165 21832 consensus_queue.cc:1059] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:20:28.303275 21832 raft_consensus.cc:3055] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:28.303640 21832 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:28.304545 21832 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.305751 21832 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.268049 21370 consensus_queue.cc:1059] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:20:28.291350 16706 catalog_manager.cc:5697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:28.308471 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 78137.4us
I20260709 13:20:28.309556 16804 raft_consensus.cc:2468] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 16.
I20260709 13:20:28.282155 21834 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:28.319973 21845 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:20:28.290055 21716 raft_consensus.cc:515] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:28.320843 21702 raft_consensus.cc:3055] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:28.321291 21702 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:28.321882 21716 leader_election.cc:290] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:28.323221 21755 consensus_queue.cc:1059] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:28.324484 21755 raft_consensus.cc:3055] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:28.323758 16706 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 8 to 10, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 10 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:28.324836 21755 raft_consensus.cc:740] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:28.325739 21755 consensus_queue.cc:260] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.326196 16775 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:28.326954 17522 raft_consensus.cc:2368] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13.
I20260709 13:20:28.327320 16884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2198) took 1023 ms. Trace:
I20260709 13:20:28.327000 21755 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:28.327721 16884 rpcz_store.cc:276] 0709 13:20:27.303883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:27.368649 (+ 64766us) service_pool.cc:224] Handling call
0709 13:20:27.448396 (+ 79747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:28.213074 (+764678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:28.327106 (+114032us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b5400343354. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:28.327268 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739744128}
I20260709 13:20:28.329021 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:28.331784 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 58171.7us
I20260709 13:20:28.332574 21668 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:20:28.334381 21849 log.cc:927] Time spent T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.129s	user 0.003s	sys 0.000s
I20260709 13:20:28.334815 21787 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:28.325940 16706 catalog_manager.cc:5697] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 8 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 11 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:28.337270 16802 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.342936 16801 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:28.349682 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:28.126269 16707 rpcz_store.cc:269] 0709 13:20:07.853201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:07.859758 (+  6557us) service_pool.cc:224] Handling call
0709 13:20:28.049532 (+20189774us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:21.703702 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:21.949951 (+246249us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:21.958967 (+  9016us) write_op.cc:435] Acquired schema lock
0709 13:20:21.959847 (+   880us) tablet.cc:662] Decoding operations
0709 13:20:22.047584 (+ 87737us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:22.047645 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:22.047690 (+    45us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:20:22.049871 (+  2181us) tablet.cc:701] Row locks acquired
0709 13:20:22.049900 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:20:22.050097 (+   197us) write_op.cc:270] Start()
0709 13:20:22.050233 (+   136us) write_op.cc:276] Timestamp: P: 1783603222050025 usec, L: 0
0709 13:20:22.050262 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:20:22.051133 (+   871us) log.cc:844] Serialized 10010 byte log entry
0709 13:20:22.248995 (+197862us) op_driver.cc:464] REPLICATION: finished
0709 13:20:22.633047 (+384052us) write_op.cc:301] APPLY: starting
0709 13:20:22.633161 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:24.462040 (+1828879us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:24.462166 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:25.652298 (+1190132us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:25.784644 (+132346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:20:25.784715 (+    71us) write_op.cc:312] APPLY: finished
0709 13:20:25.785450 (+   735us) log.cc:844] Serialized 220 byte log entry
0709 13:20:25.942606 (+157156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:25.959650 (+ 17044us) write_op.cc:454] Released schema lock
0709 13:20:25.966492 (+  6842us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:26.004831 (+ 38339us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:26.005262 (+   431us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":786250,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":342702,"apply.run_cpu_time_us":55633,"apply.run_wall_time_us":3394951,"cfile_cache_hit":98,"cfile_cache_hit_bytes":102410,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":407980,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":6,"lbm_reads_gt_100_ms":1,"lbm_reads_lt_1ms":4,"num_ops":25,"prepare.queue_time_us":265436,"prepare.run_cpu_time_us":8770,"prepare.run_wall_time_us":447118,"replication_time_us":198506,"thread_start_us":371490,"threads_started":3,"wal-append.queue_time_us":235969,"wal-append.run_cpu_time_us":1614,"wal-append.run_wall_time_us":1096674}]]}
W20260709 13:20:28.344424 16850 connection.cc:256] RPC call timeout handler was delayed by -2.3042673450001985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 13:20:28.358681 16850 connection.cc:256] RPC call timeout handler was delayed by -2.2421673450000981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:20:28.358994 16850 connection.cc:256] RPC call timeout handler was delayed by -1.9415673450000668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 13:20:28.359292 16850 connection.cc:256] RPC call timeout handler was delayed by -1.7750673450002523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
W20260709 13:20:28.359560 16850 connection.cc:256] RPC call timeout handler was delayed by -1.6886673450001126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260709 13:20:28.356555 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:28.339370 21280 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:28.344344 21826 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:28.365520 16802 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:28.350670 21798 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:20:28.370536 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.374676 17522 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:28.382586 21721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f7a2a0447a4956b36d1e9902e62f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:28.386564 16850 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:28.397593 21787 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.398340 21753 raft_consensus.cc:3055] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:28.398751 21753 raft_consensus.cc:740] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:28.399983 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.401322 17492 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:28.401525 21702 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:28.402237 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:28.402853 21702 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:28.403095 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:28.399607 21753 consensus_queue.cc:260] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.405330 21753 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:28.412636 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.413367 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.413777 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.413776 16951 raft_consensus.cc:1275] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:28.338515 16805 raft_consensus.cc:2955] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:28.354913 21834 consensus_queue.cc:1059] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:20:28.424356 16706 catalog_manager.cc:5697] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:28.426460 21834 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:28.426860 21834 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:28.427383 21703 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.427793 21834 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.428555 21763 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:28.429057 21763 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.429417 21716 raft_consensus.cc:2804] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:28.429486 21763 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:28.430151 21716 raft_consensus.cc:697] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:28.431845 21834 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:28.423028 21837 log.cc:927] Time spent T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:28.431071 21716 consensus_queue.cc:237] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:28.453763 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 127660us
I20260709 13:20:28.456147 17492 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:28.454299 16706 catalog_manager.cc:5697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 9 to 10, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 10 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:28.461220 16850 leader_election.cc:400] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:28.464557 16706 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:28.493800 16922 leader_election.cc:400] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13.
I20260709 13:20:28.498903 16922 leader_election.cc:403] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:28.500484 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:28.501122 16802 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.504172 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:28.463862 21280 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.468147 21843 raft_consensus.cc:2804] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:28.509402 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32f35f41a8f1466fb1831fe03e474c4d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:28.505707 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 136826us
I20260709 13:20:28.519410 16951 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:28.489984 21841 consensus_queue.cc:1048] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:20:28.495754 21822 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:20:28.513209 21370 raft_consensus.cc:3060] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.474291 21806 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:20:28.528056 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 78843.7us
I20260709 13:20:28.529824 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:28.536834 16802 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:28.544263 21842 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:28.544683 21842 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:28.545029 21842 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:28.548096 21859 log.cc:927] Time spent T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:20:28.549460 16706 catalog_manager.cc:5697] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 9 to 12, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 12 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:28.550438 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:28.554252 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 49167.3us
I20260709 13:20:28.554476 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:28.567044 21693 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.556041 21822 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.569358 16706 catalog_manager.cc:5697] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:28.568132 21822 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:28.560631 21702 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:20:28.588279 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.521157 21280 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:28.611104 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 52178.4us
W20260709 13:20:28.616887 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 62478.1us
I20260709 13:20:28.599996 21843 raft_consensus.cc:697] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:28.613348 21822 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:28.619071 21843 consensus_queue.cc:237] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:28.624253 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 94495.5us
I20260709 13:20:28.624267 16924 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:28.623324 21702 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:20:28.626170 21863 raft_consensus.cc:2804] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:28.596431 21763 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:28.626754 21863 raft_consensus.cc:697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:28.627784 21863 consensus_queue.cc:237] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:28.628573 21280 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:28.624691 21832 consensus_queue.cc:1048] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:20:28.632114 21832 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:28.632601 21822 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.633208 21822 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:28.633955 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:28.636266 21686 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.636457 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:28.637920 21787 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:28.638866 21763 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:28.635401 21822 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:28.639500 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:28.639717 21822 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:28.641959 16959 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 15.
I20260709 13:20:28.646044 21787 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:28.646494 21787 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:28.642052 16924 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:28.646867 21787 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:28.648648 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.644758 21693 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:20:28.664638 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:28.665385 16809 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:28.665910 16807 raft_consensus.cc:1275] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:28.674957 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:28.675451 16804 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:28.681447 16804 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:28.683276 17492 leader_election.cc:304] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:28.687465 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:28.688727 16808 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:28.691906 16876 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:28.659178 21702 raft_consensus.cc:2804] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:28.698137 16884 raft_consensus.cc:3055] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:28.698599 17520 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:20:28.691944 16802 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:20:28.697857 16810 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:28.695374 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:28.701917 16924 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:28.698673 16884 raft_consensus.cc:740] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:28.701146 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:28.704742 17492 leader_election.cc:336] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.726s (SENT)
I20260709 13:20:28.706847 17519 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 14 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:20:28.708729 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:28.712242 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:28.705256 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:28.708122 17518 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:28.715735 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:28.701848 21785 raft_consensus.cc:2804] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:28.669713 21834 consensus_queue.cc:1059] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:20:28.717911 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:28.719324 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:28.723438 16956 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:28.723711 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:28.716914 16884 consensus_queue.cc:260] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.726830 16806 raft_consensus.cc:2368] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:28.723318 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:28.704773 21702 raft_consensus.cc:697] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:28.720558 16924 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:28.716945 17523 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:28.705018 21832 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:28.722154 16878 raft_consensus.cc:3055] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:28.722918 16809 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:28.725931 21280 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:28.744367 16878 raft_consensus.cc:740] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:28.728030 21834 consensus_queue.cc:1243] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer 4b60b701acc7473e87e3e529a2a34689 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:28.729635 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:28.750317 16802 raft_consensus.cc:1240] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 8. Current term is 10. Ops: []
I20260709 13:20:28.752185 16884 raft_consensus.cc:3060] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.724713 21822 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:28.758980 21822 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:28.715781 21753 consensus_queue.cc:1048] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:20:28.761346 16806 raft_consensus.cc:1240] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:28.744050 21843 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:28.732590 21785 raft_consensus.cc:697] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:28.801741 16956 raft_consensus.cc:2468] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:28.793363 21822 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.762832 16878 consensus_queue.cc:260] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.810894 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:28.815073 16806 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:28.816028 16878 raft_consensus.cc:3060] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.816749 16803 raft_consensus.cc:2410] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:20:28.817963 21702 consensus_queue.cc:237] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:28.820353 21822 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:28.808619 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:28.824632 16879 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:28.831586 21873 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:28.832209 21873 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:28.760422 21693 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:28.760524 21863 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:28.840653 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.841413 16878 raft_consensus.cc:1275] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
W20260709 13:20:28.863803 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 166021us
I20260709 13:20:28.868144 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:20:28.870608 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 229670us
I20260709 13:20:28.808269 21280 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:28.873302 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:28.858265 16878 pending_rounds.cc:85] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 7
I20260709 13:20:28.888090 16878 pending_rounds.cc:107] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:20:28.888478 16878 raft_consensus.cc:2889] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:28.795658 21669 consensus_queue.cc:1048] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:20:28.898180 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:28.898787 16959 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 13: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:20:28.902748 17492 leader_election.cc:336] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.745s (SENT)
I20260709 13:20:28.906476 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:28.913326 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:28.864269 21684 consensus_queue.cc:1059] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:20:28.867125 21520 consensus_queue.cc:1048] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:20:28.924397 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:28.927323 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 55793.4us
I20260709 13:20:28.928846 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:28.931739 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:28.933679 16775 connection.cc:256] RPC call timeout handler was delayed by -1.1049676290001571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:20:28.872421 21863 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:28.945124 17492 leader_election.cc:336] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.749s (SENT)
I20260709 13:20:28.945684 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:28.951601 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:28.970572 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 137083us
I20260709 13:20:28.971916 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:28.955883 21866 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:20:28.950578 21873 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:28.953822 21887 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.971076 21475 raft_consensus.cc:493] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:29.000742 21882 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:29.001071 21475 raft_consensus.cc:515] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:29.001942 21875 log.cc:927] Time spent T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:20:29.003233 21475 leader_election.cc:290] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:28.987510 21669 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:20:29.009559 16884 raft_consensus.cc:1275] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:28.949741 21874 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.196s
W20260709 13:20:28.990360 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 49552us
I20260709 13:20:28.980859 21702 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:28.935205 21785 consensus_queue.cc:237] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:29.020032 16924 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:29.049330 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 102117us
I20260709 13:20:28.990103 21684 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:20:29.042346 21887 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:29.050064 21834 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:20:29.055238 21885 consensus_queue.cc:1059] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:20:28.978127 21842 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:29.064179 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.055982 21872 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:20:28.977579 21280 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:29.060858 21831 log.cc:927] Time spent T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:29.057483 21702 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:29.065209 21705 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:29.081832 16850 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:29.089320 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:29.121409 21842 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:29.129317 21863 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:29.130693 21818 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:29.131095 21818 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:29.131937 21818 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:29.132519 21892 log.cc:927] Time spent T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:29.133425 21818 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.134065 21721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44648 (request call id 761) took 4693 ms. Trace:
I20260709 13:20:29.140062 21887 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:29.140568 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.142609 21370 consensus_meta.cc:287] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.002s
I20260709 13:20:29.143143 21370 raft_consensus.cc:2749] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13.
I20260709 13:20:29.144167 21702 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:29.163805 21753 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:29.167395 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 77024.6us
W20260709 13:20:29.166219 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 103713us
I20260709 13:20:29.163628 21834 consensus_queue.cc:1048] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:20:29.169591 21753 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.177577 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:29.178244 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:29.184521 16801 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:29.178503 17492 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:29.192293 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:29.134601 21721 rpcz_store.cc:276] 0709 13:20:24.448999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:24.492285 (+ 43286us) service_pool.cc:224] Handling call
0709 13:20:25.006331 (+514046us) ts_tablet_manager.cc:934] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
0709 13:20:26.189197 (+1182866us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeebf8c0ac 00007feef4de6ab9 00007feeebfa869b 00007feeebfa5caa 00007feeebfa5bd2 00007feef400a131
0709 13:20:28.380979 (+2191782us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:20:28.729998 (+349019us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:28.730122 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:20:29.065096 (+334974us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:20:29.133222 (+ 68126us) tablet_replica.cc:206] Creating consensus instance
0709 13:20:29.133677 (+   455us) ts_tablet_manager.cc:989] Replica registered.
0709 13:20:29.133929 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":23056,"spinlock_wait_cycles":4898176,"tablet-copy.queue_time_us":367392,"thread_start_us":1532866,"threads_started":2}
I20260709 13:20:29.192227 21785 raft_consensus.cc:2804] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:29.194478 21908 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:29.176767 21832 consensus_queue.cc:1048] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:20:29.195094 21908 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:29.190893 21753 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:29.200073 16954 raft_consensus.cc:2468] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:29.199783 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:29.212584 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 142248us
W20260709 13:20:29.210502 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 163610us
W20260709 13:20:29.234392 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 155006us
I20260709 13:20:29.233325 16848 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:29.215629 21785 raft_consensus.cc:697] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:20:29.208376 21787 consensus_meta.cc:287] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 13:20:29.210208 21874 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:29.248386 16806 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:20:29.205504 21889 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:29.202291 21908 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:29.237656 21759 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:29.243479 21888 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:29.211140 21798 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:29.259739 17492 leader_election.cc:336] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.918s (SENT)
I20260709 13:20:29.211117 21891 raft_consensus.cc:3055] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:29.210812 21885 consensus_queue.cc:1059] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:20:29.264027 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:29.267889 21917 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:29.269088 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:29.269385 16956 raft_consensus.cc:3055] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:29.269863 17523 raft_consensus.cc:2393] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:29.269706 16956 raft_consensus.cc:740] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:29.271811 21899 log.cc:927] Time spent T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.097s	user 0.000s	sys 0.003s
I20260709 13:20:29.270979 16956 consensus_queue.cc:260] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:29.269711 21917 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:20:29.249711 21874 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:29.262005 21759 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.250715 21721 tablet_copy_client.cc:806] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:29.285193 21891 raft_consensus.cc:740] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:29.248955 21787 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:29.328909 21884 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:29.297730 21798 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:29.294003 21705 raft_consensus.cc:697] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:29.366343 21520 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.297349 21785 consensus_queue.cc:237] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:29.262881 16848 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:29.320384 21900 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:29.386193 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:29.410722 16951 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:29.410598 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 152920us
W20260709 13:20:29.408368 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 145518us
I20260709 13:20:29.387876 21721 tablet_copy_client.cc:670] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
W20260709 13:20:29.401144 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 166120us
I20260709 13:20:29.408960 16952 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:29.387192 21759 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.401857 21884 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:29.421489 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 53797us
I20260709 13:20:29.427100 16775 leader_election.cc:304] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:29.429193 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.429989 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:29.416152 21900 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:29.430440 21753 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:29.432420 21900 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:29.414873 21893 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:29.433151 21893 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:29.433491 21893 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.410221 21520 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:29.437110 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:29.437561 21520 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:29.438241 21705 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:29.438685 16850 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:29.439985 21874 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:29.445809 16879 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:29.451107 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:29.452894 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.453696 21668 raft_consensus.cc:2749] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.458302 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:29.467236 16951 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 14.
I20260709 13:20:29.442991 21884 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.458184 21885 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:29.545300 16810 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:20:29.547320 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 60579.4us
W20260709 13:20:29.548274 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 75420us
W20260709 13:20:29.545406 17492 leader_election.cc:336] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.740s (SENT)
I20260709 13:20:29.550791 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:29.475706 21874 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:29.558158 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:29.551627 16805 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 16.
I20260709 13:20:29.560180 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:29.561019 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 103045us
I20260709 13:20:29.563486 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.565753 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.568835 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17115e8a13c346f1998df3bc8f52ec52" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:29.568979 16878 raft_consensus.cc:1275] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:29.413827 21891 consensus_queue.cc:260] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:29.566936 21886 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:20:29.571986 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.488878 21873 consensus_queue.cc:1059] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:20:29.570176 21822 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:29.568020 21475 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.624303 16881 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 16.
W20260709 13:20:29.650786 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 85029.2us
I20260709 13:20:29.578405 21900 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.656070 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.657274 16878 raft_consensus.cc:2410] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:20:29.598001 21785 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:29.661712 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 116361us
W20260709 13:20:29.662631 17492 leader_election.cc:336] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.751s (SENT)
I20260709 13:20:29.600966 21693 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:29.671783 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.672621 16878 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:20:29.665144 21818 consensus_meta.cc:287] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.002s
I20260709 13:20:29.673506 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:29.677104 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 99968.8us
W20260709 13:20:29.678978 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 116369us
I20260709 13:20:29.670605 21822 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:29.705319 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.710873 16878 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:29.669696 21787 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:29.705353 16881 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:20:29.706898 16954 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48222 (request call id 610) took 1203 ms. Trace:
I20260709 13:20:29.719797 16954 rpcz_store.cc:276] 0709 13:20:28.503750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.504336 (+   586us) service_pool.cc:224] Handling call
0709 13:20:29.706681 (+1202345us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54002ebb54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:29.706825 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1486725888}
I20260709 13:20:29.717952 16775 leader_election.cc:304] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:29.724393 16775 leader_election.cc:336] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.562s (SENT)
I20260709 13:20:29.688176 21475 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:29.725970 17492 leader_election.cc:336] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.978s (SENT)
I20260709 13:20:29.709458 21753 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:29.732658 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.732787 16775 leader_election.cc:336] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.565s (SENT)
I20260709 13:20:29.733232 16775 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:29.734364 21901 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:20:29.735400 21922 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:20:29.731460 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:29.737311 17492 leader_election.cc:336] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.989s (SENT)
I20260709 13:20:29.738395 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:29.759516 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 70647.8us
W20260709 13:20:29.739617 21912 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:20:29.739444 21759 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:29.740437 21925 log.cc:927] Time spent T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:20:29.741662 16956 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:29.742154 21888 raft_consensus.cc:3055] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:20:29.742974 21920 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:20:29.745594 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.751848 21798 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:29.725292 21921 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.754262 21898 raft_consensus.cc:3055] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:29.743597 21822 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:29.758379 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.673933 21693 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:29.738976 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.759974 16881 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:29.761706 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:29.763856 16775 leader_election.cc:336] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.595s (SENT)
I20260709 13:20:29.773142 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:29.765583 16885 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:29.729216 21916 raft_consensus.cc:2749] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:29.772619 16878 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:29.777488 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.762897 21888 raft_consensus.cc:740] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:29.781803 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea18b0f585149f0a5558b066b194a9d" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.765384 21938 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:20:29.759469 21475 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:29.802577 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.824231 16881 raft_consensus.cc:3060] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:29.814560 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:29.801834 16775 leader_election.cc:336] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.660s (SENT)
I20260709 13:20:29.812446 16810 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:20:29.799983 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 62719.7us
I20260709 13:20:29.811431 16806 raft_consensus.cc:1240] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:29.807690 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:29.826882 16954 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 16.
I20260709 13:20:29.830529 16956 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:29.768447 21898 raft_consensus.cc:740] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:29.832216 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.833019 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.837119 16884 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 15.
I20260709 13:20:29.776288 21686 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.781144 21940 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:29.834031 16775 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:29.835661 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.783912 21916 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.808858 21759 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:29.840198 16878 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:29.840842 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.841521 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.866864 16882 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:29.867020 16879 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:29.842700 16954 raft_consensus.cc:1275] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:20:29.772647 21921 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:29.849491 21475 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:29.813442 21888 consensus_queue.cc:260] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:29.804978 21693 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:29.851918 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.840674 21940 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:29.863126 17492 leader_election.cc:336] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 2.003s (SENT)
W20260709 13:20:29.838024 21598 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:20:29.877351 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:29.805886 21520 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:20:29.871754 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.872463 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.881197 16882 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 15.
I20260709 13:20:29.881457 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.882125 16879 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:29.876133 16884 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:29.871300 21686 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.880476 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.883062 16878 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:29.867990 21903 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.882337 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.885612 16882 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:29.885959 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.886513 16884 raft_consensus.cc:2368] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 14. Current term is 15.
I20260709 13:20:29.780637 21893 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:29.880095 21927 log.cc:927] Time spent T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.154s	user 0.001s	sys 0.002s
W20260709 13:20:29.889554 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 87760.1us
W20260709 13:20:29.890331 16775 leader_election.cc:336] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.727s (SENT)
I20260709 13:20:29.892562 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.898394 16881 raft_consensus.cc:2468] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 14.
I20260709 13:20:29.899293 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.899873 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.900861 16885 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:29.884475 21888 raft_consensus.cc:3060] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:29.903429 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.905836 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.880553 21940 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:29.870321 21916 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:29.914209 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.926043 16878 raft_consensus.cc:2393] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
W20260709 13:20:29.914798 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:29.915616 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.927083 16881 raft_consensus.cc:2468] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:29.916353 16879 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:29.900190 16775 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:29.928500 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.929164 16880 raft_consensus.cc:2368] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 14. Current term is 15.
I20260709 13:20:29.931474 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.893949 21941 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:29.932521 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.933465 16882 raft_consensus.cc:2393] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 13: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:20:29.934760 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 71673.4us
I20260709 13:20:29.935779 16881 raft_consensus.cc:2376] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 14. Re-sending same reply.
I20260709 13:20:29.938333 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.901561 21842 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:29.940672 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.941485 16884 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:29.942682 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.943063 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.943956 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.945819 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.947288 16881 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:29.947943 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.888324 21903 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:29.950911 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.949470 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.953159 16879 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
W20260709 13:20:29.950345 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 146788us
I20260709 13:20:29.946631 21686 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:29.954242 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.946787 21941 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:29.966432 21921 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:29.958638 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.968178 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:29.969478 21941 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:29.963562 16881 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:29.974941 16881 raft_consensus.cc:1240] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 8. Current term is 9. Ops: []
I20260709 13:20:29.974951 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.976214 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.979040 16954 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:29.980397 16881 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:29.988149 21832 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:29.988687 21832 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:29.989660 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:29.990593 21832 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:29.992352 21916 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:29.999068 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:30.001534 21884 consensus_meta.cc:287] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Time spent flushing consensus metadata: real 0.509s	user 0.000s	sys 0.010s
I20260709 13:20:29.887029 21898 consensus_queue.cc:260] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.001955 21884 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:30.002898 21898 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:20:30.003937 16877 raft_consensus.cc:2368] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15.
W20260709 13:20:30.004839 21943 log.cc:927] Time spent T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:20:30.006474 21884 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:30.010797 16882 raft_consensus.cc:2368] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10.
I20260709 13:20:30.012892 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:30.013767 21944 log.cc:927] Time spent T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:20:30.014029 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.015205 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.015904 16881 raft_consensus.cc:2393] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:30.016618 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.017604 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:30.018126 16881 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:20:30.020900 21918 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.744s	user 0.004s	sys 0.000s
I20260709 13:20:30.014029 16879 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:30.023773 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:30.024772 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.025470 16879 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:30.025395 16881 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 13.
I20260709 13:20:30.027112 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.017609 21891 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:30.028347 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 138032us
I20260709 13:20:30.029836 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.028600 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:30.030730 16881 raft_consensus.cc:2376] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12. Re-sending same reply.
I20260709 13:20:30.031028 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51b55458c5a45c78b6a978ce6a10d31" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:30.031880 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e604fa8c1b148ea9842f341b4a2c000" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:30.035264 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:30.035842 16959 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:30.036072 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:30.028017 21669 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.040159 16881 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:30.040592 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:30.041162 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.041203 16954 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:30.041921 16881 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:30.046566 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:30.038055 21841 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:30.052330 16878 raft_consensus.cc:1240] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:30.048998 21832 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.056159 16884 raft_consensus.cc:2368] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 11. Current term is 12.
I20260709 13:20:30.052137 21475 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:30.052197 21893 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:30.063467 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.048017 21669 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:30.054375 21908 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:20:30.061585 21475 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.054375 21841 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:30.070523 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.071751 16881 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:30.072038 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:30.073423 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:30.074194 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:30.074580 21919 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:30.075081 21919 raft_consensus.cc:697] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:30.075412 21904 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:30.075863 21916 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:30.076339 21916 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:30.076012 21919 consensus_queue.cc:237] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.075841 21904 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.076795 21916 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:30.076987 21904 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:30.081182 21705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.020s	sys 0.026s
W20260709 13:20:30.081566 21705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.020s	sys 0.026s
I20260709 13:20:30.057893 21832 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.086053 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:30.086688 16956 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 15.
I20260709 13:20:30.081176 21841 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:30.090137 21669 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:30.070209 21475 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:30.098131 17492 leader_election.cc:336] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 1.610s (SENT)
I20260709 13:20:30.098596 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:30.100091 21832 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:30.100534 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:30.101104 17520 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.105510 17523 raft_consensus.cc:1240] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:20:30.109282 21280 consensus_queue.cc:1048] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:30.110172 21940 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.101025 21797 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:30.114336 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.117542 17492 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:30.129047 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.130671 17520 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 15.
I20260709 13:20:30.133262 16878 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:30.146513 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.147152 16878 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:30.147622 16880 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:30.147423 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:30.149848 16884 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.146667 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:30.164949 21940 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:30.167109 21804 raft_consensus.cc:2804] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:30.167748 21804 raft_consensus.cc:697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:30.169062 21903 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:30.168619 21804 consensus_queue.cc:237] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:30.172276 21842 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:30.179600 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:30.180411 17523 raft_consensus.cc:3060] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.186743 16884 raft_consensus.cc:2468] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
W20260709 13:20:30.189304 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.189690 17520 raft_consensus.cc:1275] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:30.172638 21721 tablet_copy_client.cc:538] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:30.194698 16883 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:30.151762 21280 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.196660 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:30.199391 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.197875 16883 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:30.198436 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.202652 16878 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 10: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:30.146950 21868 consensus_queue.cc:1048] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:20:30.148501 21797 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:20:30.176496 21842 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:30.205029 16883 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.213455 16883 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.214800 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:30.174472 21869 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:20:30.218971 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:30.219054 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:30.223246 16924 leader_election.cc:400] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15.
I20260709 13:20:30.223703 16924 leader_election.cc:403] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:30.224038 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.224701 16880 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:30.225128 16924 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:30.225533 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:30.226169 16880 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:30.226356 16692 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 599f9a88b6cd4e818a1c59a0b4522480 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:30.211380 21919 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:30.230816 21934 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.234323 21475 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.236013 21753 raft_consensus.cc:2804] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:30.236644 21753 raft_consensus.cc:697] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:30.237624 21753 consensus_queue.cc:237] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:30.263499 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.268755 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:30.216725 21842 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.280715 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:30.282429 16880 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 17.
I20260709 13:20:30.230090 21818 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:20:30.269207 21952 log.cc:927] Time spent T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:30.228024 21919 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:30.287045 17523 raft_consensus.cc:2410] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 14 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:20:30.207050 21280 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.287606 16876 raft_consensus.cc:2410] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:20:30.284392 16924 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:30.287292 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:30.371820 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 87518.5us
W20260709 13:20:30.365368 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.366055 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:30.373445 17521 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:30.366564 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.250332 21888 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:30.282332 21863 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:30.367166 16848 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
W20260709 13:20:30.374270 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.374747 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.379505 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:30.381145 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:30.381769 21919 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:30.379969 16922 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:30.404137 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:30.410763 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.412129 16954 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:30.414067 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:30.414904 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:30.415664 16950 raft_consensus.cc:2410] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:20:30.389243 16959 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:30.288511 21916 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.417462 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:30.385702 21863 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:20:30.408432 21936 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:20:30.390857 21891 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:30.367522 21904 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.420977 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:30.414649 16885 raft_consensus.cc:2376] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12. Re-sending same reply.
I20260709 13:20:30.385954 21941 raft_consensus.cc:2804] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:30.433101 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:30.434705 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:30.439567 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.419708 21475 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:30.425288 21863 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.436395 21891 raft_consensus.cc:697] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:30.427569 21940 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:30.458258 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:30.459854 21941 raft_consensus.cc:697] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:30.386140 21942 consensus_queue.cc:1048] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:20:30.462682 21721 tablet_bootstrap.cc:492] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:20:30.464512 16951 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:30.387262 21888 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:30.465626 17521 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 15.
I20260709 13:20:30.468396 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:30.469293 16952 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
I20260709 13:20:30.479454 16959 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:30.473660 16883 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
W20260709 13:20:30.481657 16775 leader_election.cc:336] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Timed out: RequestConsensusVote RPC to 127.15.90.2:33931 timed out after 3.241s (SENT)
I20260709 13:20:30.480010 16803 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2211) took 1397 ms. Trace:
I20260709 13:20:30.480026 16883 pending_rounds.cc:85] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 7
I20260709 13:20:30.489940 16959 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 17.
I20260709 13:20:30.475837 21893 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.488139 16883 pending_rounds.cc:107] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:20:30.482610 16803 rpcz_store.cc:276] 0709 13:20:29.072317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.072438 (+   121us) service_pool.cc:224] Handling call
0709 13:20:29.080980 (+  8542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:29.496555 (+415575us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:20:29.560059 (+ 63504us) log.cc:844] Serialized 14 byte log entry
0709 13:20:30.213274 (+653215us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b18003490c0. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef4e71de1 00007feef4e7e5b1 00007feeeec3e4bc 00007feeebf8c48b 00007feef4de6ab9 00007feeebfa869b 00007feeebfa693f 00007feeebfa8c02 00007feeeec3020b 00007feeeec35d23 00007feeeec3623a
0709 13:20:30.217808 (+  4534us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:30.248982 (+ 31174us) log.cc:844] Serialized 26 byte log entry
0709 13:20:30.249250 (+   268us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:30.249300 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:30.249388 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:30.463867 (+214479us) raft_consensus.cc:1685] finished
0709 13:20:30.470005 (+  6138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:30.470156 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160165,"prepare.queue_time_us":15759,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":13533,"raft.queue_time_us":327300,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":26944,"spinlock_wait_cycles":8678272,"thread_start_us":284508,"threads_started":2,"wal-append.queue_time_us":131669}
I20260709 13:20:30.498663 16883 raft_consensus.cc:2889] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:30.508805 16775 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:30.493165 21953 log.cc:927] Time spent T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:20:30.511735 21893 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:30.532207 16775 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:30.539390 16775 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:30.540373 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 263315us
I20260709 13:20:30.516180 21798 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:20:30.524091 21965 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:30.545799 16950 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:30.540668 21921 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:30.542979 21280 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:30.535964 21941 consensus_queue.cc:237] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:30.560698 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.551959 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:30.565521 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:30.565989 16804 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:30.568770 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:30.549278 21926 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.581316 21863 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.582065 16804 raft_consensus.cc:2468] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:30.540406 21842 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:30.588378 21842 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:30.536185 21891 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:30.583493 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 59273.5us
I20260709 13:20:30.593339 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:30.594134 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:30.597378 16876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44078 (request call id 2230) took 1180 ms. Trace:
I20260709 13:20:30.597888 16876 rpcz_store.cc:276] 0709 13:20:29.417439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:29.419792 (+  2353us) service_pool.cc:224] Handling call
0709 13:20:30.597084 (+1177292us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54003f3c54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef09a2fa 00007feef405bb17 00007feeed5d66d4 00007feeed5d6662 00007feeed5d6591 00007feeed5d650c 00007feeed5d57c2 00007feeed3d148c 00007feeed3d08c6 00007feeed3d026f
0709 13:20:30.597271 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972210944}
I20260709 13:20:30.599412 21904 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:30.603195 21934 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15.
I20260709 13:20:30.604912 21888 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:30.605491 21971 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:30.607053 21955 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
W20260709 13:20:30.586555 21964 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:30.562443 21916 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:30.618422 21893 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:30.612594 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:30.623350 16954 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 15.
I20260709 13:20:30.625352 16956 raft_consensus.cc:2368] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 14. Current term is 15.
I20260709 13:20:30.627487 16884 pending_rounds.cc:85] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 4
I20260709 13:20:30.627802 16884 pending_rounds.cc:107] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 8.5
W20260709 13:20:30.621068 21953 log.cc:927] Time spent T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:30.623353 21842 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:30.628522 21842 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:30.628053 16884 raft_consensus.cc:2889] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:30.630824 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:30.613489 21785 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:20:30.645851 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.628902 21842 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:30.651345 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:30.656157 16879 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:30.655375 16804 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:20:30.658371 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.659439 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 63812.4us
I20260709 13:20:30.662487 21969 consensus_queue.cc:1059] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:30.642483 21916 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:30.663846 21797 raft_consensus.cc:3055] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:20:30.664238 21797 raft_consensus.cc:740] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:30.665117 21797 consensus_queue.cc:260] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:30.666127 21974 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:20:30.666455 21797 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:30.651147 21884 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:30.668116 21884 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:30.670861 21884 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:30.680795 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:30.682073 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:30.640960 21965 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:30.691318 16805 raft_consensus.cc:1275] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:20:30.699301 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 68553.1us
I20260709 13:20:30.700070 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:30.701710 16850 connection.cc:256] RPC call timeout handler was delayed by -1.7607154330000867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:20:30.702507 16850 connection.cc:256] RPC call timeout handler was delayed by -1.6869154329999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
I20260709 13:20:30.652199 21934 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:20:30.704046 16850 connection.cc:256] RPC call timeout handler was delayed by -1.6401154330001191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 13:20:30.704694 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:30.707038 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:20:30.707564 16850 connection.cc:256] RPC call timeout handler was delayed by -1.6311154330001045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 13:20:30.707860 16809 raft_consensus.cc:3060] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:30.708124 16850 connection.cc:256] RPC call timeout handler was delayed by -1.6095154330000696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 13:20:30.708653 16850 connection.cc:256] RPC call timeout handler was delayed by -1.5798154330000216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 13:20:30.783803 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:30.787451 16850 connection.cc:256] RPC call timeout handler was delayed by -1.5348154329999488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 13:20:30.788019 16850 connection.cc:256] RPC call timeout handler was delayed by -1.5159154329999183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 13:20:30.788439 16850 connection.cc:256] RPC call timeout handler was delayed by -1.46911543300007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:20:30.788837 16850 connection.cc:256] RPC call timeout handler was delayed by -1.4484154330000365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 13:20:30.789176 16850 connection.cc:256] RPC call timeout handler was delayed by -1.3872154329999375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 13:20:30.789505 16850 connection.cc:256] RPC call timeout handler was delayed by -1.3467154330000994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
I20260709 13:20:30.770848 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:30.768658 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:30.729669 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:30.736033 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:30.741043 16775 leader_election.cc:304] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:30.763748 16848 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
W20260709 13:20:30.794629 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 91889us
I20260709 13:20:30.798628 21475 raft_consensus.cc:2749] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:30.798991 21753 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:30.799430 21753 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:30.730630 21941 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
W20260709 13:20:30.790248 16850 connection.cc:256] RPC call timeout handler was delayed by -1.3107154330000412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 13:20:30.811098 16850 connection.cc:256] RPC call timeout handler was delayed by -1.2711154329999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 13:20:30.812223 16850 connection.cc:256] RPC call timeout handler was delayed by -1.2135154330001114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
I20260709 13:20:30.785917 21926 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:30.820634 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 56993.6us
I20260709 13:20:30.821395 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:30.824386 16809 raft_consensus.cc:2468] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 17.
W20260709 13:20:30.812148 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 71158.8us
I20260709 13:20:30.838743 16775 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:30.840720 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:30.845821 16953 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 15.
I20260709 13:20:30.810714 21753 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:30.699560 21785 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 13:20:30.709371 21965 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:30.851328 16850 leader_election.cc:304] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:30.852602 21923 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:30.819489 21941 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:30.833261 21980 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:30.858161 16880 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:20:30.861737 16807 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:30.863082 16924 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:30.811244 21841 consensus_queue.cc:1048] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 13:20:30.902952 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.883603 21888 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:30.909533 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.912485 16924 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:30.858531 21979 raft_consensus.cc:2749] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:30.865334 21832 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:30.886204 21798 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:30.913746 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:30.894106 21965 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.921586 21934 raft_consensus.cc:2804] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:30.921518 21888 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:30.926705 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.935468 21934 raft_consensus.cc:697] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:30.936532 21934 consensus_queue.cc:237] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:30.938107 21916 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:30.939893 16804 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:30.927027 21842 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:30.929553 21939 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:30.944255 21941 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:30.946030 21842 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:30.931219 21863 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:30.931378 16924 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:30.935424 21888 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:30.947947 21874 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:20:31.044723 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:30.931888 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:31.045619 16924 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.048815 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:31.082952 17519 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:20:31.050966 21785 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:31.051307 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:31.085418 16953 raft_consensus.cc:606] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.085884 16953 raft_consensus.cc:614] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:31.045084 21863 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:31.056905 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 143062us
I20260709 13:20:30.914502 21980 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:20:31.094826 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 179067us
I20260709 13:20:31.071285 21842 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.119174 16850 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:31.123171 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.121106 21797 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:31.122551 21988 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:31.096233 21785 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:31.135550 21874 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:20:31.136834 21684 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:31.122865 21842 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:31.136188 21991 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:31.152952 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:31.160552 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.183372 21785 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:31.185352 21753 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:31.186731 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:31.187280 16953 raft_consensus.cc:606] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:31.198586 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:31.199199 16953 raft_consensus.cc:606] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:31.202698 16956 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:20:31.204124 21984 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:20:31.205332 21985 log.cc:927] Time spent T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.379s	user 0.004s	sys 0.000s
W20260709 13:20:31.206070 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 349255us
I20260709 13:20:31.206773 16951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:31.207342 16951 raft_consensus.cc:606] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.162603 21979 raft_consensus.cc:2764] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:31.212769 21921 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:20:31.164335 21991 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:31.218431 21991 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:31.145056 21988 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:31.220443 21988 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:31.224272 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.224211 21916 consensus_queue.cc:1059] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:31.225553 21798 raft_consensus.cc:3055] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:20:31.225874 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 46912.2us
I20260709 13:20:31.226238 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:31.226599 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.226835 16773 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:31.227770 16850 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.228902 16850 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.229779 21965 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:31.230067 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.230218 21965 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:31.230312 21874 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:20:31.230602 21965 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:31.231860 21686 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:31.232442 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.234474 17523 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:31.235126 21989 log.cc:927] Time spent T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:31.235396 21926 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:31.235780 21926 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.236133 21926 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.237725 21842 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:31.240096 16775 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:31.240378 21993 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:20:31.242283 21971 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:31.163902 21980 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:31.244429 21842 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:31.244659 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:31.244964 21842 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:31.246969 21842 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:31.248251 16957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:31.248797 16957 raft_consensus.cc:606] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.225916 21798 raft_consensus.cc:740] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:31.251921 21798 consensus_queue.cc:260] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:31.253186 21798 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.255046 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:31.243927 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:31.256723 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:31.257407 16804 raft_consensus.cc:1217] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:20:31.257536 21891 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:31.257942 16804 raft_consensus.cc:1240] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:20:31.258255 21979 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:31.258951 21979 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:31.259276 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:31.258961 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:31.262365 16803 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:31.262846 16807 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 12: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
W20260709 13:20:31.263990 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 218436us
I20260709 13:20:31.265462 16805 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:31.275492 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.268327 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:31.278575 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.280087 16803 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:31.281442 21895 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:31.281857 21895 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.282186 21895 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:31.283064 16805 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:31.285274 21965 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:31.287353 21965 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:31.300181 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.291142 21797 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:31.292280 21753 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:31.294236 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:31.306957 16880 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.307034 21797 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:31.297056 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.298614 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:31.313463 16884 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:31.304688 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.304827 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.322417 17523 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:20:31.328895 16773 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:31.331447 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:31.333777 21919 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:31.334440 21919 raft_consensus.cc:697] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:31.324376 16805 raft_consensus.cc:1275] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:20:31.343278 16851 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.348155 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.350261 16809 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:31.364288 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
W20260709 13:20:31.364948 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 225411us
W20260709 13:20:31.384203 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 154219us
I20260709 13:20:31.385025 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.392077 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.396512 17521 raft_consensus.cc:1275] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:20:31.396816 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:31.275686 21686 consensus_queue.cc:1059] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:20:31.405468 16775 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:31.335570 21919 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:31.396947 17521 pending_rounds.cc:85] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 11
I20260709 13:20:31.409960 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.410552 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:31.326874 16880 raft_consensus.cc:2468] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:31.410140 17521 pending_rounds.cc:107] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:20:31.413492 17521 raft_consensus.cc:2889] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:31.417168 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:31.417846 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.418095 16959 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:31.413786 21939 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:31.410246 21936 log.cc:927] Time spent T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:20:31.407263 21888 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:31.422947 16951 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:31.424913 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.410022 21475 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:31.419030 21939 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:31.425439 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:31.412629 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:31.431237 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:31.432405 16958 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.425439 21841 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:20:31.438571 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.442107 21763 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:31.447752 21685 raft_consensus.cc:3055] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:31.448164 21685 raft_consensus.cc:740] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:31.448959 21685 consensus_queue.cc:260] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:31.449730 21911 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:31.450098 21685 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.451998 21926 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:31.454010 21926 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:31.459298 16807 raft_consensus.cc:1240] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:20:31.466070 17523 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:31.467703 16958 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:31.471751 16956 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:31.473134 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:31.507311 16809 raft_consensus.cc:2468] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
W20260709 13:20:31.509835 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.432595 16801 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.474331 21888 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:31.467347 21475 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:31.478293 21891 raft_consensus.cc:493] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:31.480062 21939 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:31.481405 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 66236us
I20260709 13:20:31.527558 16775 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:31.529817 16850 leader_election.cc:400] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:31.530236 16850 leader_election.cc:403] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:20:31.502611 21942 consensus_queue.cc:1048] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:20:31.552341 16848 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.534140 21874 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:31.529527 21891 raft_consensus.cc:515] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:31.579236 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 53367.4us
I20260709 13:20:31.542089 21965 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:31.584585 16850 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.534804 21798 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:20:31.543064 21926 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:20:31.589429 21893 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.591023 21965 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:31.608644 21874 raft_consensus.cc:493] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:31.629370 21967 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.061s	sys 0.086s
W20260709 13:20:31.634588 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 206061us
I20260709 13:20:31.646193 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.647221 21888 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:31.647789 16850 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.648716 21888 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:20:31.650218 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:31.651113 21888 raft_consensus.cc:2764] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:20:31.583858 21475 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:31.643018 21967 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.061s	sys 0.087s
I20260709 13:20:31.670552 16850 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.673003 16850 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.675472 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:31.676568 16850 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:31.677946 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:31.678527 16880 raft_consensus.cc:2376] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12. Re-sending same reply.
I20260709 13:20:31.680470 16880 raft_consensus.cc:1275] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:31.670406 21971 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:31.642555 21874 raft_consensus.cc:515] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:31.671882 21893 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.687060 21980 raft_consensus.cc:2804] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:31.698519 21891 leader_election.cc:290] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:31.698858 16924 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.703033 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:31.705238 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:31.705781 16876 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:31.706828 16882 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 15: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:31.668112 21942 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:20:31.722147 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.682507 21979 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:31.732210 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:31.724077 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:31.725075 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:31.734545 16880 raft_consensus.cc:1275] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:20:31.734942 16880 pending_rounds.cc:85] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 10
I20260709 13:20:31.735212 16880 pending_rounds.cc:107] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:20:31.735495 16880 raft_consensus.cc:2889] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:31.687222 21888 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:31.741132 16876 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:31.689020 21971 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:31.747262 16881 raft_consensus.cc:2393] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 15: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:31.744590 16884 raft_consensus.cc:1275] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:31.754087 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:31.754381 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:31.754813 16884 raft_consensus.cc:2393] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:31.754931 16880 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
W20260709 13:20:31.743269 22001 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:20:31.724380 21997 raft_consensus.cc:2804] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:31.759866 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:31.761030 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:31.761289 16879 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 5.
I20260709 13:20:31.761593 16877 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:31.762380 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:31.762861 16883 raft_consensus.cc:3060] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.766805 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:31.768533 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:31.768790 16924 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.768986 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:31.769102 16880 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:31.774240 16877 raft_consensus.cc:3060] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.751844 21979 raft_consensus.cc:697] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:20:31.771651 22002 log.cc:927] Time spent T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:20:31.783646 16801 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 15.
I20260709 13:20:31.784494 16883 raft_consensus.cc:2468] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:31.792577 21980 raft_consensus.cc:697] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:31.771226 21988 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:31.797627 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:31.802057 16880 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 17.
I20260709 13:20:31.804323 16881 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:20:31.737181 21965 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:31.831904 16883 raft_consensus.cc:2393] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 12: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
W20260709 13:20:31.808794 22014 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:20:31.814491 21895 consensus_meta.cc:287] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.003s
I20260709 13:20:31.815207 21280 consensus_queue.cc:1048] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:31.815274 21979 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:31.816461 21753 consensus_queue.cc:1059] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:31.817070 21832 raft_consensus.cc:993] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
W20260709 13:20:31.797326 22004 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:20:31.798143 22008 log.cc:927] Time spent T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:20:31.822153 21874 leader_election.cc:290] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:31.787132 21997 raft_consensus.cc:697] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:31.785717 21971 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:31.787307 21934 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:31.824689 22010 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:20:31.837495 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:31.837774 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.839524 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:31.840458 16959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:31.877617 16876 raft_consensus.cc:2393] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 9: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:31.840907 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.878320 16807 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:31.841102 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:31.879921 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 66536.6us
I20260709 13:20:31.843909 16803 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:31.846661 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:31.853387 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "778275eedaec440eb9d6de3b4984d656" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:31.854310 16880 raft_consensus.cc:1240] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:20:31.858017 16877 raft_consensus.cc:1275] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:20:31.869783 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:31.871706 16958 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:31.876751 21832 raft_consensus.cc:3055] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:31.886235 16883 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:31.886399 21832 raft_consensus.cc:740] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:31.872551 16951 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:31.887194 21832 consensus_queue.cc:260] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:31.888166 21832 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.872442 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:31.874361 21869 consensus_queue.cc:1048] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:31.891847 16877 pending_rounds.cc:85] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 9
W20260709 13:20:31.891886 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 54179.7us
I20260709 13:20:31.892287 16877 pending_rounds.cc:107] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:20:31.892654 16877 raft_consensus.cc:2889] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:31.894120 16775 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.894164 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.895448 16883 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:31.895623 16809 raft_consensus.cc:2393] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 15: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:31.884038 21882 consensus_queue.cc:1048] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 13:20:31.896102 22006 log.cc:927] Time spent T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.242s	user 0.001s	sys 0.002s
I20260709 13:20:31.901074 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.833832 21988 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:31.876941 21370 raft_consensus.cc:1081] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:31.917835 21874 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:31.917619 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:31.918226 21893 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:31.918489 21874 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:31.918028 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:31.920190 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:31.921769 16803 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 10.
I20260709 13:20:31.925595 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.927175 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.857071 21895 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:31.928386 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.904757 21798 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:31.904523 21685 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:31.929906 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.939109 21721 tablet_bootstrap.cc:492] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:20:31.939983 21685 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:31.940203 21721 tablet_bootstrap.cc:492] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:20:31.941138 21721 ts_tablet_manager.cc:1403] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 1.479s	user 0.051s	sys 0.015s
I20260709 13:20:31.941799 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.936923 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.937893 21874 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:31.937956 21842 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:31.947803 21842 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:31.948221 21842 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:31.924204 21818 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:31.945612 21685 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:20:31.928452 21888 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:31.955356 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.956080 16957 raft_consensus.cc:2393] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 11: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:31.954538 21818 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:31.958388 21797 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:20:31.926738 21882 consensus_queue.cc:1048] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:20:31.972621 21797 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:31.975116 21797 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:31.979919 21988 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:31.971058 21818 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:31.957211 21798 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:20:31.981284 22016 log.cc:927] Time spent T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.160s	user 0.001s	sys 0.001s
I20260709 13:20:31.982993 21895 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:31.973169 22023 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:31.984704 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.985836 17492 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.959066 21940 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:31.941989 21946 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:20:31.992203 16924 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:31.958472 21980 consensus_queue.cc:237] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:31.991751 21998 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:32.003958 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:31.993561 21988 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:32.007515 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.007349 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:31.941746 21997 consensus_queue.cc:237] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:32.012344 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 83990.5us
I20260709 13:20:32.013990 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:31.996191 21895 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:32.032618 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:32.007086 21999 raft_consensus.cc:2804] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:32.003520 21998 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:31.994572 21940 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.037420 16850 leader_election.cc:400] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 14. Current term is 15.
I20260709 13:20:32.069149 16850 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:32.031006 21988 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.079490 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:32.034801 22023 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:32.086680 16775 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:32.067412 21998 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:32.033393 21934 consensus_queue.cc:1048] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:20:32.070994 21893 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:32.107072 16807 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:32.071648 21999 raft_consensus.cc:697] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:32.115900 16883 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:32.082676 21888 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:32.122793 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 88258.2us
I20260709 13:20:32.126159 16803 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:32.128615 17521 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:20:32.115312 21895 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:32.112885 21685 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:32.082347 21988 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:32.136536 22018 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:20:32.149410 21721 raft_consensus.cc:359] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:32.156313 16807 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:32.161522 22032 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:20:32.162729 21280 raft_consensus.cc:993] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:32.162510 21842 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:32.163203 21280 raft_consensus.cc:1081] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:32.163589 21921 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:20:32.165436 21988 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:32.168329 22011 raft_consensus.cc:993] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:32.168815 22011 raft_consensus.cc:1081] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
W20260709 13:20:32.169385 22022 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.344s	user 0.004s	sys 0.000s
I20260709 13:20:32.169901 21684 raft_consensus.cc:993] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:32.170528 21684 raft_consensus.cc:1081] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:32.164649 21842 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:32.169948 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:32.173288 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:32.192379 16804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:20:32.185719 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:32.204914 16804 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:32.205323 16804 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:32.200423 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:32.182857 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:32.185631 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:32.206717 16801 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 15.
I20260709 13:20:32.180529 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:32.154549 21893 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:32.220144 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:32.224593 16810 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:32.240758 21998 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:32.173353 21797 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:32.275213 22020 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.444s	user 0.000s	sys 0.002s
W20260709 13:20:32.280999 22021 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.473s	user 0.000s	sys 0.002s
W20260709 13:20:32.284439 22036 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:20:32.292301 21893 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.295439 21895 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.299002 16850 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:32.300215 16850 leader_election.cc:304] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:32.308404 16804 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:32.318892 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 105891us
I20260709 13:20:32.319893 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:20:32.314842 22004 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:20:32.326900 16804 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:32.314373 22033 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:32.316207 21798 raft_consensus.cc:493] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:32.326391 21988 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:32.324640 21979 raft_consensus.cc:2749] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:32.253813 21999 consensus_queue.cc:237] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:32.322628 21940 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:32.333039 21888 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:20:32.208489 21721 raft_consensus.cc:886] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEARNER]: Ignoring setting pending config change with OpId 9.8 because the committed config has OpId index 8. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:32.370765 21988 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:32.417574 21971 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:32.420207 22042 log.cc:927] Time spent T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:20:32.400907 21721 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:20:32.403640 21988 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:32.379426 21798 raft_consensus.cc:515] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.435842 21998 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:32.436915 21721 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:32.438912 21721 ts_tablet_manager.cc:1434] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.497s	user 0.011s	sys 0.000s
I20260709 13:20:32.445463 16810 raft_consensus.cc:2468] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:32.445807 21818 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:32.431629 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 119056us
I20260709 13:20:32.456453 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:32.488348 22049 log.cc:927] Time spent T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:20:32.489224 22019 log.cc:927] Time spent T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.677s	user 0.000s	sys 0.008s
I20260709 13:20:32.494626 16882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:20:32.495220 16882 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:32.495532 16882 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:32.502609 16882 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.504326 16883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:20:32.505041 16883 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:32.505364 21818 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:32.507010 22033 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:32.504426 16882 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:32.505393 16883 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:32.459136 21980 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:20:32.518218 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:32.523651 16878 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:32.527289 16883 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.528584 16877 raft_consensus.cc:1240] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:20:32.537425 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 114857us
I20260709 13:20:32.544237 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "671210bca23f4566a684a188613c1665" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:32.544507 16883 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:32.539433 21965 raft_consensus.cc:476] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 13:20:32.549325 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:32.550800 16876 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:32.553253 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:32.553750 16805 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:32.554665 16876 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:32.554893 16810 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:32.555600 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:32.557219 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:32.557345 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:32.557745 16804 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:32.568320 16882 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:32.579762 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:32.580461 16883 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:32.584741 16956 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:32.587934 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:32.568194 22039 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:32.559880 22053 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.589459 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:32.604995 16953 raft_consensus.cc:1240] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:20:32.590355 16804 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:32.589273 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:32.606165 16957 raft_consensus.cc:3055] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:32.597059 16956 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:20:32.598162 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:32.607425 16952 raft_consensus.cc:3055] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:32.607753 16952 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:32.602907 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:32.603757 16969 tablet_copy_service.cc:342] P ca1b60a074dc47cd8e68cc57a33a94a3: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-e9f7a2a0447a4956b36d1e9902e62f56 received from {username='slave'} at 127.0.0.1:48222
I20260709 13:20:32.604614 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:32.577226 22058 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:32.613257 16950 raft_consensus.cc:3055] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:32.614289 16850 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:32.606617 16957 raft_consensus.cc:740] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:32.546831 21988 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:32.613600 16950 raft_consensus.cc:740] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:32.628609 16805 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:32.628623 16959 raft_consensus.cc:1240] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:32.616420 16957 consensus_queue.cc:260] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.631779 16969 tablet_copy_service.cc:434] P ca1b60a074dc47cd8e68cc57a33a94a3: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-e9f7a2a0447a4956b36d1e9902e62f56 on tablet e9f7a2a0447a4956b36d1e9902e62f56 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:32.632026 16950 consensus_queue.cc:260] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.640863 16950 raft_consensus.cc:3060] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:32.634835 16957 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:32.620453 16952 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.642272 16952 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:32.635497 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:32.631664 16883 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:32.645196 22062 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:32.634907 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:32.647540 16850 leader_election.cc:304] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:32.653627 16952 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:32.683049 22060 raft_consensus.cc:2749] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:32.686197 17520 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:32.686182 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:32.591220 21980 consensus_queue.cc:1059] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:20:32.591084 21874 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 13:20:32.710065 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 104945us
W20260709 13:20:32.719187 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 74502.8us
I20260709 13:20:32.618597 22053 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:32.686208 22023 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:32.684162 21998 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 13:20:32.743305 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 147042us
I20260709 13:20:32.810843 16850 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
W20260709 13:20:32.816740 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 103835us
I20260709 13:20:32.818580 16955 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:32.822585 16850 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:32.741813 21753 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.740305 22032 raft_consensus.cc:3055] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:32.831163 21888 raft_consensus.cc:2804] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:32.835649 21888 raft_consensus.cc:697] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:32.835994 22018 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:32.836761 21888 consensus_queue.cc:237] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.840494 22046 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.841233 16950 raft_consensus.cc:2468] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:32.841024 22046 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:32.843441 22046 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:32.744753 21891 consensus_queue.cc:1059] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:20:32.815253 21998 consensus_queue.cc:1243] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer 4b60b701acc7473e87e3e529a2a34689 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:20:32.717226 22060 consensus_queue.cc:1059] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:20:32.833112 22032 raft_consensus.cc:740] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:32.819795 21686 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:20:32.881176 22033 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:20:32.888176 22045 log.cc:927] Time spent T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:20:32.850453 21753 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.903373 21979 raft_consensus.cc:3055] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:32.921407 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 98922us
I20260709 13:20:33.006369 22053 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:33.032511 21863 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:32.924814 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:33.033499 21863 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:33.033984 16883 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:33.015321 16955 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:20:33.013911 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 187681us
I20260709 13:20:32.995689 16957 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
W20260709 13:20:32.978792 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.912037 22033 raft_consensus.cc:697] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:20:32.922520 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 109028us
W20260709 13:20:32.938668 22056 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
W20260709 13:20:32.925688 22071 log.cc:927] Time spent T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:20:33.039927 16775 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:32.920377 21979 raft_consensus.cc:740] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:33.031810 21753 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:33.055936 21475 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:33.056483 21475 raft_consensus.cc:697] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:20:33.057610 16924 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.057318 21475 consensus_queue.cc:237] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:32.927872 21988 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:33.070724 16807 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:33.073053 16808 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:20:33.073395 21916 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:20:33.085053 22043 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.593s	user 0.002s	sys 0.008s
W20260709 13:20:33.075551 22059 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.583s	user 0.003s	sys 0.007s
I20260709 13:20:33.093694 22077 raft_consensus.cc:493] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:33.094944 21863 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:33.095268 22052 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.588s	user 0.000s	sys 0.002s
I20260709 13:20:33.098632 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:33.099452 21798 leader_election.cc:290] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:33.125463 21797 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:33.129760 22050 log.cc:927] Time spent T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.638s	user 0.004s	sys 0.009s
I20260709 13:20:33.134382 17521 raft_consensus.cc:1240] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 5. Current term is 6. Ops: []
I20260709 13:20:33.135579 16924 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
W20260709 13:20:33.194083 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 58593.9us
I20260709 13:20:33.139319 16803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:20:33.196002 16803 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:33.196376 16803 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:20:33.143167 16923 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.173210 16956 raft_consensus.cc:3060] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:33.179347 17527 raft_consensus.cc:1240] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:33.182956 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:33.188747 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:33.199061 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:33.200074 22041 raft_consensus.cc:2804] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:33.200628 22041 raft_consensus.cc:697] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:33.200814 22051 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.691s	user 0.010s	sys 0.000s
I20260709 13:20:33.201547 22041 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:33.203760 16807 raft_consensus.cc:2393] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:33.200094 22079 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:20:33.192178 16884 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:33.185879 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:33.211750 16877 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:33.217626 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:33.217159 16956 raft_consensus.cc:1275] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:33.210465 16803 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:33.224364 16808 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:33.225059 16884 pending_rounds.cc:85] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 10
I20260709 13:20:33.225360 16884 pending_rounds.cc:107] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:20:33.225605 16884 raft_consensus.cc:2889] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:33.226667 16877 raft_consensus.cc:1275] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:32.926573 22032 consensus_queue.cc:260] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:33.243327 16810 raft_consensus.cc:1240] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:33.253053 16807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:33.254765 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:33.262463 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d04db01c024df0a2b3bb75c0fcd76f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:33.271130 16803 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:33.245077 21999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.001s	sys 0.016s
I20260709 13:20:33.283636 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:33.241601 21891 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:33.302218 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 68370.3us
W20260709 13:20:33.306216 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 51546.4us
I20260709 13:20:33.307333 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:33.263291 21941 raft_consensus.cc:493] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
W20260709 13:20:33.285001 21999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.001s	sys 0.016s
I20260709 13:20:33.254172 21874 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:20:33.247982 21888 consensus_queue.cc:1059] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:20:33.342761 16807 raft_consensus.cc:3060] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:33.341361 16924 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:33.348320 16810 raft_consensus.cc:1240] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:20:33.191340 22077 raft_consensus.cc:515] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:33.327275 21841 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:33.317085 21842 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:20:33.214305 21979 consensus_queue.cc:260] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:33.395057 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:33.404955 16803 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
I20260709 13:20:33.344471 21971 raft_consensus.cc:493] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.403797 16775 leader_election.cc:304] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:33.408331 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 67037.2us
I20260709 13:20:33.316394 21891 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:33.425017 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:33.426719 21863 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:33.427067 21598 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:33.427970 21370 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.440291 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:33.341106 21941 raft_consensus.cc:515] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:33.445037 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:33.446812 16807 raft_consensus.cc:1275] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:20:33.474994 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 45911.2us
I20260709 13:20:33.272045 22033 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:33.481285 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:33.482493 16805 raft_consensus.cc:1240] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:33.441057 21686 raft_consensus.cc:2749] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:33.483600 16810 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:20:33.487211 16810 pending_rounds.cc:85] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Aborting all ops after (but not including) 7
I20260709 13:20:33.487499 16810 pending_rounds.cc:107] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:20:33.487886 16810 raft_consensus.cc:2889] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:33.443063 21863 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:33.484755 17527 raft_consensus.cc:1240] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 12. Current term is 13. Ops: []
W20260709 13:20:33.493916 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 62912.1us
I20260709 13:20:33.489089 21863 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.500928 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:33.430085 21971 raft_consensus.cc:515] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:33.494172 21939 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:33.499758 22079 raft_consensus.cc:3055] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:20:33.500061 22027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.010s	sys 0.021s
I20260709 13:20:33.489287 22080 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.259s
I20260709 13:20:33.502818 21926 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:33.512367 22097 consensus_queue.cc:1048] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:20:33.513098 21941 leader_election.cc:290] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:33.513216 22065 log.cc:927] Time spent T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:33.479699 21804 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:20:33.513942 22091 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:20:33.509032 21753 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:33.516569 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
W20260709 13:20:33.516840 22090 log.cc:927] Time spent T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:20:33.463704 21370 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:33.509502 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:33.564316 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 54872.6us
W20260709 13:20:33.552421 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 69035.2us
W20260709 13:20:33.556672 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 302958us
W20260709 13:20:33.550695 22027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.011s	sys 0.021s
I20260709 13:20:33.518141 22079 raft_consensus.cc:740] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:33.565315 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:33.576426 21891 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:32.512705 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:33.578936 21370 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:33.579190 22096 log.cc:927] Time spent T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:20:33.580252 21475 consensus_queue.cc:1059] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:33.581640 22081 log.cc:927] Time spent T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:20:33.591358 16810 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:20:33.601792 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 85303.5us
I20260709 13:20:33.557607 21926 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:33.617595 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 52344.4us
I20260709 13:20:33.569134 22037 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:33.640919 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:33.641551 16883 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:33.645329 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:33.654184 16951 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:33.654511 16951 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:33.656250 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:33.656764 16951 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:33.657015 16955 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 16.
I20260709 13:20:33.657683 16951 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:33.659797 22070 consensus_queue.cc:1059] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:20:33.660270 21804 consensus_queue.cc:1048] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:33.722790 16850 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:33.723888 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 59697.6us
I20260709 13:20:33.623919 21941 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:33.620179 22086 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:33.624346 22037 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:33.730549 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet d157a8f033dd43d5a5c824d9e6235fe9 with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:44070
I20260709 13:20:33.734402 16951 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
W20260709 13:20:33.737406 16706 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51366 (request call id 189) took 15891 ms (client timeout 15000 ms). Trace:
W20260709 13:20:33.739161 16706 rpcz_store.cc:269] 0709 13:20:17.836443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:17.836771 (+   328us) service_pool.cc:224] Handling call
0709 13:20:33.727723 (+15890952us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:28.994098 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:29.141334 (+147236us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:29.141399 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:20:29.141424 (+    25us) tablet.cc:662] Decoding operations
0709 13:20:29.143396 (+  1972us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:29.143511 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:29.143547 (+    36us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:20:29.205952 (+ 62405us) tablet.cc:701] Row locks acquired
0709 13:20:29.205999 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:20:29.206160 (+   161us) write_op.cc:270] Start()
0709 13:20:29.206310 (+   150us) write_op.cc:276] Timestamp: P: 1783603229206098 usec, L: 0
0709 13:20:29.206339 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:20:29.207049 (+   710us) log.cc:844] Serialized 6940 byte log entry
0709 13:20:29.738131 (+531082us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:30.088391 (+350260us) op_driver.cc:464] REPLICATION: finished
0709 13:20:30.451706 (+363315us) write_op.cc:301] APPLY: starting
0709 13:20:30.451823 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:30.663407 (+211584us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:30.683353 (+ 19946us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:31.295989 (+612636us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:31.296365 (+   376us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:20:31.296410 (+    45us) write_op.cc:312] APPLY: finished
0709 13:20:31.296825 (+   415us) log.cc:844] Serialized 164 byte log entry
0709 13:20:31.537653 (+240828us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:31.575146 (+ 37493us) write_op.cc:454] Released schema lock
0709 13:20:31.584612 (+  9466us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:31.633505 (+ 48893us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:31.635266 (+  1761us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":123564,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":261379,"apply.run_cpu_time_us":45992,"apply.run_wall_time_us":1186605,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79367,"num_ops":18,"prepare.queue_time_us":140658,"prepare.run_cpu_time_us":18416,"prepare.run_wall_time_us":288896,"raft.queue_time_us":192146,"raft.run_cpu_time_us":44022,"raft.run_wall_time_us":306051,"replication_time_us":859016,"spinlock_wait_cycles":3691904,"thread_start_us":717228,"threads_started":5,"wal-append.queue_time_us":396978,"wal-append.run_cpu_time_us":17947,"wal-append.run_wall_time_us":2825549}]]}
I20260709 13:20:33.743916 22037 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:33.746845 21893 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:33.747378 21893 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:33.748067 21893 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:33.747418 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 43769.5us
I20260709 13:20:33.746083 16883 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
W20260709 13:20:33.755718 22101 log.cc:927] Time spent T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:20:33.737982 21941 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:33.764760 21941 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:33.768342 17527 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEARNER]: Advancing to term 10
W20260709 13:20:33.769068 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:33.770737 22079 consensus_queue.cc:260] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:33.772140 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:33.777678 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 175004us
I20260709 13:20:33.778856 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:33.780217 22035 consensus_queue.cc:1048] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:33.781742 22035 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:33.782325 22035 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:33.785393 21979 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.791581 21926 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:33.794305 22109 log.cc:927] Time spent T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:20:33.802704 22079 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:33.863947 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72998e8e2cff40f3be2ce73539159ecf" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:33.872237 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:33.875145 16810 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 16.
I20260709 13:20:33.874619 22112 raft_consensus.cc:493] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:33.882140 22112 raft_consensus.cc:515] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:33.847393 22105 raft_consensus.cc:493] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:33.888494 17527 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:20:33.886615 21971 leader_election.cc:290] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:33.892397 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 142477us
I20260709 13:20:33.900988 22107 consensus_queue.cc:1059] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:33.880388 22062 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:33.907315 16956 raft_consensus.cc:1275] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:33.917027 21475 raft_consensus.cc:3055] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:33.917459 21475 raft_consensus.cc:740] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:33.918272 21475 consensus_queue.cc:260] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:33.920132 21475 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:33.925709 22122 tablet_replica.cc:333] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:33.916745 22062 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:33.890466 22112 leader_election.cc:290] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:33.920261 22104 log.cc:927] Time spent T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:20:34.008023 22062 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:33.892483 22105 raft_consensus.cc:515] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.048916 21926 raft_consensus.cc:3055] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:20:34.049373 21926 raft_consensus.cc:740] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:34.062513 16880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42010 (request call id 759) took 1889 ms. Trace:
I20260709 13:20:34.063068 16880 rpcz_store.cc:276] 0709 13:20:32.172609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:32.173014 (+   405us) service_pool.cc:224] Handling call
0709 13:20:32.212155 (+ 39141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:32.212593 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:32.212635 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:32.213186 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:20:32.361540 (+148354us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:20:32.389046 (+ 27506us) log.cc:844] Serialized 14 byte log entry
0709 13:20:32.389506 (+   460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:32.389596 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:33.129230 (+739634us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b4400022b4c. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebecfc85 00007feeebed06a2 00007feeeec421db 00007feeeec3daaf 00007feeeec3186e 00007feeeec30bb6 00007feeeec307d8 00007feeeec3a221 00007feeeec3a1d9 00007feeeec3a169
0709 13:20:34.061416 (+932186us) spinlock_profiling.cc:243] Waited 9.12 ms on lock 0x7b2400104708. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebe2f9c4 00007feeebe2dacb 00007feeebfe8dc9 00007feeebfe8a55 00007feeebfe7fb0 00007feeeec5e488 00007feeeec5ebe8 00007feeeec36398 00007feeeec3176a 00007feeeec30bb6
0709 13:20:34.062300 (+   884us) raft_consensus.cc:1685] finished
0709 13:20:34.062325 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.062453 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16466,"prepare.run_cpu_time_us":2001,"prepare.run_wall_time_us":12465,"raft.queue_time_us":1716,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":26717,"spinlock_wait_cycles":111167232,"thread_start_us":102361,"threads_started":1,"wal-append.queue_time_us":214645}
I20260709 13:20:34.065322 22105 leader_election.cc:290] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:34.067109 22018 raft_consensus.cc:3055] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:34.024133 22117 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:34.068627 22117 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.070663 22117 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:34.075070 21941 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.083560 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.088641 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:34.090731 16876 raft_consensus.cc:1275] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:34.091478 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:34.091589 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:34.095037 16955 raft_consensus.cc:1275] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:20:34.050122 21926 consensus_queue.cc:260] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.099753 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:34.101946 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:34.102118 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.067633 22018 raft_consensus.cc:740] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:34.071215 22037 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.109232 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1555b08c459f47689fc0d1a7cf582a1b" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:34.101457 21863 consensus_meta.cc:287] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: Time spent flushing consensus metadata: real 0.590s	user 0.010s	sys 0.000s
I20260709 13:20:34.115238 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:34.116897 16878 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15. Ops: []
W20260709 13:20:34.130929 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 174089us
W20260709 13:20:34.138475 16776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.139062 16957 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:34.106726 21979 raft_consensus.cc:493] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:34.124622 22117 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.145015 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.132766 21863 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.150122 21863 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:34.151077 16951 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:20:34.153503 21941 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:34.155869 22037 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:34.132316 22098 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:34.156989 22098 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.157207 22018 consensus_queue.cc:260] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.158387 22018 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:34.136076 21921 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:34.131409 21888 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:34.160048 21888 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.160840 16801 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43934 (request call id 2286) took 1018 ms. Trace:
I20260709 13:20:34.161197 16801 rpcz_store.cc:276] 0709 13:20:33.142585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.143500 (+   915us) service_pool.cc:224] Handling call
0709 13:20:33.143822 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:33.405258 (+261436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:33.405286 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:33.405323 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:33.405350 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:34.160627 (+755277us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400265f54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:34.160673 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:34.160788 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600787840}
I20260709 13:20:34.139721 21980 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:34.170603 21980 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.172726 21980 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:34.139386 22115 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:20:33.957201 22033 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.217s
I20260709 13:20:34.134224 21926 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:34.178756 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.182185 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:34.183362 16774 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.186753 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:34.188247 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:34.189638 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 322859us
I20260709 13:20:34.201664 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a7411023b914822890ea380b2bf8efc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:34.204872 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
W20260709 13:20:34.209550 16850 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.210932 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:34.214175 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d757b655f89a468ab8fc0ad2914716b7" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:34.145692 21979 raft_consensus.cc:515] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:34.220278 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 56710.7us
I20260709 13:20:34.180455 22060 consensus_queue.cc:1048] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:20:34.166471 22117 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:34.234848 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.180979 21893 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.238924 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:34.234539 16924 leader_election.cc:304] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:34.240710 16801 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:34.245474 16809 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:34.254048 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:34.212481 22115 consensus_queue.cc:1059] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:20:34.255254 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:34.258863 16879 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:34.263149 16877 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 16.
I20260709 13:20:34.234516 21965 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:34.234267 21921 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:34.277381 16801 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:34.254383 22087 raft_consensus.cc:2749] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:34.276826 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:34.278066 17527 raft_consensus.cc:1240] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:20:34.278522 16922 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.284490 22111 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:34.284893 21921 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.289314 22117 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:34.291518 16849 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:34.295066 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:34.357227 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 80456.9us
W20260709 13:20:34.360203 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 120691us
W20260709 13:20:34.361200 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 63935.2us
W20260709 13:20:34.413369 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 52548.6us
I20260709 13:20:34.262259 22062 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:20:34.416181 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:34.302551 22111 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:20:34.418401 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 53028.2us
W20260709 13:20:34.419973 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 53226.2us
I20260709 13:20:34.421737 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:34.429167 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:34.435586 22040 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:34.368386 21753 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:34.296327 21965 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:34.426275 22119 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:34.460012 16848 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:34.463423 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 44305us
I20260709 13:20:34.467131 16848 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:34.459066 21753 raft_consensus.cc:493] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.458802 22098 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:34.473141 22117 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:34.475250 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ca000fd50c4b38bfdd60badc024845" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:34.466871 22135 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.477579 16775 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:34.484699 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 46369.5us
I20260709 13:20:34.485508 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:34.487960 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:34.489486 16775 leader_election.cc:304] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:34.491566 16802 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:20:34.491716 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:34.505661 16801 raft_consensus.cc:2393] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 16: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:34.492604 22122 raft_consensus.cc:2243] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:34.494572 22124 raft_consensus.cc:2749] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:34.494690 21685 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:34.494608 22105 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:34.495329 21893 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:34.535746 16957 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:34.496009 22062 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:34.500285 22128 log.cc:927] Time spent T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:20:34.500682 21895 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:34.477110 21753 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.514026 16805 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:20:34.519217 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:34.523129 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:34.514899 22122 raft_consensus.cc:2272] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:34.473572 22111 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.546906 22111 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:34.546948 22142 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:20:34.537447 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:34.548218 16803 raft_consensus.cc:2393] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 16: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:34.538208 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:34.539453 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:34.549916 22135 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:34.551343 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:34.552342 22079 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.556046 16848 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:34.557060 22079 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.518877 21988 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:34.563434 22023 consensus_queue.cc:1175] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "96eaa6dafb3e4bbe914e54dc12507912" responder_term: 13 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 12. Current term is 13. Ops: [12.8-12.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:34.587118 21988 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.595656 21988 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:34.598047 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:34.564911 21979 leader_election.cc:290] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:34.572575 21893 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.598850 21895 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:34.597239 22117 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.605347 22117 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.605685 21895 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.610857 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:34.582162 22077 leader_election.cc:290] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:34.586539 21874 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:34.607460 22117 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:34.624783 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdef9f5ee0b4225ba140b5208412fde" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.623392 21874 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.611816 21893 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.676501 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcc7a68c24d41ef9c36f0bbfdb0e774" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.680588 16775 leader_election.cc:304] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:34.644160 22082 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:34.693248 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "109354c29850459b80f792dad016fc0d" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.694790 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.696087 16775 leader_election.cc:304] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:34.685488 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 56171.8us
I20260709 13:20:34.699930 21868 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:34.700477 21868 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.701440 21874 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:34.702533 21868 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:34.706002 22018 raft_consensus.cc:2749] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.690445 22105 raft_consensus.cc:2749] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:34.690754 22145 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:34.704067 21893 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:34.705036 22122 ts_tablet_manager.cc:1916] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:34.705312 22032 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:34.711557 22145 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.713730 22145 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:34.715970 16773 leader_election.cc:304] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:34.720033 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:34.720654 16805 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:34.722259 22145 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:34.725754 17518 raft_consensus.cc:1240] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
I20260709 13:20:34.725942 22138 raft_consensus.cc:2749] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:34.728910 22105 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.729358 22105 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.730298 16922 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:34.695725 22082 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.731112 21980 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.731603 22105 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:34.732604 22082 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:34.734666 22152 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:20:34.691507 22148 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:20:34.731637 21980 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:34.738407 16881 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:20:34.738749 16881 pending_rounds.cc:85] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Aborting all ops after (but not including) 8
I20260709 13:20:34.738961 16881 pending_rounds.cc:107] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:20:34.739178 16881 raft_consensus.cc:2889] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:34.608583 21753 raft_consensus.cc:515] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.740229 16951 raft_consensus.cc:2368] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 16. Current term is 17.
I20260709 13:20:34.732198 22105 consensus_queue.cc:1059] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:34.743975 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.746532 17520 raft_consensus.cc:3060] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEARNER]: Advancing to term 11
W20260709 13:20:34.746727 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 48637.7us
I20260709 13:20:34.747408 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:34.746582 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.749590 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:34.750782 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 230821us
I20260709 13:20:34.741161 21753 leader_election.cc:290] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:34.767596 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:34.768028 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:34.769443 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:34.770453 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:34.771047 16805 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.774307 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.774704 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:34.801337 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 53976.4us
I20260709 13:20:34.802111 16850 leader_election.cc:304] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:34.804633 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:34.806521 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.807081 16956 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 17.
I20260709 13:20:34.808692 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "168ed6dff4844944aff3337d23ee2950" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:34.809175 16884 raft_consensus.cc:3060] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.811666 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:34.749159 22018 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:34.826804 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.827338 16956 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 16.
I20260709 13:20:34.822559 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:34.777643 21804 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:34.777323 21971 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:34.800572 21798 raft_consensus.cc:3055] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:20:34.837478 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:34.840634 17520 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:34.817619 22115 raft_consensus.cc:2749] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.815958 22060 raft_consensus.cc:493] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:34.843529 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1b0416e641248ecbd3052388f5edf59" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:34.766603 22098 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:20:34.722782 22145 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.770092 22082 consensus_queue.cc:1059] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:20:34.812652 22135 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:34.842247 16805 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 17.
I20260709 13:20:34.844100 21804 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.888516 16775 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:34.874696 16884 raft_consensus.cc:2468] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 17.
I20260709 13:20:34.853971 21874 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:34.849315 21798 raft_consensus.cc:740] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
W20260709 13:20:34.894380 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 74492.8us
I20260709 13:20:34.834972 22018 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.867304 21891 raft_consensus.cc:493] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
W20260709 13:20:34.903559 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 85266.6us
I20260709 13:20:34.891368 21804 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:34.890573 22123 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:34.909164 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:34.909912 16801 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 15.
I20260709 13:20:34.851312 21971 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.916785 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:34.894587 21874 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.883315 22060 raft_consensus.cc:515] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:34.921918 21867 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:34.924536 21874 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:34.939787 21980 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:34.944350 22150 log.cc:927] Time spent T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:20:34.948215 22054 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:34.909140 21891 raft_consensus.cc:515] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:34.961918 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:34.960003 21798 consensus_queue.cc:260] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:34.979569 22157 log.cc:927] Time spent T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:20:34.987139 22081 log.cc:927] Time spent T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.423s	user 0.002s	sys 0.000s
W20260709 13:20:34.989466 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 68801.5us
I20260709 13:20:34.990213 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:35.006796 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.007042 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:35.012384 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:35.015496 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:34.982916 21971 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:34.984776 22018 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:34.983779 22145 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:34.979822 22130 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:35.012019 21867 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:35.020219 22040 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:20:34.973008 22054 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.031869 21804 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.036141 21874 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.049896 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:34.985224 22057 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:34.981745 22060 leader_election.cc:290] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:34.981703 21891 leader_election.cc:290] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:35.142706 17527 raft_consensus.cc:2393] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 16: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:20:35.147078 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 127583us
I20260709 13:20:35.066026 22062 raft_consensus.cc:493] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:35.153167 16953 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:20:35.156538 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 233692us
I20260709 13:20:35.143028 22057 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:35.168390 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:35.168089 16924 leader_election.cc:304] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:35.172268 16957 raft_consensus.cc:2393] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 16: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:35.175107 22162 raft_consensus.cc:2804] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:35.175614 22162 raft_consensus.cc:697] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:35.176479 22162 consensus_queue.cc:237] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.162029 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:35.156394 22062 raft_consensus.cc:515] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.210579 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:35.167399 22037 consensus_queue.cc:1059] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 13:20:35.221074 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 55927.7us
I20260709 13:20:35.190366 22172 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:35.225574 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 53402.6us
I20260709 13:20:35.228217 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f7a2a0447a4956b36d1e9902e62f56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.230410 16879 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2345) took 1116 ms. Trace:
I20260709 13:20:35.230544 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05d0b0f25f26402cb5f324812a9f12c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.230798 16879 rpcz_store.cc:276] 0709 13:20:34.113889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.115794 (+  1905us) service_pool.cc:224] Handling call
0709 13:20:34.135763 (+ 19969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.259196 (+123433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.230201 (+971005us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000b5754. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:35.230362 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276275584}
I20260709 13:20:35.233734 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e60cb274e4a7404ebaf6480f093cdf56" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.234584 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:35.235147 16806 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.240296 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.243324 16807 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:35.232177 17527 raft_consensus.cc:2962] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEARNER]: Ignoring commit of config change with OpId 9.8 because the committed config has OpId index 8. The config change we are ignoring is: Old config: { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:35.250085 16954 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:20:35.314260 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 64462.7us
I20260709 13:20:35.335309 22062 leader_election.cc:290] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:35.335582 21370 raft_consensus.cc:493] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:35.336275 21370 raft_consensus.cc:515] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.340611 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:35.348001 22151 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:35.348536 22151 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.352075 22122 ts_tablet_manager.cc:1929] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.7
I20260709 13:20:35.352617 22122 log.cc:1199] T d157a8f033dd43d5a5c824d9e6235fe9 P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/d157a8f033dd43d5a5c824d9e6235fe9
I20260709 13:20:35.353842 22122 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44070 (request call id 98) took 1763 ms. Trace:
I20260709 13:20:35.355334 21965 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:35.354195 22122 rpcz_store.cc:276] 0709 13:20:33.643131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:33.730286 (+ 87155us) service_pool.cc:224] Handling call
0709 13:20:33.925234 (+194948us) ts_tablet_manager.cc:1151] Deleting tablet d157a8f033dd43d5a5c824d9e6235fe9
0709 13:20:33.925304 (+    70us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:20:35.031295 (+1105991us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:35.351931 (+320636us) tablet_metadata.cc:665] Metadata flushed
0709 13:20:35.353742 (+  1811us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":572418,"tablet-delete.queue_time_us":129168,"thread_start_us":104023,"threads_started":1}
W20260709 13:20:35.364727 22175 log.cc:927] Time spent T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:20:35.342226 21874 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:35.366367 22174 log.cc:927] Time spent T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:20:35.370347 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 54832.8us
I20260709 13:20:35.370682 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:35.382292 22179 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:20:35.388767 16806 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 14.
I20260709 13:20:35.329063 22176 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.394263 22176 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.395299 22054 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:35.396584 22176 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.338337 22057 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.338356 21370 leader_election.cc:290] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.373108 21965 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:35.401302 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:35.401921 17519 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 6.
I20260709 13:20:35.409983 22057 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.411222 22151 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:35.412642 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:35.415302 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 415173us
I20260709 13:20:35.422618 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:35.422962 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:35.423349 16956 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.424757 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:35.425269 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:35.427017 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:35.429006 16806 raft_consensus.cc:3060] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:35.431617 16884 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:20:35.419831 22023 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:35.441114 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet d157a8f033dd43d5a5c824d9e6235fe9 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:20:35.431491 21979 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:35.442625 21979 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.444043 21891 raft_consensus.cc:493] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:35.444566 21891 raft_consensus.cc:515] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:35.445477 22132 log.cc:927] Time spent T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 1.088s	user 0.003s	sys 0.000s
I20260709 13:20:35.446559 21891 leader_election.cc:290] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.447049 22060 raft_consensus.cc:493] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:35.447532 22060 raft_consensus.cc:515] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.447924 22164 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:20:35.449463 22060 leader_election.cc:290] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:35.450762 22060 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.426786 21965 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.453910 16806 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 17.
I20260709 13:20:35.455257 16956 raft_consensus.cc:2468] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 17.
I20260709 13:20:35.451202 22060 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.493965 22060 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.500418 16850 leader_election.cc:304] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:35.462656 21874 raft_consensus.cc:493] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:35.504603 16850 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:35.507058 22117 raft_consensus.cc:2749] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:35.508519 16850 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:35.509049 22117 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:35.510344 22117 raft_consensus.cc:2804] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:35.510763 22117 raft_consensus.cc:697] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 17 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:35.511569 22117 consensus_queue.cc:237] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.516021 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:35.516640 22169 log.cc:927] Time spent T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:20:35.516700 16883 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 16.
I20260709 13:20:35.518937 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:35.521256 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:35.522759 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:35.523020 16850 leader_election.cc:304] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:35.523551 16880 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 5.
I20260709 13:20:35.521835 16883 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:35.533049 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.533846 16806 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 6.
I20260709 13:20:35.534914 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:35.537045 16951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:35.537612 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e6de173e42433e8df1572e54437e03" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:35.538009 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:35.544703 22032 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:20:35.545084 22032 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:35.545446 22032 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:35.571569 16881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44078 (request call id 2356) took 1450 ms. Trace:
I20260709 13:20:35.572165 16881 rpcz_store.cc:276] 0709 13:20:34.121587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.121789 (+   202us) service_pool.cc:224] Handling call
0709 13:20:34.122114 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.739592 (+617478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.571280 (+831688us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400190d54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:35.571496 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416428928}
I20260709 13:20:35.574448 17492 leader_election.cc:304] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:35.575881 22145 raft_consensus.cc:2804] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:35.576356 22145 raft_consensus.cc:697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:35.577207 22145 consensus_queue.cc:237] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.600929 21997 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:35.601925 21997 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.604628 21997 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.606400 21965 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:35.606997 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
W20260709 13:20:35.607542 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 56592.9us
I20260709 13:20:35.608209 16775 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:35.556970 22031 raft_consensus.cc:2749] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:35.529920 21874 raft_consensus.cc:515] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.617239 22114 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:35.617785 22114 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:35.618089 16775 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:35.618271 22114 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:35.618885 22177 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:20:35.619014 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:35.619302 22177 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.619630 22177 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:35.619765 21475 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:35.620174 21475 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:35.620540 21475 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:35.622540 21874 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.624346 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "043a927eb1a442999f1930b07d059e8f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.628659 16808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.630610 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:35.630903 16956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:35.632836 17520 raft_consensus.cc:1240] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 9. Current term is 10. Ops: []
W20260709 13:20:35.634672 16775 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:35.638856 22121 raft_consensus.cc:493] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:35.639326 22082 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.639535 22121 raft_consensus.cc:515] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.639884 22082 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.654407 22082 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:35.647720 22152 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:35.656123 22152 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.633905 21893 raft_consensus.cc:493] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:35.663980 21888 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.583353 22032 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.671703 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.677939 16803 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:35.680989 22032 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.682614 22156 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:35.686062 22177 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.690599 22177 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.691128 22192 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.691578 22192 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.696199 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.697130 16809 raft_consensus.cc:2368] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:35.698731 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:35.699254 17519 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:35.705255 16708 catalog_manager.cc:5697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 7 to 10, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 10 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.708328 22192 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:35.709447 22121 leader_election.cc:290] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.710351 21798 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:20:35.712386 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.713750 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:35.713852 16876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:35.714627 16876 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:35.716166 16850 leader_election.cc:400] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 16. Current term is 17.
I20260709 13:20:35.716459 16850 leader_election.cc:403] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:20:35.669903 21893 raft_consensus.cc:515] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.721195 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e62b3fa7cbf498099f802cfe999bd65" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:35.718596 16850 leader_election.cc:304] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:35.708256 22152 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.723745 16876 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:20:35.707231 16708 catalog_manager.cc:5697] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 7 to 10, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 10 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.728053 16775 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:35.728297 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:35.729554 16802 raft_consensus.cc:2368] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:20:35.732802 16708 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 9 to 11, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 11 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:35.736589 21891 raft_consensus.cc:2749] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:35.752221 17519 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 7.
I20260709 13:20:35.748673 16708 catalog_manager.cc:5697] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 7 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.759263 21475 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.761173 16775 leader_election.cc:304] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:35.763226 16773 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:35.754853 22114 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.764529 16876 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:35.765755 16850 leader_election.cc:400] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:35.767925 16850 leader_election.cc:403] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:35.726644 22080 raft_consensus.cc:2749] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 16. Current term is 17.
I20260709 13:20:35.757649 22107 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:35.772214 16806 raft_consensus.cc:1240] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:35.773013 16808 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 16.
W20260709 13:20:35.779239 22182 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:20:35.780505 21979 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.772430 21686 raft_consensus.cc:2749] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:35.782943 22023 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:35.783403 22023 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:35.786805 21475 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:35.772358 22176 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:35.788259 22176 raft_consensus.cc:697] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:35.788682 21893 leader_election.cc:290] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:35.789064 22176 consensus_queue.cc:237] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.764284 22070 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:20:35.792714 16810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43950 (request call id 2271) took 1207 ms. Trace:
I20260709 13:20:35.771580 22032 raft_consensus.cc:3060] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:35.793076 16810 rpcz_store.cc:276] 0709 13:20:34.585113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.585305 (+   192us) service_pool.cc:224] Handling call
0709 13:20:34.588085 (+  2780us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:20:35.051840 (+463755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:35.051860 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:20:35.052396 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:20:35.208073 (+155677us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:20:35.208130 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.792350 (+584220us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400266e54. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:35.792402 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:20:35.792444 (+    42us) raft_consensus.cc:1685] finished
0709 13:20:35.792456 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.792651 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6885,"raft.queue_time_us":139,"raft.run_cpu_time_us":454,"raft.run_wall_time_us":80712,"spinlock_wait_cycles":1065629056,"thread_start_us":44294,"threads_started":1,"wal-append.queue_time_us":85304}
I20260709 13:20:35.798952 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:35.769537 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:35.806870 21921 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:35.809096 16954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:35.809726 16954 raft_consensus.cc:606] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:35.813005 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbad0fc0e5714f879e763bb34b5f172f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:35.775012 16708 catalog_manager.cc:5697] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:35.817819 17518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:35.821034 16708 catalog_manager.cc:5697] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:35.819540 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:35.826799 17527 raft_consensus.cc:2368] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:20:35.827594 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:35.818216 22114 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:35.832296 21893 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.832789 21893 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:35.833031 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:35.833889 17519 raft_consensus.cc:2368] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:20:35.834815 21893 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:35.836050 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:35.836333 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:35.838284 17518 raft_consensus.cc:2393] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 16: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:35.838443 17521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44636 (request call id 1316) took 1113 ms. Trace:
I20260709 13:20:35.838850 17521 rpcz_store.cc:276] 0709 13:20:34.724708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.733333 (+  8625us) service_pool.cc:224] Handling call
0709 13:20:34.733674 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:20:34.895495 (+161821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:20:34.895526 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:20:34.895566 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:20:34.895597 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:20:35.838245 (+942648us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54004f2754. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeeefff571 00007feeef096e01 00007feeef09583e 00007feef405a419 00007feeed5d1bd4 00007feeed5d1b62 00007feeed5d1a91 00007feeed5d1a0c 00007feeed5d0cc2 00007feeed3d148c 00007feeed3d08c6
0709 13:20:35.838292 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:20:35.838394 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371661056}
I20260709 13:20:35.842367 17521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd370afa4144ee3b93ac6dc4ae63e07" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:35.844709 17527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0f9edf7f0a4d878e6da7c3949d2dbe" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:35.844908 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:35.847605 21804 leader_election.cc:290] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:35.850643 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:35.855542 16708 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 7 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.827965 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:35.863554 17522 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 16.
I20260709 13:20:35.851404 16775 leader_election.cc:304] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:35.871012 16877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa815b919c824fb196befa2fd6eeac35" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:35.872311 16881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:35.876784 16850 leader_election.cc:400] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:20:35.877110 16850 leader_election.cc:403] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:20:35.877691 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:35.885200 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9fb47e66dc4499902e4f88e8774c9c" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.886139 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.770576 22145 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:35.888967 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:35.875478 16881 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:35.895071 16848 leader_election.cc:304] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:35.919703 16809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:35.934228 16708 catalog_manager.cc:5697] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:35.936991 16708 catalog_manager.cc:5697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.893781 21980 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:20:35.955442 16708 catalog_manager.cc:5697] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 7 to 12, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 12 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:35.889633 22077 raft_consensus.cc:2749] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:35.900656 22032 raft_consensus.cc:2749] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 13. Current term is 14.
I20260709 13:20:35.935765 22138 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.932467 21798 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:20:35.967408 22138 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:35.990936 16809 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:36.000990 16877 raft_consensus.cc:2468] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 14.
I20260709 13:20:35.836026 22023 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:36.006588 22018 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.022s	sys 0.041s
I20260709 13:20:35.940960 22145 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:36.009320 22018 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.023s	sys 0.041s
I20260709 13:20:36.064318 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:36.067242 21868 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:36.069048 16957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "595865d470ea4e5489bcc4699f26ff4a"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:36.069669 16957 raft_consensus.cc:606] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:36.069983 16957 raft_consensus.cc:614] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:36.070880 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:36.067622 21868 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.074277 21868 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.069337 22164 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:36.075462 22164 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.077420 22164 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:36.081619 16958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:36.082692 22156 raft_consensus.cc:1064] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:20:36.083833 22138 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:36.083364 21868 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.084401 16958 raft_consensus.cc:606] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:36.086603 16922 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:36.088008 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:36.088725 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 199847us
I20260709 13:20:36.089422 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:36.091966 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:36.093854 16924 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:36.094477 17520 raft_consensus.cc:2393] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 14: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
W20260709 13:20:36.094892 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 199921us
I20260709 13:20:36.095271 16850 leader_election.cc:304] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:36.099108 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:36.098359 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:36.110539 21868 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:36.115335 21895 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:36.115994 16922 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:36.093330 21980 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:36.119546 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:36.122519 16801 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.103883 22193 raft_consensus.cc:2749] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:36.123612 16924 leader_election.cc:304] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:36.124476 16802 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:36.104106 21891 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:36.103765 22033 raft_consensus.cc:2749] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:36.135941 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:36.141558 22168 raft_consensus.cc:2749] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:36.134156 21868 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:20:36.144593 22152 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:36.129110 21934 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:36.137253 22179 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:36.151978 22098 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:36.152709 22098 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.153247 22156 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.154704 22098 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:36.156827 16848 leader_election.cc:400] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:20:36.158531 16848 leader_election.cc:400] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 6 election: Vote denied by peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369) with higher term. Message: Invalid argument: T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 6. Current term is 7.
I20260709 13:20:36.159951 16848 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:36.162125 21888 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:36.154623 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:36.162777 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:36.165155 22087 consensus_queue.cc:1059] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:36.165918 22087 raft_consensus.cc:3055] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:36.166419 22087 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:36.102535 22040 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:20:36.172885 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:36.167327 22087 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:36.177795 22087 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.123907 21980 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.272136 21980 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:20:36.176600 22196 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:20:36.181916 16924 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:36.191860 16878 raft_consensus.cc:1275] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:20:36.194303 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
W20260709 13:20:36.277724 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 95882.8us
I20260709 13:20:36.278035 16885 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:36.279313 16878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:36.203116 16952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:36.287631 16952 raft_consensus.cc:606] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:36.288004 16952 raft_consensus.cc:614] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:20:36.289776 16885 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:20:36.290485 16810 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:36.291280 22018 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.203703 16877 raft_consensus.cc:1275] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:20:36.245558 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:36.291774 22018 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.293979 22018 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:36.302963 17519 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:36.311332 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:36.311975 17520 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 10.
I20260709 13:20:36.322286 22179 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:36.326627 16773 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:36.327521 22018 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:36.327903 22018 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.328254 22018 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:36.331272 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:36.107008 22138 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:20:36.122731 22023 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 18 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:36.256053 22173 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:36.334884 22173 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:36.335276 22173 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.271009 21798 raft_consensus.cc:493] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:36.338996 21798 raft_consensus.cc:515] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:36.341219 21798 leader_election.cc:290] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:36.202318 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:36.283972 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:36.343650 16954 raft_consensus.cc:1275] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:20:36.284864 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:36.285043 21934 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:36.285705 16880 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:36.294360 16953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:36.348194 16953 raft_consensus.cc:606] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Received request to transfer leadership to TS 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:36.247687 22145 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:36.343153 16883 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 12.
I20260709 13:20:36.350776 21891 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:36.352682 22023 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:36.348150 16850 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:36.357154 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:36.364790 16801 raft_consensus.cc:2468] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 14.
I20260709 13:20:36.370675 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:36.370179 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:36.372328 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:36.376318 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:36.367945 21888 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:36.378949 16775 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:36.370293 22023 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.383716 22107 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:36.385352 22107 consensus_queue.cc:1059] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:36.376385 21988 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:36.391613 17520 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:20:36.391716 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:36.394093 17492 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:36.386270 22107 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:36.371556 22130 consensus_queue.cc:1048] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:20:36.396654 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:36.400693 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c407adc8efe4ee9859c31d64a280e7a" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:36.401628 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:36.402825 16883 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 9.
I20260709 13:20:36.389822 22018 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.413106 22018 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:36.413609 22176 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:36.396606 22033 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:20:36.411372 22023 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:36.418931 22166 raft_consensus.cc:2804] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:36.419472 22166 raft_consensus.cc:697] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:36.421774 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:36.422358 17520 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:36.424554 16775 leader_election.cc:304] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:36.425295 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:36.426038 16880 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:20:36.427515 16802 raft_consensus.cc:2368] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11.
I20260709 13:20:36.436664 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:36.439458 17520 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:36.440883 16773 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:36.442003 22176 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:36.442625 22176 raft_consensus.cc:697] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:36.396117 22107 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:36.456841 22152 consensus_queue.cc:1048] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:36.420701 22077 raft_consensus.cc:2764] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:20:36.429517 21798 raft_consensus.cc:2749] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:36.467026 16880 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 11.
I20260709 13:20:36.393433 22193 consensus_queue.cc:1048] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:20:36.488107 22107 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:36.420324 22166 consensus_queue.cc:237] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.487010 22173 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:36.491945 16880 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:36.489477 22107 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:36.508303 21895 raft_consensus.cc:993] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:36.512956 16801 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:20:36.516044 22088 raft_consensus.cc:993] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:36.536091 21980 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.538295 21980 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:36.539942 16878 raft_consensus.cc:2368] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 16. Current term is 17.
I20260709 13:20:36.546063 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:36.561431 16850 leader_election.cc:400] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11.
I20260709 13:20:36.593133 16850 leader_election.cc:403] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:20:36.593194 16801 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:36.443598 22176 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.581875 21598 raft_consensus.cc:993] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:36.589015 16957 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:36.589139 22152 raft_consensus.cc:1081] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
W20260709 13:20:36.611321 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 50021.3us
I20260709 13:20:36.619755 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf243a747f348a29b25b4642b64788e" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:36.620363 17519 raft_consensus.cc:3060] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:36.629729 16801 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 17.
I20260709 13:20:36.615490 21863 raft_consensus.cc:1081] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:36.614542 22193 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655) with higher term. Message: Invalid argument: T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 10. Current term is 11.
I20260709 13:20:36.637539 16850 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:36.645459 16775 leader_election.cc:400] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 election: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 16. Current term is 17.
I20260709 13:20:36.645849 16775 leader_election.cc:403] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:20:36.655854 21280 raft_consensus.cc:1081] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Signalling peer 96eaa6dafb3e4bbe914e54dc12507912 to start an election
I20260709 13:20:36.656306 17519 raft_consensus.cc:2468] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 17.
W20260709 13:20:36.656885 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 68262.3us
I20260709 13:20:36.625133 22138 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:20:36.649171 22033 raft_consensus.cc:2804] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:36.657927 21798 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931) with higher term. Message: Invalid argument: T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 16. Current term is 17.
I20260709 13:20:36.701786 16883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:36.689116 22173 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:36.696631 22033 raft_consensus.cc:697] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 17 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:36.705725 21753 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:20:36.760097 22033 consensus_queue.cc:237] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:36.779345 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 69877.7us
I20260709 13:20:36.783202 22173 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.783778 22173 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.785617 22173 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:36.799068 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:36.809657 22173 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:20:36.865505 16802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:36.866354 16801 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:20:36.866899 16801 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:36.866994 16804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:20:36.867269 16801 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.867556 16804 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:36.869462 16804 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.869879 16807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
 from {username='slave'} at 127.0.0.1:43934
I20260709 13:20:36.870395 16807 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:36.870754 16807 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.886843 16801 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:36.888072 16806 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:36.889065 16801 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:36.890636 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:36.891394 16957 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:36.891765 16957 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:36.892721 16957 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:36.895406 16957 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.903155 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:36.900146 16807 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:36.906765 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 76867us
I20260709 13:20:36.908069 16804 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.911489 16807 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:36.912645 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:36.913311 16953 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:20:36.913635 16953 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:36.914379 16953 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:36.913331 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:36.916180 17519 raft_consensus.cc:2410] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260709 13:20:36.924010 22219 log.cc:927] Time spent T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:20:36.925745 21997 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:20:36.929646 16958 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Rejecting Update request from peer 96eaa6dafb3e4bbe914e54dc12507912 for earlier term 15. Current term is 16. Ops: []
I20260709 13:20:36.931016 16957 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 16.
I20260709 13:20:36.932291 16801 raft_consensus.cc:1240] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:20:36.933919 16775 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:36.911118 16884 raft_consensus.cc:2955] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
W20260709 13:20:36.936818 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 79162.4us
I20260709 13:20:36.942874 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:36.943393 17519 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.945178 21798 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:36.945559 21798 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:36.937985 22223 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:36.946511 22223 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:36.947345 22223 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:36.937839 22221 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:20:36.977701 17519 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:36.981093 16773 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:36.983646 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:36.984256 16952 raft_consensus.cc:3055] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:36.984524 16952 raft_consensus.cc:740] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:36.985257 16952 consensus_queue.cc:260] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:36.986280 16952 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:36.988507 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:36.989208 16882 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.991148 16879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:36.991695 16879 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:36.992996 22224 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:36.992882 21798 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:36.993512 22224 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:36.994300 21798 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:36.994351 22224 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:37.005594 16804 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:37.016357 16882 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 16.
W20260709 13:20:37.018312 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 101723us
I20260709 13:20:37.026185 16952 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 15.
I20260709 13:20:37.030436 16879 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:37.024324 22230 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.045800 22230 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:37.049381 22230 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:37.055934 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:37.056537 16954 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 16.
I20260709 13:20:37.067303 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:37.071597 22230 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:37.072057 22230 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.072453 22230 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.072556 16953 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:37.078387 16925 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:37.086247 16924 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:37.087077 22168 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:37.102720 16953 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 14.
I20260709 13:20:37.104115 16775 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:37.104884 21798 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:37.105414 21798 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:37.110662 21798 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:37.114248 16804 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:37.115592 21882 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:37.120419 22230 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:37.125726 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:37.126873 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:37.128180 16878 raft_consensus.cc:3060] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:20:37.129464 22230 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:37.130673 16958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:37.131201 16958 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.133059 16706 catalog_manager.cc:5697] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 12, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 12 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.134874 16706 catalog_manager.cc:5697] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 12, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 12 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.136289 16706 catalog_manager.cc:5697] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 9 to 12, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 12 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.138021 16706 catalog_manager.cc:5697] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 14, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 14 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.138849 16810 raft_consensus.cc:1240] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 LEADER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:20:37.157063 16706 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.158452 16706 catalog_manager.cc:5697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 10 to 12, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 12 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.168048 16706 catalog_manager.cc:5697] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index -1 to 8, term changed from 7 to 10, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to <none>, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:37.141266 16878 raft_consensus.cc:1275] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:37.169697 16706 catalog_manager.cc:5697] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 13, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 13 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.154034 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet d157a8f033dd43d5a5c824d9e6235fe9 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:44070
I20260709 13:20:37.141028 16958 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 17.
I20260709 13:20:37.181524 21882 consensus_queue.cc:1048] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:37.183521 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:37.189867 21882 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:37.189646 16706 catalog_manager.cc:5697] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 13 to 14, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 14 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.195336 16706 catalog_manager.cc:5697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 9 to 10, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 10 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.202203 16706 catalog_manager.cc:5697] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.203312 16706 catalog_manager.cc:5697] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.190623 21882 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:37.200271 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet d157a8f033dd43d5a5c824d9e6235fe9 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
W20260709 13:20:37.153714 16708 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58326 (request call id 275) took 25357 ms (client timeout 15000 ms). Trace:
I20260709 13:20:37.246806 21882 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:37.248224 16706 catalog_manager.cc:5697] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 4 to 9, term changed from 12 to 15, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1), VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2), VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3), VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 15 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.253541 16706 catalog_manager.cc:5697] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 13, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 13 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:37.237051 16708 rpcz_store.cc:269] 0709 13:20:11.796772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:11.797180 (+   408us) service_pool.cc:224] Handling call
0709 13:20:37.153630 (+25356450us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:36.274429 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:36.274959 (+   530us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:36.274992 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:20:36.275008 (+    16us) tablet.cc:662] Decoding operations
0709 13:20:36.276006 (+   998us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:36.276065 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:36.276091 (+    26us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:20:36.276836 (+   745us) tablet.cc:701] Row locks acquired
0709 13:20:36.276854 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:20:36.276992 (+   138us) write_op.cc:270] Start()
0709 13:20:36.277109 (+   117us) write_op.cc:276] Timestamp: P: 1783603236276944 usec, L: 0
0709 13:20:36.277132 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:20:36.277718 (+   586us) log.cc:844] Serialized 3950 byte log entry
0709 13:20:36.504799 (+227081us) op_driver.cc:464] REPLICATION: finished
0709 13:20:36.699884 (+195085us) write_op.cc:301] APPLY: starting
0709 13:20:36.704871 (+  4987us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:36.915859 (+210988us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:36.915971 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:36.991057 (+ 75086us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:36.991309 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:20:36.991363 (+    54us) write_op.cc:312] APPLY: finished
0709 13:20:36.991636 (+   273us) log.cc:844] Serialized 97 byte log entry
0709 13:20:36.991829 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:36.991962 (+   133us) write_op.cc:454] Released schema lock
0709 13:20:36.992009 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:36.992458 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:36.992488 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":152817,"reported_tablets":49,"spinlock_wait_cycles":88192,"child_traces":[["op",{"apply.queue_time_us":190300,"apply.run_cpu_time_us":14500,"apply.run_wall_time_us":296269,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45927,"num_ops":10,"prepare.queue_time_us":215861,"prepare.run_cpu_time_us":3955,"prepare.run_wall_time_us":38051,"raft.queue_time_us":186486,"raft.run_cpu_time_us":22670,"raft.run_wall_time_us":146381,"replication_time_us":224410,"thread_start_us":467352,"threads_started":4,"wal-append.queue_time_us":1215}]]}
I20260709 13:20:37.260728 16879 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:37.261730 17520 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:37.259428 16804 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:37.262006 22224 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:37.263722 16706 catalog_manager.cc:5697] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 14, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 14 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.265034 16706 catalog_manager.cc:5697] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 9 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 11 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.273190 16706 catalog_manager.cc:5697] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 12, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 12 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.279043 16706 catalog_manager.cc:5697] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 10 to 13, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 13 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.282172 22229 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:20:37.288075 22035 raft_consensus.cc:2955] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 8 to 10, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.305425 16706 catalog_manager.cc:5697] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 12 to 13, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 13 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.306659 16706 catalog_manager.cc:5697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.307503 16706 catalog_manager.cc:5697] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 13, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 13 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.304673 16880 raft_consensus.cc:2955] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 8 to 10, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.316330 16706 catalog_manager.cc:5697] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 10 to 14, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 14 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.317456 16706 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 15, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 15 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.321216 16706 catalog_manager.cc:5697] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 15, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 15 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.324347 16706 catalog_manager.cc:5697] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 9, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 9 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.326957 21980 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:37.327541 21980 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:37.329936 21980 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:37.330487 16804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:37.331283 16804 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 15: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:37.305711 22224 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:20:37.353391 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:37.354220 16953 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 15.
I20260709 13:20:37.361354 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:37.375264 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:37.366163 17520 raft_consensus.cc:2955] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 8 to 10, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.385747 16804 raft_consensus.cc:2955] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 8 to 10, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:37.408139 17523 raft_consensus.cc:1275] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:37.391736 22193 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:37.416678 21980 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:37.441413 22193 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:20:37.465168 22193 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:37.433629 22033 consensus_queue.cc:1048] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:20:37.501865 17520 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:37.473930 21980 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:37.539278 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 72763.8us
I20260709 13:20:37.541347 16878 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:37.510812 22107 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
W20260709 13:20:37.576820 22246 log.cc:927] Time spent T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:20:37.583477 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:37.584293 16953 raft_consensus.cc:2368] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 16. Current term is 17.
I20260709 13:20:37.586064 16850 leader_election.cc:400] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 16. Current term is 17.
I20260709 13:20:37.586563 16850 leader_election.cc:403] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:20:37.604457 22243 log.cc:927] Time spent T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.097s	user 0.003s	sys 0.000s
I20260709 13:20:37.615935 21980 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:37.618705 16952 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:20:37.619766 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:37.621891 16953 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:20:37.598585 21979 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:20:37.611454 22193 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:37.661804 21979 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725) with higher term. Message: Invalid argument: T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 for earlier term 16. Current term is 17.
I20260709 13:20:37.639595 22018 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:20:37.671885 22193 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:37.752417 16879 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:37.753894 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:37.797190 22166 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:37.806617 16957 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:37.817483 21280 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:37.818305 21280 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:37.823921 16957 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:37.829605 21280 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:37.834074 16952 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 15.
I20260709 13:20:37.854123 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:37.855306 16884 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 18: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:37.779361 22224 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:20:37.871181 16850 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:37.880535 22193 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:37.881184 22193 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
W20260709 13:20:37.909883 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 110082us
I20260709 13:20:37.912334 22107 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:37.914744 22166 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:37.923838 22193 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:37.953567 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:37.954371 16810 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 18.
I20260709 13:20:37.967473 22260 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:37.991765 16878 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:38.012627 21888 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:38.013370 21888 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.016351 21888 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:38.020128 16803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:38.021142 16803 raft_consensus.cc:2393] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 15: Already voted for candidate 96eaa6dafb3e4bbe914e54dc12507912 in this term.
I20260709 13:20:38.025112 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:38.026142 16953 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 16: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:38.027184 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:38.028055 21280 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:38.028487 21280 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:38.028892 21280 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:38.049201 21280 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.057732 21280 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:38.074303 22107 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:38.085778 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:38.098192 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:38.098352 16806 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 16.
I20260709 13:20:38.099061 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:38.099856 16885 raft_consensus.cc:2393] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 18: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:38.118034 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:38.118942 21888 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:38.119323 21888 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:38.119666 21888 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:38.160063 16810 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 18.
I20260709 13:20:38.172004 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:38.175197 22156 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:38.175747 22156 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:38.176723 22156 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.223019 21888 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.260190 21888 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:38.261494 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:38.264681 16957 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 16: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:38.264744 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:38.294765 16805 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 16.
I20260709 13:20:38.340011 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:38.342633 21888 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:38.346084 21888 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 16 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:38.347267 21888 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.363308 22193 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.363935 22193 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.366396 22193 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:38.369835 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:38.370507 16805 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 18.
I20260709 13:20:38.371970 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:38.372551 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:38.373099 22193 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:38.373440 22193 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.373812 22193 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:38.397017 16950 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:38.399128 22249 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:38.436529 22193 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.445099 22193 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 19 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:38.461527 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:38.462159 16805 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:38.468086 16692 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet d157a8f033dd43d5a5c824d9e6235fe9 with cas_config_opid_index 3: aborting the task: latest config opid_index 9; task opid_index 3
I20260709 13:20:38.474570 16805 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 19.
I20260709 13:20:38.479631 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:38.485811 16850 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:38.487941 21979 raft_consensus.cc:2804] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:38.522761 16705 catalog_manager.cc:5697] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 14 to 15, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 15 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.524935 16705 catalog_manager.cc:5697] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 9 to 12, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 12 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.529479 21979 raft_consensus.cc:697] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 19 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:38.561033 16801 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:38.558811 16705 catalog_manager.cc:5697] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 5 to 8, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 8 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.564436 21979 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.574663 22018 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.575228 22018 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.577455 22018 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:38.585438 22193 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:38.585708 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:38.584621 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:38.596832 16775 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:38.598050 22260 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:38.653064 16706 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51366 (request call id 190) took 3941 ms. Trace:
I20260709 13:20:38.653513 16706 rpcz_store.cc:276] 0709 13:20:34.711961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:34.715779 (+  3818us) service_pool.cc:224] Handling call
0709 13:20:38.652835 (+3937056us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:37.488526 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:37.562348 (+ 73822us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:37.564336 (+  1988us) write_op.cc:435] Acquired schema lock
0709 13:20:37.566260 (+  1924us) tablet.cc:662] Decoding operations
0709 13:20:37.604827 (+ 38567us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:37.604885 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:37.604909 (+    24us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:20:37.606878 (+  1969us) tablet.cc:701] Row locks acquired
0709 13:20:37.606898 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:20:37.607037 (+   139us) write_op.cc:270] Start()
0709 13:20:37.607168 (+   131us) write_op.cc:276] Timestamp: P: 1783603237606994 usec, L: 0
0709 13:20:37.607192 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:20:37.665207 (+ 58015us) log.cc:844] Serialized 9663 byte log entry
0709 13:20:37.687959 (+ 22752us) op_driver.cc:464] REPLICATION: finished
0709 13:20:37.689164 (+  1205us) write_op.cc:301] APPLY: starting
0709 13:20:37.689252 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:38.106642 (+417390us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:38.106778 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:38.333184 (+226406us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:38.333656 (+   472us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:20:38.333724 (+    68us) write_op.cc:312] APPLY: finished
0709 13:20:38.334416 (+   692us) log.cc:844] Serialized 220 byte log entry
0709 13:20:38.344593 (+ 10177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.364308 (+ 19715us) write_op.cc:454] Released schema lock
0709 13:20:38.364382 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:38.404724 (+ 40342us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.404758 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38242,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":966,"apply.run_cpu_time_us":38196,"apply.run_wall_time_us":714197,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108627,"num_ops":25,"prepare.queue_time_us":111158,"prepare.run_cpu_time_us":7244,"prepare.run_wall_time_us":203619,"replication_time_us":80597,"spinlock_wait_cycles":2304,"thread_start_us":77197,"threads_started":2}]]}
W20260709 13:20:38.706290 16705 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58310 (request call id 268) took 20610 ms (client timeout 15000 ms). Trace:
I20260709 13:20:38.716177 16801 raft_consensus.cc:1240] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 19 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:20:38.719504 22152 consensus_queue.cc:1059] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:20:38.720402 22152 raft_consensus.cc:3055] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:38.720683 22152 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:38.721432 22152 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.722545 22152 raft_consensus.cc:3060] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:38.706722 16705 rpcz_store.cc:269] 0709 13:20:18.096122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:18.099828 (+  3706us) service_pool.cc:224] Handling call
0709 13:20:18.258247 (+158419us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5400037fd4. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeef000090 00007feeef09ef3a 00007feef4e551cc 00007feef4f5337e 00007feef34142a4 00007feef3414232 00007feef3414161 00007feef34140dc 00007feef3413392 00007feeed3d148c 00007feeed3d08c6
0709 13:20:38.706185 (+20447938us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:38.590778 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:38.591445 (+   667us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:38.591494 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:20:38.591522 (+    28us) tablet.cc:662] Decoding operations
0709 13:20:38.592204 (+   682us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:38.592316 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:38.592343 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:20:38.592801 (+   458us) tablet.cc:701] Row locks acquired
0709 13:20:38.592851 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:20:38.593020 (+   169us) write_op.cc:270] Start()
0709 13:20:38.593160 (+   140us) write_op.cc:276] Timestamp: P: 1783603238592957 usec, L: 0
0709 13:20:38.593187 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:20:38.593741 (+   554us) log.cc:844] Serialized 1299 byte log entry
0709 13:20:38.610534 (+ 16793us) op_driver.cc:464] REPLICATION: finished
0709 13:20:38.611759 (+  1225us) write_op.cc:301] APPLY: starting
0709 13:20:38.611850 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:38.613629 (+  1779us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:38.613707 (+    78us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:38.615850 (+  2143us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:38.616017 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:20:38.616057 (+    40us) write_op.cc:312] APPLY: finished
0709 13:20:38.616237 (+   180us) log.cc:844] Serialized 41 byte log entry
0709 13:20:38.616418 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.616512 (+    94us) write_op.cc:454] Released schema lock
0709 13:20:38.616551 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:38.620375 (+  3824us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:38.620403 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14134,"reported_tablets":49,"spinlock_wait_cycles":23429376,"child_traces":[["op",{"apply.queue_time_us":927,"apply.run_cpu_time_us":4790,"apply.run_wall_time_us":8574,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12540,"num_ops":3,"prepare.queue_time_us":24074,"prepare.run_cpu_time_us":3341,"prepare.run_wall_time_us":3341,"replication_time_us":3031,"spinlock_wait_cycles":1920,"thread_start_us":27763,"threads_started":1}]]}
I20260709 13:20:38.744733 16703 catalog_manager.cc:5697] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 10 to 13, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 13 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.746877 16703 catalog_manager.cc:5697] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.787782 16703 catalog_manager.cc:5697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 10 to 15, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 15 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.797058 16703 catalog_manager.cc:5697] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.804880 16703 catalog_manager.cc:5697] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 13 to 16, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 16 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.817412 16703 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 8 to 9, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 9 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.836738 16703 catalog_manager.cc:5697] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 11 to 13, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 13 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.840099 16703 catalog_manager.cc:5697] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 12 to 17, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 17 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.841873 16703 catalog_manager.cc:5697] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 9 to 14, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 14 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.843765 16703 catalog_manager.cc:5697] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 15 to 17, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 17 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.860430 16703 catalog_manager.cc:5697] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.864754 16703 catalog_manager.cc:5697] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 12 to 15, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 15 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.868228 16703 catalog_manager.cc:5697] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 5 to 14. New cstate: current_term: 14 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.871861 22152 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.872444 22152 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.875938 22152 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:38.872386 16703 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.878037 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:38.878652 16801 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 16.
I20260709 13:20:38.876982 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:38.883731 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:38.886751 16801 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:38.887271 22152 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:38.887696 22152 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:38.888028 22152 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.888327 22281 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:38.901163 16703 catalog_manager.cc:5697] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.920169 22152 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.932210 16957 raft_consensus.cc:1240] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Rejecting Update request from peer 4b60b701acc7473e87e3e529a2a34689 for earlier term 16. Current term is 17. Ops: []
I20260709 13:20:38.915539 16703 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 11 to 15, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 15 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:38.938458 22281 consensus_queue.cc:1059] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:38.942165 22281 raft_consensus.cc:3055] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:20:38.942550 22281 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:38.942016 16703 catalog_manager.cc:5697] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.943341 22281 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:38.943804 16703 catalog_manager.cc:5697] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 12 to 15, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 15 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.946951 22152 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:38.948931 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:38.947937 16703 catalog_manager.cc:5697] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.950440 16703 catalog_manager.cc:5697] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 7 to 10, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 10 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.951978 16805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:38.944499 22281 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:38.952073 16703 catalog_manager.cc:5697] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.960386 16703 catalog_manager.cc:5697] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:38.989292 16882 raft_consensus.cc:2410] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:20:38.993932 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:38.995316 22152 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:20:39.046038 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:39.099714 16801 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 19 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:20:39.101363 22281 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:39.132896 16950 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:20:39.133283 16950 pending_rounds.cc:85] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting all ops after (but not including) 9
I20260709 13:20:39.133482 16950 pending_rounds.cc:107] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:20:39.133742 16950 raft_consensus.cc:2889] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:39.138271 22280 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:39.096817 16705 catalog_manager.cc:5697] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 8 to 10, term changed from 10 to 11, leader changed from <none> to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:39.143537 16705 catalog_manager.cc:5697] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 14 to 15, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 15 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:39.158308 16705 catalog_manager.cc:5697] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:39.183024 16957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:39.183844 16957 raft_consensus.cc:606] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:39.182585 16705 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:39.192168 16957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6455509d1ac14e1d961f38607a869924"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:39.195204 16705 catalog_manager.cc:5697] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:39.192714 16957 raft_consensus.cc:606] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:39.196688 16705 catalog_manager.cc:5697] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:39.202306 16705 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:39.203960 16705 catalog_manager.cc:5697] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:39.211769 16950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:39.212384 22152 raft_consensus.cc:993] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:39.213017 22152 raft_consensus.cc:1081] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:39.212455 16950 raft_consensus.cc:606] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:39.223209 16882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:20:39.223213 16950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:50296
I20260709 13:20:39.223953 16882 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:39.224315 16882 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:39.225689 16950 raft_consensus.cc:606] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:39.231102 16882 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:39.242381 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:39.242975 16801 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:39.255110 16801 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 15.
I20260709 13:20:39.256295 16850 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:39.257268 16882 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:39.259482 22280 raft_consensus.cc:2804] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:39.260109 22280 raft_consensus.cc:697] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:39.261091 22280 consensus_queue.cc:237] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:39.267148 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db7a71cf1004eaab193504169d474c4" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:39.267820 16950 raft_consensus.cc:3055] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:20:39.268121 16950 raft_consensus.cc:740] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:39.268939 16950 consensus_queue.cc:260] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:39.276928 16950 raft_consensus.cc:3060] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:39.277267 16703 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58310 (request call id 269) took 3517 ms. Trace:
I20260709 13:20:39.334143 16801 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:39.362561 16950 raft_consensus.cc:2468] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 15.
I20260709 13:20:39.369078 22152 raft_consensus.cc:993] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:39.369537 22152 raft_consensus.cc:1081] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:39.277658 16703 rpcz_store.cc:276] 0709 13:20:35.759989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:35.760832 (+   843us) service_pool.cc:224] Handling call
0709 13:20:35.864818 (+103986us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5400002210. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feeebe31db1 00007feeebf71b71 00007feeebf720b2 00007feef4eeba89 00007feef4e83da6 00007feef4e55088 00007feef4f5337e 00007feef34142a4 00007feef3414232 00007feef3414161 00007feef34140dc
0709 13:20:39.277206 (+3412388us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:38.977861 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:38.978420 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:38.978461 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:20:38.978476 (+    15us) tablet.cc:662] Decoding operations
0709 13:20:38.980202 (+  1726us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:38.980262 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:38.980292 (+    30us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:20:38.982011 (+  1719us) tablet.cc:701] Row locks acquired
0709 13:20:38.982028 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:20:38.982185 (+   157us) write_op.cc:270] Start()
0709 13:20:38.982293 (+   108us) write_op.cc:276] Timestamp: P: 1783603238982138 usec, L: 0
0709 13:20:38.982314 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:20:38.983028 (+   714us) log.cc:844] Serialized 8548 byte log entry
0709 13:20:38.985910 (+  2882us) op_driver.cc:464] REPLICATION: finished
0709 13:20:38.986356 (+   446us) write_op.cc:301] APPLY: starting
0709 13:20:38.986432 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:39.022947 (+ 36515us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:39.025927 (+  2980us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:39.062380 (+ 36453us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:39.062656 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:20:39.062700 (+    44us) write_op.cc:312] APPLY: finished
0709 13:20:39.063098 (+   398us) log.cc:844] Serialized 196 byte log entry
0709 13:20:39.067124 (+  4026us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:39.067317 (+   193us) write_op.cc:454] Released schema lock
0709 13:20:39.067404 (+    87us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:39.074249 (+  6845us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b5400037e28. stack: 00007feeebf77343 00007feeebf77240 00007feeeb9061d4 00007feef5644304 00007feef5644299 00007feef54529e1 00007feef545164c 00007feef2ae23fd 00007feef2ace389 00007feef2acdb53 00007feef2ad1d61 00007feef2ad1d19 00007feef2ad1ca9 00007feef2ad1c71 00007feef2ad0e9d 000000000038f354
0709 13:20:39.074617 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:39.074645 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6361,"reported_tablets":49,"spinlock_wait_cycles":26920832,"child_traces":[["op",{"apply.queue_time_us":252,"apply.run_cpu_time_us":27885,"apply.run_wall_time_us":88202,"cfile_cache_hit":88,"cfile_cache_hit_bytes":91960,"num_ops":22,"prepare.queue_time_us":121,"prepare.run_cpu_time_us":5455,"prepare.run_wall_time_us":15493,"replication_time_us":3486,"spinlock_wait_cycles":9590528}]]}
I20260709 13:20:39.374403 16882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6455509d1ac14e1d961f38607a869924"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:20:39.374965 16882 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:39.375321 16882 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:39.383113 16882 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:39.457666 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 158362us
I20260709 13:20:39.562356 16882 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:39.590003 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:39.590678 16950 raft_consensus.cc:3055] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:20:39.590965 16950 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:39.626199 16950 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:39.630400 16950 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:39.636291 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 43714.7us
I20260709 13:20:39.681211 17519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0"
dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
mode: GRACEFUL
new_leader_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:36014
I20260709 13:20:39.681831 17519 raft_consensus.cc:606] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 LEADER]: Received request to transfer leadership to TS 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:39.683465 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:39.684172 16704 catalog_manager.cc:5697] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 6 to 13, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 13 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:39.685201 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:39.688588 16704 catalog_manager.cc:5697] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 14 to 15, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 15 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:39.698043 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 48255.4us
I20260709 13:20:39.698140 16950 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
W20260709 13:20:39.702364 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 317976us
I20260709 13:20:39.705011 22303 raft_consensus.cc:993] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:39.705562 22294 raft_consensus.cc:1081] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
W20260709 13:20:39.705969 22296 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:20:39.709281 16850 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:39.714665 22299 raft_consensus.cc:2804] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:39.715205 22299 raft_consensus.cc:697] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:39.716188 22299 consensus_queue.cc:237] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:39.721663 16801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:39.722335 16801 raft_consensus.cc:3060] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:39.730013 16704 catalog_manager.cc:5697] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:39.814837 16801 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 12.
W20260709 13:20:39.817162 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 77503.1us
I20260709 13:20:39.825835 16704 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:39.833702 16801 raft_consensus.cc:1240] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:20:39.835621 16955 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:39.853431 16885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:42010
I20260709 13:20:39.862258 16885 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:39.862653 16885 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:39.872828 16885 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:39.876837 16885 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 18 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:39.904346 17520 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:39.945024 22315 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:20:39.954757 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 54492.4us
I20260709 13:20:39.956411 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
W20260709 13:20:39.971773 16775 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 69873.3us
I20260709 13:20:39.971908 16955 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:39.974013 22315 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:39.986327 16950 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:39.999312 22299 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:40.005098 16803 raft_consensus.cc:1275] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:20:40.020185 16955 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 18.
I20260709 13:20:40.031626 22318 consensus_queue.cc:1048] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:40.031183 16850 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:40.034544 22281 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:40.035125 22281 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 18 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:40.035215 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:40.035861 17526 raft_consensus.cc:3055] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:20:40.036761 22281 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:40.036178 17526 raft_consensus.cc:740] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:40.045589 22307 raft_consensus.cc:993] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:40.046087 22307 raft_consensus.cc:1081] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:40.043057 17526 consensus_queue.cc:260] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:40.056342 17526 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:40.057909 22306 raft_consensus.cc:993] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:40.067003 22306 raft_consensus.cc:1081] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:40.067662 17526 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 18.
I20260709 13:20:40.079025 16882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:20:40.080219 16882 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:40.080792 16882 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:40.080161 16878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:20:40.084038 16878 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:40.084378 16878 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:40.103974 16878 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:40.108201 16882 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:40.111095 16810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912"
I20260709 13:20:40.111974 16810 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:40.114310 22107 raft_consensus.cc:2955] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 9 to 11, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:40.117611 16879 raft_consensus.cc:1240] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:20:40.119189 22307 consensus_queue.cc:1059] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:40.121155 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89c4a22bddc9425886aa0574ae085451" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:40.121420 22307 raft_consensus.cc:3055] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:20:40.121706 16955 raft_consensus.cc:3055] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:20:40.121850 22307 raft_consensus.cc:740] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:40.122087 16955 raft_consensus.cc:740] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:40.120268 16878 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:40.116174 16957 raft_consensus.cc:2955] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 9 to 11, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:40.122949 16955 consensus_queue.cc:260] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:40.125708 16955 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:40.133955 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet efa1a19816094c78802287ff39e74b62 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:40.122792 22307 consensus_queue.cc:260] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:40.137238 22307 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:40.139988 16810 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:40.142120 16850 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: 
I20260709 13:20:40.151233 16882 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Requested vote from peers ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:40.151717 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:40.152279 17526 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:40.142120 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:40.159639 16955 raft_consensus.cc:2468] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 11.
I20260709 13:20:40.164929 17526 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:40.186555 16885 raft_consensus.cc:1240] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 18 LEADER]: Rejecting Update request from peer 599f9a88b6cd4e818a1c59a0b4522480 for earlier term 17. Current term is 18. Ops: []
I20260709 13:20:40.160337 22318 raft_consensus.cc:2804] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:40.189986 22318 raft_consensus.cc:697] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:40.213797 22318 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:40.219869 22322 log.cc:927] Time spent T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:20:40.224282 16848 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
W20260709 13:20:40.240842 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 55315.5us
I20260709 13:20:40.241508 17519 raft_consensus.cc:2955] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 9 to 11, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:40.249939 22281 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:40.263799 22281 raft_consensus.cc:697] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:40.264770 22281 consensus_queue.cc:237] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:40.271754 16810 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:40.275120 22308 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:40.287923 16953 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:40.313719 16955 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:20:40.322225 22299 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:20:40.342638 22318 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:40.343245 22318 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:40.356140 16806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "96eaa6dafb3e4bbe914e54dc12507912" is_pre_election: true
I20260709 13:20:40.358299 16705 catalog_manager.cc:5697] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 9 to 11, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 15 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:40.393869 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet efa1a19816094c78802287ff39e74b62 with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:44070
I20260709 13:20:40.400804 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:40.406600 16850 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:40.414175 16704 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58336 (request call id 239) took 10033 ms. Trace:
I20260709 13:20:40.409332 22281 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:40.417400 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:40.417582 22318 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:40.414614 16704 rpcz_store.cc:276] 0709 13:20:30.380885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:30.422243 (+ 41358us) service_pool.cc:224] Handling call
0709 13:20:40.414093 (+9991850us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:20:40.006679 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:20:40.016158 (+  9479us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:20:40.016439 (+   281us) write_op.cc:435] Acquired schema lock
0709 13:20:40.016461 (+    22us) tablet.cc:662] Decoding operations
0709 13:20:40.018098 (+  1637us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:20:40.018184 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:20:40.018208 (+    24us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:20:40.018611 (+   403us) tablet.cc:701] Row locks acquired
0709 13:20:40.018631 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:20:40.018776 (+   145us) write_op.cc:270] Start()
0709 13:20:40.018966 (+   190us) write_op.cc:276] Timestamp: P: 1783603240018728 usec, L: 0
0709 13:20:40.018990 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:20:40.043623 (+ 24633us) log.cc:844] Serialized 1678 byte log entry
0709 13:20:40.218713 (+175090us) op_driver.cc:464] REPLICATION: finished
0709 13:20:40.316022 (+ 97309us) write_op.cc:301] APPLY: starting
0709 13:20:40.316104 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:20:40.318548 (+  2444us) tablet.cc:1370] finished BulkCheckPresence
0709 13:20:40.318640 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:20:40.320970 (+  2330us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:20:40.321139 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:20:40.321181 (+    42us) write_op.cc:312] APPLY: finished
0709 13:20:40.321403 (+   222us) log.cc:844] Serialized 49 byte log entry
0709 13:20:40.321560 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:40.321653 (+    93us) write_op.cc:454] Released schema lock
0709 13:20:40.322555 (+   902us) write_op.cc:341] FINISH: Updating metrics
0709 13:20:40.364060 (+ 41505us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:20:40.364095 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1678,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":86629,"apply.run_cpu_time_us":6132,"apply.run_wall_time_us":41810,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20847,"num_ops":4,"prepare.queue_time_us":109407,"prepare.run_cpu_time_us":3432,"prepare.run_wall_time_us":41703,"replication_time_us":170103,"thread_start_us":186225,"threads_started":2}]]}
I20260709 13:20:40.459805 22336 tablet_replica.cc:333] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:40.461330 22336 raft_consensus.cc:2243] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:40.481923 16950 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:40.485562 22336 raft_consensus.cc:2272] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:40.488701 22336 ts_tablet_manager.cc:1916] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:40.492374 22299 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:40.527551 22107 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:40.528082 22107 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:40.528837 16703 catalog_manager.cc:5697] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:40.530093 22107 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:40.531138 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:40.531877 16950 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 17: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:40.531138 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:40.533174 16885 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 17.
I20260709 13:20:40.534741 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:40.534564 16703 catalog_manager.cc:5697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 15 to 16, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 16 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:40.535468 22107 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:40.535861 22107 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:40.536227 22107 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:40.536113 16703 catalog_manager.cc:5697] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 11 to 14, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 14 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:40.544754 22107 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:40.553781 17519 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:20:40.556924 22107 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:40.557905 22299 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:40.559433 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:40.560178 16953 raft_consensus.cc:2393] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 96eaa6dafb3e4bbe914e54dc12507912 in current term 17: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:40.561894 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:40.568940 16885 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96eaa6dafb3e4bbe914e54dc12507912 in term 17.
I20260709 13:20:40.558252 16703 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 15 to 16, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 16 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:40.570379 16703 catalog_manager.cc:5697] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 17 to 19, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 19 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:40.575977 16703 catalog_manager.cc:5697] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:40.577162 16703 catalog_manager.cc:5697] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 10 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:40.582238 16775 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912; no voters: ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:40.582974 22107 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:20:40.583434 22107 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 LEADER]: Becoming Leader. State: Replica: 96eaa6dafb3e4bbe914e54dc12507912, State: Running, Role: LEADER
I20260709 13:20:40.584251 22107 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:40.579993 16703 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 13 to 14, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 14 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:40.608675 16703 catalog_manager.cc:5697] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 13 to 14, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 14 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:40.612200 16703 catalog_manager.cc:5697] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:40.627933 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet d157a8f033dd43d5a5c824d9e6235fe9 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:44070
W20260709 13:20:40.629823 16707 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58326 (request call id 276) took 12054 ms (client timeout 15000 ms). Trace:
I20260709 13:20:40.630241 16953 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:40.632936 22299 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:40.637498 16705 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 17 to 18, leader changed from 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 18 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:20:40.630244 16707 rpcz_store.cc:269] 0709 13:20:28.575437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:28.575626 (+   189us) service_pool.cc:224] Handling call
0709 13:20:40.629652 (+12054026us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":49}
I20260709 13:20:40.673262 22336 ts_tablet_manager.cc:1929] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:20:40.673861 22336 log.cc:1199] T efa1a19816094c78802287ff39e74b62 P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/efa1a19816094c78802287ff39e74b62
I20260709 13:20:40.675602 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet efa1a19816094c78802287ff39e74b62 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:20:40.688900 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet d157a8f033dd43d5a5c824d9e6235fe9 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:20:40.747246 16950 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:20:40.756698 17526 raft_consensus.cc:1275] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:20:40.758517 22304 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:40.769281 22304 consensus_queue.cc:1048] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:20:40.834252 16704 catalog_manager.cc:5697] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 11 to 12, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 12 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:40.848464 16810 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:20:40.855048 16704 catalog_manager.cc:5697] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 14 to 15, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 15 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:40.857686 22310 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:40.868706 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:40.921648 16705 catalog_manager.cc:5697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 16 to 17, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1). New cstate: current_term: 17 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:40.926043 16703 catalog_manager.cc:5697] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 12 to 13, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 13 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:40.988550 16705 catalog_manager.cc:5697] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: term changed from 10 to 11, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } }
I20260709 13:20:41.032446 16955 consensus_queue.cc:237] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:41.072691 17526 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:41.074170 22306 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:41.078773 16810 raft_consensus.cc:1275] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:20:41.080403 22307 consensus_queue.cc:1048] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:41.108246 22306 raft_consensus.cc:2955] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:41.113160 16810 raft_consensus.cc:2955] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:41.124178 16955 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:41.134784 22315 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:41.150367 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9f7a2a0447a4956b36d1e9902e62f56 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:41.164202 16707 catalog_manager.cc:5697] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 10 to 11, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New cstate: current_term: 11 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:41.179724 16870 tablet_service.cc:1558] Processing DeleteTablet for tablet e9f7a2a0447a4956b36d1e9902e62f56 with delete_type TABLET_DATA_TOMBSTONED (TS 4b60b701acc7473e87e3e529a2a34689 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:44070
I20260709 13:20:41.181020 22336 tablet_replica.cc:333] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:41.177543 17519 raft_consensus.cc:2955] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:41.191129 22336 raft_consensus.cc:2243] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:41.194834 22336 raft_consensus.cc:2272] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:41.209043 16884 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:20:41.213666 22336 ts_tablet_manager.cc:1916] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:41.218041 22315 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:41.334718 22336 ts_tablet_manager.cc:1929] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:20:41.335291 22336 log.cc:1199] T e9f7a2a0447a4956b36d1e9902e62f56 P 4b60b701acc7473e87e3e529a2a34689: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/wals/e9f7a2a0447a4956b36d1e9902e62f56
I20260709 13:20:41.336817 16694 catalog_manager.cc:5028] TS 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): tablet e9f7a2a0447a4956b36d1e9902e62f56 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:20:42.106293 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:42.261368 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:20:42.262959 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:42.706271 16884 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:42.733341 16950 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:42.734714 22281 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:42.744940 17519 raft_consensus.cc:3060] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 2 LEARNER]: Advancing to term 11
I20260709 13:20:42.748313 16803 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:42.751500 22281 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:20:42.752496 17519 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:20:42.754124 22281 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:42.756138 22281 consensus_queue.cc:1243] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Peer 599f9a88b6cd4e818a1c59a0b4522480 log is divergent from this leader: its last log entry 1.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:20:42.762926 17519 pending_rounds.cc:85] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting all ops after (but not including) 1
I20260709 13:20:42.763202 17519 pending_rounds.cc:107] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:20:42.763438 17519 raft_consensus.cc:2917] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:20:42.763840 17519 raft_consensus.cc:2889] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:42.772234 22281 raft_consensus.cc:2955] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:42.777124 16953 raft_consensus.cc:2955] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:42.844200 16704 catalog_manager.cc:5697] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 7, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:42.852902 16884 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:42.870606 16803 raft_consensus.cc:2955] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:42.940574 16953 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:20:42.949034 16848 consensus_peers.cc:597] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e5bdf407d5944728fca8072489ee727. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:42.958325 16803 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:20:42.956319 22357 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:20:42.965179 22366 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:42.996737 17519 raft_consensus.cc:2955] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEARNER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:43.018321 22366 raft_consensus.cc:2955] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:43.032783 22357 raft_consensus.cc:1064] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:20:43.034731 16950 raft_consensus.cc:2955] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:43.035630 22357 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:43.053617 16953 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:43.054708 17519 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:43.056422 22281 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:43.065346 16803 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:43.069134 22281 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:43.072198 22310 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:20:43.075158 16803 raft_consensus.cc:2955] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:43.079571 16810 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:43.088364 22310 raft_consensus.cc:2955] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:43.113600 16704 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 9, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 14 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:43.106101 16806 raft_consensus.cc:2955] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:43.102741 16950 raft_consensus.cc:2955] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:43.126163 16953 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:43.141335 22374 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 13:20:43.167419 16773 consensus_peers.cc:597] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d5fe95d8fc442c7ad6fda1ba72b8ea9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.182507 16884 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:20:43.179550 16704 catalog_manager.cc:5697] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index 7 to 8, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:43.189261 17519 raft_consensus.cc:2955] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:43.196084 22380 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:20:43.233842 16880 consensus_queue.cc:237] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:43.243410 22381 raft_consensus.cc:2955] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:43.250684 16953 raft_consensus.cc:2955] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:43.263644 16810 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:43.263870 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:43.265538 22357 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:43.276844 17519 raft_consensus.cc:1275] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:20:43.263754 16884 raft_consensus.cc:2955] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:43.281698 22357 consensus_queue.cc:1048] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:20:43.291204 22368 raft_consensus.cc:2955] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:43.298190 16806 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:43.304250 17519 raft_consensus.cc:2955] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:43.306867 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 89c4a22bddc9425886aa0574ae085451 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:43.312657 16805 raft_consensus.cc:2955] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:43.313668 16707 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 10, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 16 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.336604 16704 catalog_manager.cc:5697] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 8 to 9, VOTER ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) evicted. New cstate: current_term: 11 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:43.356845 16942 tablet_service.cc:1558] Processing DeleteTablet for tablet 89c4a22bddc9425886aa0574ae085451 with delete_type TABLET_DATA_TOMBSTONED (TS ca1b60a074dc47cd8e68cc57a33a94a3 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:34326
I20260709 13:20:43.368711 22385 tablet_replica.cc:333] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:43.372524 22385 raft_consensus.cc:2243] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:43.374154 22385 raft_consensus.cc:2272] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:43.374342 16773 consensus_peers.cc:597] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be49fe28fec04ec88f4f84bc7aa2149f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.379082 16953 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:43.379364 16884 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Refusing update from remote peer 96eaa6dafb3e4bbe914e54dc12507912: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:43.383374 22316 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:43.386241 22381 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:43.386730 22385 ts_tablet_manager.cc:1916] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:20:43.405215 22385 ts_tablet_manager.cc:1929] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
I20260709 13:20:43.405689 22385 log.cc:1199] T 89c4a22bddc9425886aa0574ae085451 P ca1b60a074dc47cd8e68cc57a33a94a3: Deleting WAL directory at /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/wals/89c4a22bddc9425886aa0574ae085451
I20260709 13:20:43.407627 16694 catalog_manager.cc:5028] TS ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): tablet 89c4a22bddc9425886aa0574ae085451 (table test-workload [id=5731bb0fbda44935b8c72315bdb9c2b9]) successfully deleted
I20260709 13:20:43.429473 22386 ts_tablet_manager.cc:933] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:43.432142 22386 tablet_copy_client.cc:323] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:20:43.434393 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 7e5bdf407d5944728fca8072489ee727 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:20:43.434990 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 7e5bdf407d5944728fca8072489ee727 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-7e5bdf407d5944728fca8072489ee727
I20260709 13:20:43.449468 16895 tablet_copy_source_session.cc:215] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:43.454587 22374 raft_consensus.cc:2955] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:43.464661 16953 raft_consensus.cc:2955] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:43.468437 16882 raft_consensus.cc:2955] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:43.475775 22386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5bdf407d5944728fca8072489ee727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:43.493877 16707 catalog_manager.cc:5697] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 reported cstate change: config changed from index -1 to 11, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 14 leader_uuid: "96eaa6dafb3e4bbe914e54dc12507912" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.502202 22386 tablet_copy_client.cc:806] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:43.502918 22386 tablet_copy_client.cc:670] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:43.510715 22386 tablet_copy_client.cc:538] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:43.550401 15720 tablet_server.cc:179] TabletServer@127.15.90.1:0 shutting down...
I20260709 13:20:43.555197 22386 tablet_bootstrap.cc:492] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:20:43.561038 22390 ts_tablet_manager.cc:933] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
W20260709 13:20:43.569289 17492 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 32 similar messages]
I20260709 13:20:43.605784 22390 tablet_copy_client.cc:323] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
W20260709 13:20:43.624080 16850 consensus_peers.cc:597] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.627166 16850 consensus_peers.cc:597] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.629206 16850 consensus_peers.cc:597] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.631765 16924 consensus_peers.cc:597] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.647964 16850 consensus_peers.cc:597] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.688980 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.716104 16924 consensus_peers.cc:597] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.721992 16924 consensus_peers.cc:597] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.752740 17492 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.781024 16850 consensus_peers.cc:597] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.817886 17492 consensus_peers.cc:597] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.821033 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.831291 16924 consensus_peers.cc:597] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.839354 16924 consensus_peers.cc:597] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.840109 16850 consensus_peers.cc:597] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.847111 17492 consensus_peers.cc:597] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.847910 16924 consensus_peers.cc:597] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.847649 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.874953 17492 consensus_peers.cc:597] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.899638 16924 consensus_peers.cc:597] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.905136 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.907305 16850 consensus_peers.cc:597] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.910184 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 67784.6us
I20260709 13:20:43.912416 22400 ts_tablet_manager.cc:933] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
W20260709 13:20:43.944588 16850 consensus_peers.cc:597] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.945633 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:43.954500 22400 tablet_copy_client.cc:323] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.1:46655
W20260709 13:20:43.955365 16924 consensus_peers.cc:597] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.966722 22386 tablet_bootstrap.cc:492] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:43.977157 22386 tablet_bootstrap.cc:492] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
W20260709 13:20:43.976017 16924 consensus_peers.cc:597] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:43.974159 16850 consensus_peers.cc:597] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.985810 15720 tablet_replica.cc:333] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:43.986794 15720 raft_consensus.cc:2243] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:20:43.991555 22386 ts_tablet_manager.cc:1403] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.437s	user 0.052s	sys 0.009s
W20260709 13:20:43.992228 16850 consensus_peers.cc:597] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:43.996644 22386 raft_consensus.cc:359] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:44.002537 22386 raft_consensus.cc:740] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:20:43.997740 15720 raft_consensus.cc:2272] T 7fe476f65c0445399ab9cd51828acf2f P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:44.026096 16924 consensus_peers.cc:597] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:44.032297 15720 tablet_replica.cc:333] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.033249 15720 raft_consensus.cc:2243] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.033916 15720 raft_consensus.cc:2272] T 8abf86e7719a4c7bae84b69e92b761bb P 96eaa6dafb3e4bbe914e54dc12507912 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.036720 15720 tablet_replica.cc:333] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
W20260709 13:20:44.037859 17492 consensus_peers.cc:597] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:44.039755 15720 raft_consensus.cc:2243] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.040441 22386 consensus_queue.cc:260] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:44.044159 22386 ts_tablet_manager.cc:1434] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:20:44.044780 15720 raft_consensus.cc:2272] T f4f36dd72a75406881b100b0ebbaeaff P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.048280 15720 tablet_replica.cc:333] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.048400 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-7e5bdf407d5944728fca8072489ee727 received from {username='slave'} at 127.0.0.1:42010
I20260709 13:20:44.048887 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-7e5bdf407d5944728fca8072489ee727 on tablet 7e5bdf407d5944728fca8072489ee727 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:44.049562 15720 raft_consensus.cc:2243] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.050194 15720 raft_consensus.cc:2272] T 2bff4b982e59440089e2d3d5b8ada66f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:44.051856 17492 consensus_peers.cc:597] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:44.092249 16924 consensus_peers.cc:597] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:44.057854 15720 tablet_replica.cc:333] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.104485 15720 raft_consensus.cc:2243] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.105173 15720 raft_consensus.cc:2272] T 2db7a71cf1004eaab193504169d474c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.121320 15720 tablet_replica.cc:333] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.122241 15720 raft_consensus.cc:2243] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.126848 15720 raft_consensus.cc:2272] T 5bc0e6e74a524cd59d8c8341367e62b3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:44.141963 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:44.146795 16924 consensus_peers.cc:597] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:44.129807 15720 tablet_replica.cc:333] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.159955 15720 raft_consensus.cc:2243] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.160806 15720 raft_consensus.cc:2272] T 7c407adc8efe4ee9859c31d64a280e7a P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.165232 15720 tablet_replica.cc:333] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.170910 15720 raft_consensus.cc:2243] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.171882 15720 raft_consensus.cc:2272] T e37840a1d83b4fe5be57618ff85b8a47 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.175365 15720 tablet_replica.cc:333] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.179461 15720 raft_consensus.cc:2243] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.180121 15720 raft_consensus.cc:2272] T caf243a747f348a29b25b4642b64788e P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.182593 15720 tablet_replica.cc:333] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.210893 15720 raft_consensus.cc:2243] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.212603 15720 raft_consensus.cc:2272] T 2a9fb47e66dc4499902e4f88e8774c9c P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.222002 15720 tablet_replica.cc:333] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.223140 15720 raft_consensus.cc:2243] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.223805 15720 raft_consensus.cc:2272] T 1555b08c459f47689fc0d1a7cf582a1b P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.226568 15720 tablet_replica.cc:333] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.242246 15720 raft_consensus.cc:2243] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.243065 15720 raft_consensus.cc:2272] T c1b0416e641248ecbd3052388f5edf59 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.248430 17519 raft_consensus.cc:1217] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:20:44.276870 15720 tablet_replica.cc:333] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.281095 15720 raft_consensus.cc:2243] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.282222 15720 raft_consensus.cc:2272] T cd1d35ba148544669e52d7293ac9bd82 P 96eaa6dafb3e4bbe914e54dc12507912 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.292142 15720 tablet_replica.cc:333] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.299151 15720 raft_consensus.cc:2243] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.300449 15720 raft_consensus.cc:2272] T efa1a19816094c78802287ff39e74b62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.390553 15720 tablet_replica.cc:333] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.391381 15720 raft_consensus.cc:2243] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.392045 15720 raft_consensus.cc:2272] T 949d7afc13ea44af96dab1af3a1dd354 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.394711 15720 tablet_replica.cc:333] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.395502 15720 raft_consensus.cc:2243] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.404328 15720 raft_consensus.cc:2272] T a51b55458c5a45c78b6a978ce6a10d31 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.417971 15720 tablet_replica.cc:333] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.418715 15720 raft_consensus.cc:2243] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.419494 15720 raft_consensus.cc:2272] T 168ed6dff4844944aff3337d23ee2950 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.421859 15720 tablet_replica.cc:333] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.422601 15720 raft_consensus.cc:2243] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.423574 15720 raft_consensus.cc:2272] T deabeb68cc1e4f73b9a6b49f9f29da22 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.443864 15720 tablet_replica.cc:333] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.444702 15720 raft_consensus.cc:2243] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.445279 15720 raft_consensus.cc:2272] T 06e6de173e42433e8df1572e54437e03 P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.472200 15720 tablet_replica.cc:333] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.473786 15720 raft_consensus.cc:2243] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.477385 15720 raft_consensus.cc:2272] T 109354c29850459b80f792dad016fc0d P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.480422 15720 tablet_replica.cc:333] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.481355 15720 raft_consensus.cc:2243] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.482013 15720 raft_consensus.cc:2272] T 32f35f41a8f1466fb1831fe03e474c4d P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.484704 15720 tablet_replica.cc:333] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.485482 15720 raft_consensus.cc:2243] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.486403 15720 raft_consensus.cc:2272] T e9f7a2a0447a4956b36d1e9902e62f56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.489171 15720 tablet_replica.cc:333] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.490250 15720 raft_consensus.cc:2243] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.490866 15720 raft_consensus.cc:2272] T 72998e8e2cff40f3be2ce73539159ecf P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.494995 15720 tablet_replica.cc:333] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.495784 15720 raft_consensus.cc:2243] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.496392 15720 raft_consensus.cc:2272] T 3a7411023b914822890ea380b2bf8efc P 96eaa6dafb3e4bbe914e54dc12507912 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.499107 15720 tablet_replica.cc:333] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.499938 15720 raft_consensus.cc:2243] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.506475 15720 raft_consensus.cc:2272] T 57dfb70986d346cdb015b37c0f58dce3 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.509092 15720 tablet_replica.cc:333] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.518118 15720 raft_consensus.cc:2243] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.518711 15720 raft_consensus.cc:2272] T 2e62b3fa7cbf498099f802cfe999bd65 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.521312 15720 tablet_replica.cc:333] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.522094 15720 raft_consensus.cc:2243] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.522966 15720 raft_consensus.cc:2272] T 05d0b0f25f26402cb5f324812a9f12c4 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.537424 15720 tablet_replica.cc:333] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.538096 15720 raft_consensus.cc:2243] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.539022 15720 raft_consensus.cc:2272] T 4c50b9c8ead54558a785ce80fcc5fb62 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.541285 15720 tablet_replica.cc:333] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.541990 15720 raft_consensus.cc:2243] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.542912 15720 raft_consensus.cc:2272] T 406d9b96060f4833ba26879d81f73bdc P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.545430 15720 tablet_replica.cc:333] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.545476 22356 raft_consensus.cc:493] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 599f9a88b6cd4e818a1c59a0b4522480)
I20260709 13:20:44.546284 15720 raft_consensus.cc:2243] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.546130 22356 raft_consensus.cc:515] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:44.546917 15720 raft_consensus.cc:2272] T aa815b919c824fb196befa2fd6eeac35 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.548730 22356 leader_election.cc:290] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:44.550338 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:44.550338 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8b8274145134eaa8f14229eceeca799" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:44.553783 15720 tablet_replica.cc:333] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.559934 15720 raft_consensus.cc:2243] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.561088 15720 raft_consensus.cc:2272] T be49fe28fec04ec88f4f84bc7aa2149f P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.564263 16775 leader_election.cc:304] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:44.565111 22374 raft_consensus.cc:2749] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.568063 15720 tablet_replica.cc:333] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.568946 15720 raft_consensus.cc:2243] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.569541 15720 raft_consensus.cc:2272] T 17115e8a13c346f1998df3bc8f52ec52 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.580000 22356 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:44.580209 15720 tablet_replica.cc:333] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.581259 15720 raft_consensus.cc:2243] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.580818 22356 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:44.582046 15720 raft_consensus.cc:2272] T e60cb274e4a7404ebaf6480f093cdf56 P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.584772 15720 tablet_replica.cc:333] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.584844 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:44.585624 15720 raft_consensus.cc:2243] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.586318 15720 raft_consensus.cc:2272] T 043a927eb1a442999f1930b07d059e8f P 96eaa6dafb3e4bbe914e54dc12507912 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.586724 22356 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:44.588289 22356 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:44.590333 22356 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:44.594910 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:44.588842 15720 tablet_replica.cc:333] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.600481 15720 raft_consensus.cc:2243] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.600852 16775 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:44.601523 15720 raft_consensus.cc:2272] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 96eaa6dafb3e4bbe914e54dc12507912 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.601644 22374 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:44.608078 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:44.610088 22356 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:44.612265 15720 tablet_replica.cc:333] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.613932 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "96eaa6dafb3e4bbe914e54dc12507912" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:44.614523 15720 raft_consensus.cc:2243] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.615180 15720 raft_consensus.cc:2272] T f8b8274145134eaa8f14229eceeca799 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.617803 15720 tablet_replica.cc:333] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.618575 15720 raft_consensus.cc:2243] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.619601 15720 raft_consensus.cc:2272] T d157a8f033dd43d5a5c824d9e6235fe9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.621698 16775 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96eaa6dafb3e4bbe914e54dc12507912; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:44.622236 15720 tablet_replica.cc:333] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.623077 15720 raft_consensus.cc:2243] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.623529 22356 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:44.623833 15720 raft_consensus.cc:2272] T 5e604fa8c1b148ea9842f341b4a2c000 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.630136 15720 tablet_replica.cc:333] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.630894 15720 raft_consensus.cc:2243] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.631536 15720 raft_consensus.cc:2272] T 7e5bdf407d5944728fca8072489ee727 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.633984 15720 tablet_replica.cc:333] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.634684 15720 raft_consensus.cc:2243] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.635264 15720 raft_consensus.cc:2272] T 98d04db01c024df0a2b3bb75c0fcd76f P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.637846 15720 tablet_replica.cc:333] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.638466 15720 raft_consensus.cc:2243] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.638975 15720 raft_consensus.cc:2272] T d757b655f89a468ab8fc0ad2914716b7 P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.661582 22403 raft_consensus.cc:1064] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:20:44.662995 15720 tablet_replica.cc:333] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.663807 15720 raft_consensus.cc:2243] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.664507 15720 raft_consensus.cc:2272] T 6455509d1ac14e1d961f38607a869924 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.665329 22403 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:44.673897 15720 tablet_replica.cc:333] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.674707 15720 raft_consensus.cc:2243] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.675313 15720 raft_consensus.cc:2272] T efdef9f5ee0b4225ba140b5208412fde P 96eaa6dafb3e4bbe914e54dc12507912 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.678025 15720 tablet_replica.cc:333] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.678730 15720 raft_consensus.cc:2243] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.679383 15720 raft_consensus.cc:2272] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 96eaa6dafb3e4bbe914e54dc12507912 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.682463 15720 tablet_replica.cc:333] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.683178 15720 raft_consensus.cc:2243] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.697474 15720 raft_consensus.cc:2272] T 595865d470ea4e5489bcc4699f26ff4a P 96eaa6dafb3e4bbe914e54dc12507912 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.699961 15720 tablet_replica.cc:333] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.700775 15720 raft_consensus.cc:2243] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.701884 15720 raft_consensus.cc:2272] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 96eaa6dafb3e4bbe914e54dc12507912 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.711431 15720 tablet_replica.cc:333] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.712082 15720 raft_consensus.cc:2243] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:44.712819 15720 raft_consensus.cc:2272] T 89c4a22bddc9425886aa0574ae085451 P 96eaa6dafb3e4bbe914e54dc12507912 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.715724 15720 tablet_replica.cc:333] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912: stopping tablet replica
I20260709 13:20:44.731474 15720 raft_consensus.cc:2243] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:20:44.734292 15720 raft_consensus.cc:2272] T efa7919f3d1c40e096823aab461b0e25 P 96eaa6dafb3e4bbe914e54dc12507912 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:44.755420 16955 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:44.756790 22281 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:44.758278 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:20:44.768633 16850 consensus_peers.cc:597] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:44.800451 17519 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:44.810668 22403 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:44.871891 22281 raft_consensus.cc:2955] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:44.885187 16953 raft_consensus.cc:2955] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:44.893824 17519 raft_consensus.cc:2955] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:44.891664 16707 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 9 to 10, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:44.976533 16773 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:45.034833 16884 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.053092 17519 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:45.055415 22403 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:45.057960 16955 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:20:45.059407 22403 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:45.060133 16773 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 49055.7us
I20260709 13:20:45.062587 22399 raft_consensus.cc:2955] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:20:45.065533 16924 connection.cc:573] client connection to 127.15.90.1:46655 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:20:45.067142 17519 raft_consensus.cc:2955] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:45.068481 16955 raft_consensus.cc:2955] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:45.092468 16703 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: config changed from index 10 to 11, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 14 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:45.124997 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e5bdf407d5944728fca8072489ee727 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:45.154331 22368 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.154892 22368 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:45.156872 22368 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:45.188774 22407 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.189325 22407 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.192842 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:45.194120 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:45.191623 22407 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:45.203282 17492 leader_election.cc:336] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.203860 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:45.206097 22406 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:45.211488 22400 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44636 (request call id 1478) took 1348 ms. Trace:
W20260709 13:20:45.211512 16850 leader_election.cc:336] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.212257 16850 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:45.212100 22400 rpcz_store.cc:276] 0709 13:20:43.862972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.863117 (+   145us) service_pool.cc:224] Handling call
0709 13:20:43.912736 (+ 49619us) ts_tablet_manager.cc:934] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
0709 13:20:45.211390 (+1298654us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":259,"tablet-copy.queue_time_us":48811,"thread_start_us":77313,"threads_started":2}
I20260709 13:20:45.213039 22399 raft_consensus.cc:2749] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:45.215238 17491 connection.cc:466] server connection from 127.0.0.1:44636 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44636 (request call id 1478) could send its response
W20260709 13:20:45.232957 16694 catalog_manager.cc:4755] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7e5bdf407d5944728fca8072489ee727: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.235085 22368 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.235626 22368 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:45.237672 22368 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:45.243227 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:45.260164 16850 leader_election.cc:336] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.260689 16850 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:45.261444 22368 raft_consensus.cc:2749] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:45.268481 22390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44636 (request call id 1473) took 1742 ms. Trace:
I20260709 13:20:45.268935 22390 rpcz_store.cc:276] 0709 13:20:43.526457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:20:43.526588 (+   131us) service_pool.cc:224] Handling call
0709 13:20:43.568102 (+ 41514us) ts_tablet_manager.cc:934] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655)
0709 13:20:45.268410 (+1700308us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":19779,"tablet-copy.queue_time_us":33969,"thread_start_us":51354,"threads_started":2}
W20260709 13:20:45.270030 17491 connection.cc:466] server connection from 127.0.0.1:44636 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:44636 (request call id 1473) could send its response
I20260709 13:20:45.276165 22358 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.276695 22358 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.278820 22358 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:45.281863 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:45.285195 16924 leader_election.cc:336] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.285593 16924 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:45.287189 22307 raft_consensus.cc:2749] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:45.354249 22368 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.354796 22368 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.356853 22368 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:45.359812 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:45.363834 16850 leader_election.cc:336] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.364264 16850 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:45.365525 22403 raft_consensus.cc:2749] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:20:45.392063 22406 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.392601 22406 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.395426 22406 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.398202 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:45.398846 16885 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:45.402366 17492 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 
I20260709 13:20:45.406206 22406 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:20:45.406670 22406 raft_consensus.cc:493] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.407621 22406 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:45.407160 17492 leader_election.cc:336] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.418012 22407 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.418526 22407 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.420516 22407 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:45.435899 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:45.436532 16955 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 15.
I20260709 13:20:45.441708 22406 raft_consensus.cc:515] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.449899 17492 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:45.451090 22396 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:45.451476 22396 raft_consensus.cc:493] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.451824 22396 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.452586 22307 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.453094 22307 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.455098 22307 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:45.455940 22372 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.456444 22372 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.458354 22372 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.464061 22406 leader_election.cc:290] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.466352 22396 raft_consensus.cc:515] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.469125 22307 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.475617 22307 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:45.477808 22307 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.479696 22396 leader_election.cc:290] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:45.484516 22307 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.485958 22368 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.486346 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:45.491106 17519 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:45.490985 22368 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.487545 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:45.492043 16885 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 10.
I20260709 13:20:45.493795 22368 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:45.494453 22307 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:45.497053 22307 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:45.498354 16924 leader_election.cc:336] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:45.498852 16850 leader_election.cc:336] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.503539 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe476f65c0445399ab9cd51828acf2f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:45.504078 16884 raft_consensus.cc:3060] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:20:45.507203 17492 leader_election.cc:336] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.509186 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:45.509430 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:45.511862 22297 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:45.512267 22297 raft_consensus.cc:493] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.512622 22297 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:45.515527 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:45.516150 16885 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 7.
I20260709 13:20:45.518254 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa1a19816094c78802287ff39e74b62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:45.518775 16953 raft_consensus.cc:3060] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.519418 16922 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:45.524823 22358 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:45.525200 22358 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.525522 22358 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.528007 22403 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.528513 22403 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.530565 22403 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:45.536805 16850 leader_election.cc:336] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.538666 16884 raft_consensus.cc:2468] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:45.540581 16953 raft_consensus.cc:2468] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 16.
W20260709 13:20:45.542148 16924 leader_election.cc:336] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.547658 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:45.547856 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:45.548225 17492 leader_election.cc:336] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.548336 17523 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 7.
W20260709 13:20:45.548859 17492 leader_election.cc:336] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.549279 22297 raft_consensus.cc:515] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:45.552100 22297 leader_election.cc:290] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.541267 22358 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.561625 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4f36dd72a75406881b100b0ebbaeaff" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:45.562218 16884 raft_consensus.cc:3060] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:45.569912 16884 raft_consensus.cc:2468] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 11.
I20260709 13:20:45.571815 22358 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:45.575052 16924 leader_election.cc:336] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.579641 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:45.581674 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 62437.5us
I20260709 13:20:45.589421 22358 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:20:45.592594 16924 leader_election.cc:304] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:45.593900 22358 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.618464 22358 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:45.617139 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:45.620726 22396 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:45.621083 22396 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.621418 22396 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:45.629777 22422 raft_consensus.cc:2804] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:45.630420 22422 raft_consensus.cc:697] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:45.631342 22422 consensus_queue.cc:237] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:45.643308 16924 leader_election.cc:336] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.637416 22297 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.644016 22297 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.646227 22297 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:45.639536 22358 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.628367 17492 leader_election.cc:304] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:45.648207 22406 raft_consensus.cc:2804] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:20:45.648711 22406 raft_consensus.cc:697] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:45.649521 22406 consensus_queue.cc:237] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.658288 17492 leader_election.cc:304] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:45.633785 22396 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.660898 22407 raft_consensus.cc:2804] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:45.661402 22407 raft_consensus.cc:697] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:45.662274 22407 consensus_queue.cc:237] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.675437 22396 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.676802 16848 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:45.678047 22368 raft_consensus.cc:2749] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:45.679157 16848 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:45.680344 22368 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:20:45.680775 22368 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.681198 22368 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:20:45.683537 22403 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.684062 22403 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.686062 22403 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:45.688393 22403 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.688855 22403 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:45.690743 22403 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:45.691572 17492 leader_election.cc:336] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.693545 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:45.696188 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:45.696851 16884 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
W20260709 13:20:45.697419 16850 leader_election.cc:336] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.702033 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:45.702991 22297 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:45.703374 22297 raft_consensus.cc:493] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.703761 22297 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:45.703974 16924 leader_election.cc:336] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:45.704557 16924 leader_election.cc:336] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:45.711889 16850 leader_election.cc:336] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.712388 16850 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:45.712445 22368 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.713943 22399 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:45.722299 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:45.722981 16885 raft_consensus.cc:2393] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 8: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:45.730994 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37840a1d83b4fe5be57618ff85b8a47" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:45.731572 17523 raft_consensus.cc:3060] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:45.732583 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:45.733861 22307 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.734315 22307 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.739663 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:45.740406 17519 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:45.750278 22407 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.766503 22407 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.768802 22407 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:45.769733 22307 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:45.711105 22297 raft_consensus.cc:515] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:45.733474 22396 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.769102 22368 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:45.789157 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 54712.8us
I20260709 13:20:45.781013 22396 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.798493 16848 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:45.800412 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 60584.7us
I20260709 13:20:45.805682 22297 leader_election.cc:290] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.809079 22403 raft_consensus.cc:2749] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:45.809900 22403 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.810487 22403 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:45.812469 22358 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.813007 22358 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:45.813829 22403 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:45.815078 22358 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.815692 17523 raft_consensus.cc:2468] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 16.
I20260709 13:20:45.820453 22396 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.829062 22429 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.835783 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:45.836540 17523 raft_consensus.cc:2393] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 8: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:45.835954 22429 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:45.836495 16707 catalog_manager.cc:5697] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 10 to 11, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 11 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:45.838882 22429 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.845094 16704 catalog_manager.cc:5697] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 9 to 10, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 10 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:45.856487 16848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 58105.3us
W20260709 13:20:45.859000 17492 leader_election.cc:336] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:45.859079 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 90197.4us
I20260709 13:20:45.859607 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:45.862059 22426 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:45.862739 16922 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:45.864284 22358 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:45.864653 22358 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.864797 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:45.865008 22358 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:45.896399 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:45.897310 16884 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
W20260709 13:20:45.898562 16850 leader_election.cc:336] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.902069 16922 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:45.899220 16850 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:45.904206 17492 leader_election.cc:336] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.904955 22434 raft_consensus.cc:2749] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:20:45.906433 16953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:45.907065 16953 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 13.
I20260709 13:20:45.904978 22431 raft_consensus.cc:2804] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:45.907907 22431 raft_consensus.cc:697] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:45.908694 22431 consensus_queue.cc:237] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:45.904379 16924 leader_election.cc:336] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.912178 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:45.912875 22434 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.914587 22434 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:45.916687 22434 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:45.917029 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc0e6e74a524cd59d8c8341367e62b3" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:45.917539 16885 raft_consensus.cc:3060] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:45.918331 17492 leader_election.cc:336] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:45.920485 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:45.921844 22406 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:20:45.922216 22406 raft_consensus.cc:493] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.922567 22406 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:20:45.924928 16885 raft_consensus.cc:2468] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 16.
I20260709 13:20:45.925071 22358 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.976872 22396 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.977630 16955 raft_consensus.cc:2393] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 15: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:45.977442 22396 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.978068 22358 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:45.925879 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:45.978868 16884 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 17.
I20260709 13:20:45.979460 22396 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:45.926919 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:45.979777 22372 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.980278 16882 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 16.
I20260709 13:20:45.980294 22372 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.982398 22372 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.982999 22431 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.930433 22406 raft_consensus.cc:515] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:45.925715 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:45.985659 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 59980.7us
W20260709 13:20:45.986197 17492 consensus_peers.cc:597] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:45.983924 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 46275.4us
I20260709 13:20:45.983512 22431 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:45.991089 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:45.991737 22403 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.991740 16955 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 16.
I20260709 13:20:45.992436 22403 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:45.991849 22297 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.993611 22297 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.988585 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:45.995134 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:45.995659 22307 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:45.995256 22403 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:45.996009 16924 leader_election.cc:304] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:45.996212 22307 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.996793 22426 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:45.997694 22431 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:45.996212 22429 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:45.995736 22297 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:45.997428 22426 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:45.996949 22307 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:45.998155 22406 leader_election.cc:290] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:46.002270 22422 raft_consensus.cc:2804] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:46.000367 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:46.012512 16955 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:46.013899 22422 raft_consensus.cc:697] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:46.011394 22429 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:46.014948 22422 consensus_queue.cc:237] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:46.010747 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:46.015630 22429 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.016187 22403 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:46.016598 22403 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:46.016974 22403 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:46.017673 22426 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:46.010411 16924 leader_election.cc:336] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.019922 16924 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:46.020728 22297 raft_consensus.cc:2749] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:20:46.022711 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:46.022859 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:46.025975 22436 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:20:46.027421 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:46.028499 22307 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:46.029150 17523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157a8f033dd43d5a5c824d9e6235fe9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:46.029470 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:46.030054 17526 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 12.
W20260709 13:20:46.032799 16850 leader_election.cc:336] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.026355 22436 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:46.028234 22396 raft_consensus.cc:3060] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:46.035893 22425 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:46.059340 22307 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:46.059523 22436 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:20:46.059778 22425 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:46.064786 22425 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.069077 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:46.069733 16882 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
W20260709 13:20:46.070598 16924 leader_election.cc:336] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:46.071346 16924 leader_election.cc:336] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:46.071997 16924 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.074368 22436 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:46.076519 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deabeb68cc1e4f73b9a6b49f9f29da22" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:46.080056 16882 raft_consensus.cc:3060] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:46.083467 22429 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:46.086587 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:46.087330 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:46.087929 16957 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:46.091737 16885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d9b96060f4833ba26879d81f73bdc" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:46.091753 16882 raft_consensus.cc:2468] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 18.
I20260709 13:20:46.092486 16885 raft_consensus.cc:3060] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:20:46.093312 16924 leader_election.cc:336] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:46.093827 16924 leader_election.cc:336] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.091893 22297 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:20:46.094242 17492 leader_election.cc:336] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.094554 22297 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:46.094882 22297 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:46.095911 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:46.096498 16880 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
W20260709 13:20:46.098327 16850 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:46.094252 16924 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:46.094870 17492 leader_election.cc:336] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:46.100011 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.100605 16924 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:46.098685 16922 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:46.104260 16885 raft_consensus.cc:2468] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:46.108093 22297 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:20:46.111477 17492 leader_election.cc:336] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:46.111965 17492 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.112910 22428 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:46.113056 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:46.113425 22428 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:46.113685 16954 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 10.
I20260709 13:20:46.114008 22428 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.114524 22297 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:46.121265 15720 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16831)
W20260709 13:20:46.122800 16924 leader_election.cc:336] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.129534 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:46.130268 16880 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:46.135146 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:46.136312 22406 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:20:46.136986 22406 raft_consensus.cc:493] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:46.137516 22406 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:46.108186 22431 raft_consensus.cc:2804] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:46.140246 22431 raft_consensus.cc:697] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:46.141455 22431 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:46.165272 22406 raft_consensus.cc:515] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:46.172955 22406 leader_election.cc:290] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:46.170383 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:46.173825 22436 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:46.175223 22425 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:46.176095 17492 leader_election.cc:336] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.178583 22425 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:46.180917 16880 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:46.110616 22403 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:46.184223 22403 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:46.185933 22428 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:46.187801 22406 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:46.188846 22406 raft_consensus.cc:493] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 96eaa6dafb3e4bbe914e54dc12507912)
I20260709 13:20:46.189317 22406 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.187903 22428 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:46.193725 22429 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:46.194512 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 84489.3us
I20260709 13:20:46.195334 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
W20260709 13:20:46.195953 16924 consensus_peers.cc:597] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.196478 16924 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.196580 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f6df2c313bf4b0a8bb4d3b4422f4da1" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:46.197106 16954 raft_consensus.cc:3060] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:20:46.199156 22436 raft_consensus.cc:2764] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:20:46.200418 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:46.201146 16950 raft_consensus.cc:2393] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 13: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:46.202692 16882 raft_consensus.cc:1275] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:20:46.207696 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:46.208230 16882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:46.208884 16882 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 17: Already voted for candidate 4b60b701acc7473e87e3e529a2a34689 in this term.
I20260709 13:20:46.209689 22307 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:46.210148 22307 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
W20260709 13:20:46.210937 16924 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.210894 22307 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:46.212394 16950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:46.214272 16950 raft_consensus.cc:2393] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4b60b701acc7473e87e3e529a2a34689 in current term 17: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:46.213680 16955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dfb70986d346cdb015b37c0f58dce3" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:46.214913 16955 raft_consensus.cc:3060] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:46.213394 16882 raft_consensus.cc:1275] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:20:46.220242 22396 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:46.223321 16954 raft_consensus.cc:2468] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 11.
I20260709 13:20:46.225672 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:46.226744 17523 raft_consensus.cc:2468] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:46.226823 16955 raft_consensus.cc:2468] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 14.
I20260709 13:20:46.228397 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:46.229250 17526 raft_consensus.cc:2393] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 13: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:46.230760 22358 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:46.235093 16850 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.240432 22358 consensus_queue.cc:1048] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:20:46.243709 17492 leader_election.cc:304] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:46.269658 16924 leader_election.cc:336] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:46.270210 16924 consensus_peers.cc:597] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.273425 16850 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:46.274577 22399 raft_consensus.cc:2804] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:46.275079 22426 consensus_queue.cc:1048] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:46.275204 22399 raft_consensus.cc:697] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:46.276444 22425 raft_consensus.cc:2804] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:20:46.278543 17492 leader_election.cc:304] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:46.281967 16922 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:46.285302 16922 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:46.287693 22399 consensus_queue.cc:237] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:46.284049 22372 raft_consensus.cc:2804] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:20:46.288185 22307 raft_consensus.cc:2804] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:46.291178 22307 raft_consensus.cc:697] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:46.284192 22425 raft_consensus.cc:697] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:46.295935 22425 consensus_queue.cc:237] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:46.296623 22372 raft_consensus.cc:697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:46.297538 22372 consensus_queue.cc:237] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:46.308559 22307 consensus_queue.cc:237] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:46.307602 16703 catalog_manager.cc:5697] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 15 to 16, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 16 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:46.311833 16703 catalog_manager.cc:5697] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 15 to 16, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 16 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.313299 16703 catalog_manager.cc:5697] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 17 to 18, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 18 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:46.316262 16850 consensus_peers.cc:597] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.316735 16850 consensus_peers.cc:597] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.317090 16850 consensus_peers.cc:597] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.318383 16850 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.318701 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:46.286454 22431 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:20:46.314756 16703 catalog_manager.cc:5697] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 14 to 15, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 15 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:46.343410 16850 leader_election.cc:336] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:46.348189 16850 consensus_peers.cc:597] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.353119 22442 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:20:46.360772 16924 consensus_peers.cc:597] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.381075 16850 consensus_peers.cc:597] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.381722 16850 consensus_peers.cc:597] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.393882 16850 consensus_peers.cc:597] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.398162 16924 consensus_peers.cc:597] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.406302 16850 consensus_peers.cc:597] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.417667 16924 consensus_peers.cc:597] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.421033 17492 leader_election.cc:336] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:46.422086 17492 leader_election.cc:336] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.422856 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:46.438508 16704 catalog_manager.cc:5697] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 15 to 16, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 16 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.440644 16704 catalog_manager.cc:5697] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 11 to 12, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 12 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.442317 16704 catalog_manager.cc:5697] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 10 to 11, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 11 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.430841 22425 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:20:46.534425 16924 consensus_peers.cc:597] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.535141 16924 consensus_peers.cc:597] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.540225 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 87155us
W20260709 13:20:46.554723 17492 consensus_peers.cc:597] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.556057 16954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34326
I20260709 13:20:46.559476 16954 raft_consensus.cc:606] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Received request to transfer leadership
W20260709 13:20:46.563731 22412 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:20:46.567579 16703 catalog_manager.cc:5697] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 13 to 14, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 14 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:46.567835 22446 log.cc:927] Time spent T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:20:46.582652 22406 raft_consensus.cc:515] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:46.585616 16950 raft_consensus.cc:1275] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:20:46.585834 16954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34326
I20260709 13:20:46.586397 16954 raft_consensus.cc:606] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Received request to transfer leadership
I20260709 13:20:46.588666 22406 leader_election.cc:290] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:46.605942 16924 consensus_peers.cc:597] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.606542 16924 consensus_peers.cc:597] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.609357 16924 consensus_peers.cc:597] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.612761 16924 consensus_peers.cc:597] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.613216 16924 consensus_peers.cc:597] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.614607 16882 raft_consensus.cc:1275] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:20:46.615362 17492 consensus_peers.cc:597] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.616111 22454 consensus_queue.cc:1048] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:46.616346 16707 catalog_manager.cc:5697] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 14 to 15, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 15 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:46.617774 22460 log.cc:927] Time spent T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:20:46.621311 16850 consensus_peers.cc:597] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.617029 17492 consensus_peers.cc:597] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.633074 16880 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:46.638176 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c50b9c8ead54558a785ce80fcc5fb62" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:46.638770 16884 raft_consensus.cc:3060] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:46.649776 16884 raft_consensus.cc:2468] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:46.651832 22358 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:46.656993 16924 consensus_peers.cc:597] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.659906 17526 raft_consensus.cc:1275] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:20:46.660086 17492 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.660712 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.661052 17492 leader_election.cc:336] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.661767 22456 consensus_queue.cc:1048] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:46.670477 16694 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 74635.2us
I20260709 13:20:46.676677 17492 leader_election.cc:304] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:46.680271 22456 raft_consensus.cc:2804] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:46.680799 22456 raft_consensus.cc:697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
W20260709 13:20:46.685604 16694 catalog_manager.cc:4755] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7e5bdf407d5944728fca8072489ee727: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.681660 22456 consensus_queue.cc:237] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:46.688868 16922 consensus_peers.cc:597] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be49fe28fec04ec88f4f84bc7aa2149f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.689692 22422 consensus_queue.cc:1048] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:20:46.692628 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.702944 16924 consensus_peers.cc:597] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.704563 16954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34326
I20260709 13:20:46.705332 16954 raft_consensus.cc:606] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Received request to transfer leadership
I20260709 13:20:46.725955 16707 catalog_manager.cc:5697] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 12 to 13, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 13 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:46.727967 16756 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:20:46.732272 16756 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for be49fe28fec04ec88f4f84bc7aa2149f already in progress
W20260709 13:20:46.732558 16756 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for be49fe28fec04ec88f4f84bc7aa2149f already in progress
W20260709 13:20:46.758018 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.772457 16957 raft_consensus.cc:1275] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:20:46.775337 16924 consensus_peers.cc:597] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.775240 22368 consensus_queue.cc:1048] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:20:46.786113 17523 raft_consensus.cc:1275] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:46.788681 22457 consensus_queue.cc:1048] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:20:46.790505 22422 raft_consensus.cc:993] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:46.791105 22453 raft_consensus.cc:1081] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:46.795424 16884 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:20:46.797089 16924 consensus_peers.cc:597] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:46.797555 16924 consensus_peers.cc:597] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.804862 16884 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:20:46.805408 16884 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.805766 16884 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:46.817721 16850 consensus_peers.cc:597] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.819610 16884 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:20:46.820817 17492 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.825290 22454 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:46.824869 16884 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:46.833933 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:46.834487 16954 raft_consensus.cc:3055] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:20:46.834787 16954 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:46.835536 16954 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:46.836894 16954 raft_consensus.cc:3060] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:46.836920 16850 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:46.846267 16954 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 16.
I20260709 13:20:46.865516 16850 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:46.866307 22368 raft_consensus.cc:2804] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:46.866869 22368 raft_consensus.cc:697] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 16 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:46.867815 22368 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:46.892498 16954 raft_consensus.cc:1275] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:20:46.900487 17492 consensus_peers.cc:597] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:46.916704 22448 consensus_queue.cc:1048] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:20:46.923578 16882 raft_consensus.cc:1275] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:20:46.919699 16704 catalog_manager.cc:5697] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 15 to 16, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 16 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:46.943897 16924 consensus_peers.cc:597] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:46.952715 17492 consensus_peers.cc:597] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:46.998397 22448 consensus_queue.cc:1048] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:47.047092 17492 consensus_peers.cc:597] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:47.121692 15720 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16831)
I20260709 13:20:47.138355 16884 raft_consensus.cc:1275] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:47.142243 22458 consensus_queue.cc:1048] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:47.276862 17492 consensus_peers.cc:597] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:47.312270 16848 consensus_peers.cc:597] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be49fe28fec04ec88f4f84bc7aa2149f. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:47.386952 16850 consensus_peers.cc:597] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:47.426636 16957 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:20:47.431243 22368 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:47.795921 22476 ts_tablet_manager.cc:933] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:47.816797 22476 tablet_copy_client.cc:323] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
W20260709 13:20:47.823438 16694 catalog_manager.cc:4755] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7e5bdf407d5944728fca8072489ee727: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:47.826938 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet be49fe28fec04ec88f4f84bc7aa2149f from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:20:47.827579 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet be49fe28fec04ec88f4f84bc7aa2149f from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-be49fe28fec04ec88f4f84bc7aa2149f
I20260709 13:20:47.837692 16895 tablet_copy_source_session.cc:215] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:47.868116 22476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be49fe28fec04ec88f4f84bc7aa2149f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:47.975822 22454 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:47.977568 22454 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:47.986619 22476 tablet_copy_client.cc:806] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:48.040676 22433 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.041517 22433 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:48.045313 22454 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:47.989689 22476 tablet_copy_client.cc:670] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:48.082338 22433 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:48.122354 15720 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 16831)
W20260709 13:20:48.137897 16924 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:48.155860 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:48.157039 16884 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 8.
W20260709 13:20:48.160355 17492 leader_election.cc:336] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:48.162374 22476 tablet_copy_client.cc:538] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:48.200273 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689" is_pre_election: true
I20260709 13:20:48.201231 16880 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 17.
I20260709 13:20:48.255129 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:48.256166 22433 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:20:48.256589 22433 raft_consensus.cc:493] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.256940 22433 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:48.269968 22433 raft_consensus.cc:515] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:48.272090 22433 leader_election.cc:290] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:48.278654 22476 tablet_bootstrap.cc:492] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:20:48.282651 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 96eaa6dafb3e4bbe914e54dc12507912
W20260709 13:20:48.281872 16850 consensus_peers.cc:597] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.283886 22487 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:20:48.284299 22487 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.284641 22487 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:20:48.302909 22487 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:48.308718 16880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1d35ba148544669e52d7293ac9bd82" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:48.312057 16880 raft_consensus.cc:3060] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:20:48.332569 22487 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:48.354259 16880 raft_consensus.cc:2468] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 9.
I20260709 13:20:48.359604 16884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
I20260709 13:20:48.360296 16884 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:20:48.363889 17492 leader_election.cc:336] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:48.364526 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.367664 17492 leader_election.cc:304] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:48.368531 22448 raft_consensus.cc:2804] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:20:48.369012 22448 raft_consensus.cc:697] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:48.370008 22448 consensus_queue.cc:237] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:48.373546 16884 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 18.
I20260709 13:20:48.400837 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:48.407894 22454 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:20:48.408502 22454 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:48.409704 22454 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:20:48.419317 16924 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:48.434423 16705 catalog_manager.cc:5697] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 7 to 9, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 9 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:48.441768 16704 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 16 to 18, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 18 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:48.454331 22454 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:48.458820 22454 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:48.464212 22454 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:48.465440 17520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:48.466149 17520 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:48.468580 16922 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:48.472342 22454 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:48.486781 22454 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:48.487110 22454 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:20:48.502827 17492 consensus_peers.cc:597] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:48.512567 16924 leader_election.cc:336] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:48.539014 16850 consensus_peers.cc:597] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.572091 22454 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:48.573433 17492 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111) [suppressed 427 similar messages]
I20260709 13:20:48.574559 22454 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:48.576633 17526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7919f3d1c40e096823aab461b0e25" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:48.577167 17526 raft_consensus.cc:3060] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:48.587229 17526 raft_consensus.cc:2468] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:48.588857 16922 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:48.589680 22454 raft_consensus.cc:2804] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:20:48.590196 22454 raft_consensus.cc:697] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:48.591143 22454 consensus_queue.cc:237] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:48.593876 16924 leader_election.cc:336] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:48.651618 16850 consensus_peers.cc:597] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:48.652786 16924 consensus_peers.cc:597] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.658135 16952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34326
I20260709 13:20:48.658910 16952 raft_consensus.cc:606] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Received request to transfer leadership
I20260709 13:20:48.670542 16952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34326
I20260709 13:20:48.671104 16952 raft_consensus.cc:606] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Received request to transfer leadership
W20260709 13:20:48.675951 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:48.683831 16924 consensus_peers.cc:597] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.684747 16952 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9"
dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34326
I20260709 13:20:48.692049 16952 raft_consensus.cc:606] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Received request to transfer leadership
I20260709 13:20:48.690877 22476 tablet_bootstrap.cc:492] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:48.697321 22476 tablet_bootstrap.cc:492] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:20:48.698051 22476 ts_tablet_manager.cc:1403] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.420s	user 0.055s	sys 0.022s
W20260709 13:20:48.706182 16924 consensus_peers.cc:597] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:48.707506 16756 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:20:48.707926 16756 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 1d5fe95d8fc442c7ad6fda1ba72b8ea9 already in progress
W20260709 13:20:48.708194 16756 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 1d5fe95d8fc442c7ad6fda1ba72b8ea9 already in progress
W20260709 13:20:48.718302 16924 consensus_peers.cc:597] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:48.719223 17492 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.724252 22476 raft_consensus.cc:359] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:48.725163 22476 raft_consensus.cc:740] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:20:48.725940 22476 consensus_queue.cc:260] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:20:48.733742 16850 consensus_peers.cc:597] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.731976 16705 catalog_manager.cc:5697] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 12 to 14, leader changed from 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 14 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:48.752947 22476 ts_tablet_manager.cc:1434] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.001s
I20260709 13:20:48.756562 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-be49fe28fec04ec88f4f84bc7aa2149f received from {username='slave'} at 127.0.0.1:42010
I20260709 13:20:48.757006 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-be49fe28fec04ec88f4f84bc7aa2149f on tablet be49fe28fec04ec88f4f84bc7aa2149f with peer 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:20:48.758574 17492 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:48.792937 16924 consensus_peers.cc:597] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:48.794149 17492 consensus_peers.cc:597] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:48.832267 16850 consensus_peers.cc:597] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.868022 17520 raft_consensus.cc:1217] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 LEARNER]: Deduplicated request from leader. Original: 15.12->[16.13-16.13]   Dedup: 16.13->[]
W20260709 13:20:48.895031 16924 consensus_peers.cc:597] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.905771 16882 raft_consensus.cc:1275] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:20:48.907357 22484 consensus_queue.cc:1048] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:20:48.937197 17492 consensus_peers.cc:597] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:48.957348 16850 consensus_peers.cc:597] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:48.988183 16924 consensus_peers.cc:597] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:48.997699 16882 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:20:48.999271 22454 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:49.020072 16922 consensus_peers.cc:597] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d5fe95d8fc442c7ad6fda1ba72b8ea9. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:49.022306 16850 consensus_peers.cc:597] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.024433 16924 consensus_peers.cc:597] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.025082 16924 consensus_peers.cc:597] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.033645 17492 consensus_peers.cc:597] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:49.075603 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:49.076467 22454 raft_consensus.cc:993] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: : Instructing follower 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:49.076979 22454 raft_consensus.cc:1081] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Signalling peer 4b60b701acc7473e87e3e529a2a34689 to start an election
I20260709 13:20:49.079807 16880 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9"
dest_uuid: "4b60b701acc7473e87e3e529a2a34689"
 from {username='slave'} at 127.0.0.1:44078
I20260709 13:20:49.080399 16880 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:49.080719 16880 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:49.103543 16880 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:49.108700 16882 raft_consensus.cc:1240] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 19 FOLLOWER]: Rejecting Update request from peer ca1b60a074dc47cd8e68cc57a33a94a3 for earlier term 18. Current term is 19. Ops: []
W20260709 13:20:49.105963 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.114310 16924 consensus_peers.cc:597] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:49.115978 16880 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 19 election: Requested vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:49.117002 16952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "4b60b701acc7473e87e3e529a2a34689" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:49.117624 16952 raft_consensus.cc:3055] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:20:49.117954 16952 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:49.118717 16952 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:49.121430 16952 raft_consensus.cc:3060] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:20:49.122916 15720 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 16831)
W20260709 13:20:49.129912 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.136538 16924 consensus_peers.cc:597] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:49.139305 16952 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b60b701acc7473e87e3e529a2a34689 in term 19.
I20260709 13:20:49.140676 16850 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:49.141764 22368 raft_consensus.cc:2804] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:49.142217 22368 raft_consensus.cc:697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 19 LEADER]: Becoming Leader. State: Replica: 4b60b701acc7473e87e3e529a2a34689, State: Running, Role: LEADER
I20260709 13:20:49.143163 22368 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:20:49.144853 16924 consensus_peers.cc:597] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:49.159194 16704 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: term changed from 18 to 19, leader changed from ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3) to 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2). New cstate: current_term: 19 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:49.173682 16924 consensus_peers.cc:597] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:49.179252 16924 consensus_peers.cc:597] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:49.211589 17520 raft_consensus.cc:1275] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:20:49.215145 22307 consensus_queue.cc:1048] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:20:49.222354 16924 consensus_peers.cc:597] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.303507 17492 consensus_peers.cc:597] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.315698 17492 consensus_peers.cc:597] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:49.334815 16924 consensus_peers.cc:597] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.343416 16924 consensus_peers.cc:597] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:49.345247 16924 consensus_peers.cc:597] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:49.346771 22499 raft_consensus.cc:1064] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:20:49.350739 22499 consensus_queue.cc:237] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 12, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:49.370611 16957 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:49.373039 17521 raft_consensus.cc:1275] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:49.373134 22442 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:20:49.374553 22368 consensus_queue.cc:1048] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:20:49.415076 22499 raft_consensus.cc:2955] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 11 to 14, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:49.417861 17521 raft_consensus.cc:2955] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 11 to 14, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:49.436064 16957 raft_consensus.cc:2955] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 11 to 14, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:49.444139 16704 catalog_manager.cc:5697] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 11 to 14, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:49.550220 17492 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:49.567188 17492 consensus_peers.cc:597] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:49.610073 16924 consensus_peers.cc:597] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:49.633323 16848 consensus_peers.cc:597] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d5fe95d8fc442c7ad6fda1ba72b8ea9. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:49.639890 17492 consensus_peers.cc:597] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:49.654004 16957 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:49.659119 22499 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:49.737913 16922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:35369, user_credentials={real_user=slave}} blocked reactor thread for 69848.3us
W20260709 13:20:49.865296 17492 consensus_peers.cc:597] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:49.933549 16694 catalog_manager.cc:4755] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7e5bdf407d5944728fca8072489ee727: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:50.065065 22518 ts_tablet_manager.cc:933] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:50.086058 22518 tablet_copy_client.cc:323] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:20:50.102226 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:20:50.102743 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-1d5fe95d8fc442c7ad6fda1ba72b8ea9
W20260709 13:20:50.103804 16850 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:50.104710 16850 consensus_peers.cc:597] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:50.105113 16850 consensus_peers.cc:597] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:50.105569 16850 consensus_peers.cc:597] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.105979 16850 consensus_peers.cc:597] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:50.106472 16850 consensus_peers.cc:597] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.115156 16895 tablet_copy_source_session.cc:215] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:20:50.123345 15720 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 16831)
I20260709 13:20:50.125159 16880 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:50.129062 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:20:50.160807 16848 consensus_peers.cc:597] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8abf86e7719a4c7bae84b69e92b761bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.176913 16957 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:20:50.187382 22518 tablet_copy_client.cc:806] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:50.188032 22518 tablet_copy_client.cc:670] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:50.190552 22368 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:50.214015 16850 consensus_peers.cc:597] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.225265 22518 tablet_copy_client.cc:538] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:50.233662 22368 raft_consensus.cc:2955] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 19 LEADER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:50.236743 22518 tablet_bootstrap.cc:492] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:20:50.254756 16880 consensus_queue.cc:237] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:50.256433 16957 raft_consensus.cc:2955] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Committing config change with OpId 19.11: config changed from index -1 to 11, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:50.262004 16707 catalog_manager.cc:5697] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index -1 to 11, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 19 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:50.289108 16848 consensus_peers.cc:597] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6455509d1ac14e1d961f38607a869924. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.291638 16957 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:20:50.303038 22368 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:20:50.329862 16850 consensus_peers.cc:597] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.368880 22514 raft_consensus.cc:2955] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:50.374611 16952 raft_consensus.cc:2955] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:50.393731 16705 catalog_manager.cc:5697] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index -1 to 10, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 12 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:50.421373 16882 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:20:50.493664 16848 consensus_peers.cc:597] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2bff4b982e59440089e2d3d5b8ada66f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.495148 22518 tablet_bootstrap.cc:492] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=2 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:50.495326 16957 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:20:50.496192 22518 tablet_bootstrap.cc:492] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:20:50.499079 22514 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:20:50.496975 22518 ts_tablet_manager.cc:1403] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.260s	user 0.037s	sys 0.012s
I20260709 13:20:50.513819 22518 raft_consensus.cc:359] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:50.514657 22518 raft_consensus.cc:740] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
W20260709 13:20:50.518834 16850 consensus_peers.cc:597] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.515370 22518 consensus_queue.cc:260] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:50.526731 22499 raft_consensus.cc:2955] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:50.532648 16957 raft_consensus.cc:2955] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:50.534515 22518 ts_tablet_manager.cc:1434] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:20:50.552356 16952 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:50.554059 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-1d5fe95d8fc442c7ad6fda1ba72b8ea9 received from {username='slave'} at 127.0.0.1:42010
I20260709 13:20:50.554458 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-1d5fe95d8fc442c7ad6fda1ba72b8ea9 on tablet 1d5fe95d8fc442c7ad6fda1ba72b8ea9 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:50.596349 16707 catalog_manager.cc:5697] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index -1 to 10, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 15 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.600634 16882 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:20:50.603598 22529 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:20:50.613729 17521 raft_consensus.cc:1217] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 LEARNER]: Deduplicated request from leader. Original: 18.11->[19.12-19.12]   Dedup: 19.12->[]
W20260709 13:20:50.627599 16922 consensus_peers.cc:597] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369): Couldn't send request to peer 599f9a88b6cd4e818a1c59a0b4522480. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: deabeb68cc1e4f73b9a6b49f9f29da22. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:50.655740 16924 consensus_peers.cc:597] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:50.659520 22518 ts_tablet_manager.cc:933] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:50.660740 22531 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.053s	user 0.018s	sys 0.012s
W20260709 13:20:50.663892 22492 log.cc:927] Time spent T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: Append to log took a long time: real 0.061s	user 0.004s	sys 0.009s
W20260709 13:20:50.665874 22532 log.cc:927] Time spent T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:20:50.671566 22454 raft_consensus.cc:2955] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index -1 to 15, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:50.676743 22518 tablet_copy_client.cc:323] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:20:50.678997 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 8abf86e7719a4c7bae84b69e92b761bb from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:20:50.679472 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 8abf86e7719a4c7bae84b69e92b761bb from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-8abf86e7719a4c7bae84b69e92b761bb
I20260709 13:20:50.685292 16882 raft_consensus.cc:2955] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index -1 to 15, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
I20260709 13:20:50.697609 16895 tablet_copy_source_session.cc:215] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:50.713179 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8abf86e7719a4c7bae84b69e92b761bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.722879 16704 catalog_manager.cc:5697] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index -1 to 15, NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) added. New cstate: current_term: 18 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } } }
W20260709 13:20:50.726162 16906 debug-util.cc:398] Leaking SignalData structure 0x7b080010f3a0 after lost signal to thread 15723
W20260709 13:20:50.727324 16906 debug-util.cc:398] Leaking SignalData structure 0x7b0800316ae0 after lost signal to thread 16742
W20260709 13:20:50.728695 16906 debug-util.cc:398] Leaking SignalData structure 0x7b0800038e20 after lost signal to thread 16909
W20260709 13:20:50.729858 16906 debug-util.cc:398] Leaking SignalData structure 0x7b080011d9a0 after lost signal to thread 16983
W20260709 13:20:50.731051 16906 debug-util.cc:398] Leaking SignalData structure 0x7b080037a680 after lost signal to thread 17551
I20260709 13:20:50.776937 22535 ts_tablet_manager.cc:933] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:50.818670 22535 tablet_copy_client.cc:323] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:20:50.820300 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 6455509d1ac14e1d961f38607a869924 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:20:50.820798 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 6455509d1ac14e1d961f38607a869924 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-6455509d1ac14e1d961f38607a869924
I20260709 13:20:50.835292 16895 tablet_copy_source_session.cc:215] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:50.841988 22535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6455509d1ac14e1d961f38607a869924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.837728 22518 tablet_copy_client.cc:806] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:50.844049 22518 tablet_copy_client.cc:670] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:50.858599 22518 tablet_copy_client.cc:538] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:50.890556 22535 tablet_copy_client.cc:806] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
W20260709 13:20:50.901895 16924 consensus_peers.cc:597] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:50.891278 22535 tablet_copy_client.cc:670] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:50.907958 22518 tablet_bootstrap.cc:492] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:20:50.908704 22535 tablet_copy_client.cc:538] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:50.933681 22537 ts_tablet_manager.cc:933] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:50.960023 22535 tablet_bootstrap.cc:492] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:20:50.966218 22537 tablet_copy_client.cc:323] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.2:33931
I20260709 13:20:50.968005 16895 tablet_copy_service.cc:140] P 4b60b701acc7473e87e3e529a2a34689: Received BeginTabletCopySession request for tablet 2bff4b982e59440089e2d3d5b8ada66f from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:42010)
I20260709 13:20:50.989738 16895 tablet_copy_service.cc:161] P 4b60b701acc7473e87e3e529a2a34689: Beginning new tablet copy session on tablet 2bff4b982e59440089e2d3d5b8ada66f from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:42010: session id = 599f9a88b6cd4e818a1c59a0b4522480-2bff4b982e59440089e2d3d5b8ada66f
I20260709 13:20:50.997053 22368 raft_consensus.cc:1064] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:20:51.002732 22368 consensus_queue.cc:237] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:51.024593 16895 tablet_copy_source_session.cc:215] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:20:51.061110 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 60356.4us
I20260709 13:20:51.068887 22537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bff4b982e59440089e2d3d5b8ada66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:51.092088 16952 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:51.099359 22499 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:20:51.124162 15720 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 16831)
W20260709 13:20:51.127215 16850 consensus_peers.cc:597] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:51.143834 22518 tablet_bootstrap.cc:492] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:51.148636 22518 tablet_bootstrap.cc:492] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:20:51.149354 22518 ts_tablet_manager.cc:1403] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.242s	user 0.037s	sys 0.017s
I20260709 13:20:51.152587 22518 raft_consensus.cc:359] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:51.153297 22518 raft_consensus.cc:740] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:20:51.170742 22537 tablet_copy_client.cc:806] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:51.153895 22518 consensus_queue.cc:260] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:51.175412 22518 ts_tablet_manager.cc:1434] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
W20260709 13:20:51.188272 16924 consensus_peers.cc:597] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:51.188788 16924 consensus_peers.cc:597] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:51.171576 22537 tablet_copy_client.cc:670] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
W20260709 13:20:51.216637 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 121197us
I20260709 13:20:51.227450 16895 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-8abf86e7719a4c7bae84b69e92b761bb received from {username='slave'} at 127.0.0.1:42010
I20260709 13:20:51.227979 16895 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-8abf86e7719a4c7bae84b69e92b761bb on tablet 8abf86e7719a4c7bae84b69e92b761bb with peer 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:20:51.231118 16924 consensus_peers.cc:597] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:51.242991 22518 ts_tablet_manager.cc:933] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480: Initiating tablet copy from peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:51.243791 22535 tablet_bootstrap.cc:492] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:51.253794 17526 raft_consensus.cc:1275] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:20:51.256949 22535 tablet_bootstrap.cc:492] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:20:51.257802 22535 ts_tablet_manager.cc:1403] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.298s	user 0.032s	sys 0.014s
I20260709 13:20:51.259853 22518 tablet_copy_client.cc:323] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Beginning tablet copy session from remote peer at address 127.15.90.3:33725
I20260709 13:20:51.259933 22537 tablet_copy_client.cc:538] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:20:51.271438 22537 tablet_bootstrap.cc:492] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
I20260709 13:20:51.291989 17519 raft_consensus.cc:1217] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.10->[19.11-19.11]   Dedup: 19.11->[]
I20260709 13:20:51.297066 22535 raft_consensus.cc:359] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:51.298292 22535 raft_consensus.cc:740] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
W20260709 13:20:51.312031 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:51.312616 22535 consensus_queue.cc:260] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:51.316857 22535 ts_tablet_manager.cc:1434] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:20:51.378096 22511 consensus_queue.cc:1048] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:20:51.390558 16969 tablet_copy_service.cc:140] P ca1b60a074dc47cd8e68cc57a33a94a3: Received BeginTabletCopySession request for tablet deabeb68cc1e4f73b9a6b49f9f29da22 from peer 599f9a88b6cd4e818a1c59a0b4522480 ({username='slave'} at 127.0.0.1:48222)
I20260709 13:20:51.391130 16969 tablet_copy_service.cc:161] P ca1b60a074dc47cd8e68cc57a33a94a3: Beginning new tablet copy session on tablet deabeb68cc1e4f73b9a6b49f9f29da22 from peer 599f9a88b6cd4e818a1c59a0b4522480 at {username='slave'} at 127.0.0.1:48222: session id = 599f9a88b6cd4e818a1c59a0b4522480-deabeb68cc1e4f73b9a6b49f9f29da22
I20260709 13:20:51.399477 16969 tablet_copy_source_session.cc:215] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:20:51.423048 22518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deabeb68cc1e4f73b9a6b49f9f29da22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:51.441219 16894 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-6455509d1ac14e1d961f38607a869924 received from {username='slave'} at 127.0.0.1:42010
I20260709 13:20:51.441745 16894 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-6455509d1ac14e1d961f38607a869924 on tablet 6455509d1ac14e1d961f38607a869924 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:51.460141 22518 tablet_copy_client.cc:806] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 0 data blocks...
I20260709 13:20:51.460850 22518 tablet_copy_client.cc:670] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Starting download of 1 WAL segments...
I20260709 13:20:51.478514 22537 tablet_bootstrap.cc:492] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:51.496538 22537 tablet_bootstrap.cc:492] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:20:51.497363 22537 ts_tablet_manager.cc:1403] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.226s	user 0.040s	sys 0.006s
I20260709 13:20:51.506675 22537 raft_consensus.cc:359] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:51.507588 22537 raft_consensus.cc:740] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:20:51.508800 22537 consensus_queue.cc:260] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:20:51.516813 16850 consensus_peers.cc:597] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:51.520907 22537 ts_tablet_manager.cc:1434] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:20:51.559257 17519 raft_consensus.cc:1217] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
W20260709 13:20:51.585335 16924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33931, user_credentials={real_user=slave}} blocked reactor thread for 79778.1us
W20260709 13:20:51.739435 16924 consensus_peers.cc:597] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:51.740160 16924 consensus_peers.cc:597] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:51.740648 16924 consensus_peers.cc:597] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:51.741106 16924 consensus_peers.cc:597] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:51.741828 16924 consensus_peers.cc:597] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:51.746557 22499 raft_consensus.cc:2955] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 10 to 13, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:51.779922 22368 raft_consensus.cc:1064] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:20:51.785796 22368 consensus_queue.cc:237] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 9, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:51.792994 16894 tablet_copy_service.cc:342] P 4b60b701acc7473e87e3e529a2a34689: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-2bff4b982e59440089e2d3d5b8ada66f received from {username='slave'} at 127.0.0.1:42010
I20260709 13:20:51.793543 16894 tablet_copy_service.cc:434] P 4b60b701acc7473e87e3e529a2a34689: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-2bff4b982e59440089e2d3d5b8ada66f on tablet 2bff4b982e59440089e2d3d5b8ada66f with peer 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:20:51.911574 16924 consensus_peers.cc:597] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:51.912639 16924 consensus_peers.cc:597] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:51.933889 22518 tablet_copy_client.cc:538] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:20:52.031260 16850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 101875us
W20260709 13:20:52.052073 17492 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletCopyService.FetchData -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 118946us
I20260709 13:20:52.058425 17526 raft_consensus.cc:1217] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 13:20:52.058477 17520 raft_consensus.cc:2955] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 10 to 13, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:52.061038 17523 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:20:52.095978 22518 tablet_bootstrap.cc:492] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap starting.
W20260709 13:20:52.111994 16924 consensus_peers.cc:597] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:52.152354 16924 consensus_peers.cc:597] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.152956 16924 consensus_peers.cc:597] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.153359 16924 consensus_peers.cc:597] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:52.107623 16705 catalog_manager.cc:5697] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 10 to 13, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.122283 16952 raft_consensus.cc:1275] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:20:52.125478 15720 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 16831)
W20260709 13:20:52.144622 16850 consensus_peers.cc:597] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:52.159603 16850 consensus_peers.cc:597] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:52.121840 16954 raft_consensus.cc:2955] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 10 to 13, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:20:52.160175 16850 consensus_peers.cc:597] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:52.163564 22499 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:52.173786 16850 consensus_peers.cc:597] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.179411 16924 consensus_peers.cc:597] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:52.199141 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 136164us
I20260709 13:20:52.238027 22552 consensus_queue.cc:1048] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:52.244501 22552 raft_consensus.cc:1064] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
W20260709 13:20:52.246393 16850 consensus_peers.cc:597] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.247620 22552 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:52.264839 17492 consensus_peers.cc:597] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:52.270612 16954 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:52.274960 22552 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:52.275791 16850 consensus_peers.cc:597] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:52.304144 16850 consensus_peers.cc:597] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.311403 22564 log.cc:927] Time spent T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:20:52.342247 16850 consensus_peers.cc:597] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:52.347977 17520 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:20:52.348239 22518 tablet_bootstrap.cc:492] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:52.349257 22518 tablet_bootstrap.cc:492] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480: Bootstrap complete.
I20260709 13:20:52.350005 22518 ts_tablet_manager.cc:1403] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent bootstrapping tablet: real 0.254s	user 0.038s	sys 0.006s
I20260709 13:20:52.352830 22518 raft_consensus.cc:359] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
I20260709 13:20:52.353638 22518 raft_consensus.cc:740] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Initialized, Role: LEARNER
I20260709 13:20:52.354231 22518 consensus_queue.cc:260] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: NON_VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: true } }
W20260709 13:20:52.365049 16924 consensus_peers.cc:597] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:52.378587 22552 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:52.380760 22518 ts_tablet_manager.cc:1434] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:20:52.381561 22499 raft_consensus.cc:2955] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:52.396430 16954 raft_consensus.cc:2955] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:52.414261 16704 catalog_manager.cc:5697] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 11 to 12, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:52.437410 16969 tablet_copy_service.cc:342] P ca1b60a074dc47cd8e68cc57a33a94a3: Request end of tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-deabeb68cc1e4f73b9a6b49f9f29da22 received from {username='slave'} at 127.0.0.1:48222
I20260709 13:20:52.437878 16969 tablet_copy_service.cc:434] P ca1b60a074dc47cd8e68cc57a33a94a3: ending tablet copy session 599f9a88b6cd4e818a1c59a0b4522480-deabeb68cc1e4f73b9a6b49f9f29da22 on tablet deabeb68cc1e4f73b9a6b49f9f29da22 with peer 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:52.458406 17519 raft_consensus.cc:2955] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index 11 to 12, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:52.476395 22552 raft_consensus.cc:2955] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:52.520054 16954 raft_consensus.cc:2955] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:20:52.543844 17492 consensus_peers.cc:597] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.548116 16704 catalog_manager.cc:5697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 10 to 11, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:52.557296 17521 raft_consensus.cc:1217] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.14->[18.15-18.15]   Dedup: 18.15->[]
I20260709 13:20:52.565102 17521 raft_consensus.cc:2955] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } attrs { replace: true } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:52.575809 16879 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:52.605731 16952 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:52.610807 22514 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:20:52.612826 16850 consensus_peers.cc:597] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:52.620477 22368 raft_consensus.cc:2955] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:52.625921 16952 raft_consensus.cc:2955] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:52.634532 16694 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2bff4b982e59440089e2d3d5b8ada66f with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:20:52.652921 16705 catalog_manager.cc:5697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 11 to 12, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New cstate: current_term: 15 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:20:52.698079 16694 catalog_manager.cc:4755] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2bff4b982e59440089e2d3d5b8ada66f: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:52.741827 17492 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:52.798568 17519 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:20:52.834245 17492 consensus_peers.cc:597] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:52.841679 16850 consensus_peers.cc:597] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:52.855849 22368 raft_consensus.cc:1064] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:20:52.858251 22368 consensus_queue.cc:237] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:52.861660 22514 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:20:52.888769 16952 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:20:52.891875 22368 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:20:52.914884 16850 consensus_peers.cc:597] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:52.937688 16739 debug-util.cc:398] Leaking SignalData structure 0x7b0800355a20 after lost signal to thread 15723
W20260709 13:20:52.938819 16739 debug-util.cc:398] Leaking SignalData structure 0x7b08003555c0 after lost signal to thread 16742
W20260709 13:20:52.940114 16739 debug-util.cc:398] Leaking SignalData structure 0x7b08000345c0 after lost signal to thread 16909
W20260709 13:20:52.941227 16739 debug-util.cc:398] Leaking SignalData structure 0x7b080030c3a0 after lost signal to thread 16983
W20260709 13:20:52.942427 16739 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8da0 after lost signal to thread 17551
I20260709 13:20:52.958993 17519 raft_consensus.cc:2955] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:52.977279 17521 raft_consensus.cc:1275] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEARNER]: Refusing update from remote peer 4b60b701acc7473e87e3e529a2a34689: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:20:53.007805 16924 consensus_peers.cc:597] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:53.022835 22368 consensus_queue.cc:1048] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:20:53.048405 22554 raft_consensus.cc:1064] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: attempting to promote NON_VOTER 599f9a88b6cd4e818a1c59a0b4522480 to VOTER
I20260709 13:20:53.051460 22554 consensus_queue.cc:237] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 13, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:53.146914 16878 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:20:53.143951 22569 raft_consensus.cc:2955] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
W20260709 13:20:53.159086 15720 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 16831)
I20260709 13:20:53.162917 22555 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:20:53.174158 16954 raft_consensus.cc:2955] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:53.181979 16707 catalog_manager.cc:5697] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 reported cstate change: config changed from index 10 to 11, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "4b60b701acc7473e87e3e529a2a34689" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:53.184724 16924 consensus_peers.cc:597] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:53.291112 17492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:33725, user_credentials={real_user=slave}} blocked reactor thread for 99785.4us
I20260709 13:20:53.296416 17521 raft_consensus.cc:1275] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 LEARNER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 13:20:53.299396 17492 consensus_peers.cc:597] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:53.336055 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:53.336687 17492 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:53.365549 17526 raft_consensus.cc:2955] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:53.389969 22554 consensus_queue.cc:1048] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:20:53.397472 16924 consensus_peers.cc:597] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:53.411917 17492 consensus_peers.cc:597] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:53.413506 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:53.444484 17492 consensus_peers.cc:597] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:53.445133 17492 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:53.445669 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:53.446107 17492 consensus_peers.cc:597] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:53.460565 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:53.487457 22543 raft_consensus.cc:2955] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Committing config change with OpId 18.16: config changed from index 15 to 16, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:53.503722 17526 raft_consensus.cc:2955] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Committing config change with OpId 18.16: config changed from index 15 to 16, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:53.529927 16878 raft_consensus.cc:2955] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Committing config change with OpId 18.16: config changed from index 15 to 16, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } } }
I20260709 13:20:53.541746 16705 catalog_manager.cc:5697] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: config changed from index 15 to 16, 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:20:53.621575 16924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111) [suppressed 415 similar messages]
W20260709 13:20:53.737522 16924 consensus_peers.cc:597] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:53.740993 17492 consensus_peers.cc:597] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:53.762945 16850 consensus_peers.cc:597] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:53.806579 16924 consensus_peers.cc:597] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:53.858920 16924 consensus_peers.cc:597] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:53.899688 17492 consensus_peers.cc:597] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:53.912830 16694 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.15.90.1:46655, user_credentials={real_user=slave}} blocked reactor thread for 52328.8us
W20260709 13:20:53.915400 16924 consensus_peers.cc:597] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:53.932201 16924 consensus_peers.cc:597] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:53.944481 16694 catalog_manager.cc:4755] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2bff4b982e59440089e2d3d5b8ada66f: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:53.957667 16924 consensus_peers.cc:597] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:54.012013 16924 consensus_peers.cc:597] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:54.034853 16850 consensus_peers.cc:597] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:54.070935 16924 consensus_peers.cc:597] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.105077 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.159543 15720 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 16831)
W20260709 13:20:54.176370 16850 consensus_peers.cc:597] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.252305 16924 consensus_peers.cc:597] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.258688 16924 consensus_peers.cc:597] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.261564 16924 consensus_peers.cc:597] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:54.352221 16850 consensus_peers.cc:597] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.368965 16924 consensus_peers.cc:597] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.468205 16924 consensus_peers.cc:597] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.469831 16924 consensus_peers.cc:597] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.524066 16924 consensus_peers.cc:597] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:54.610740 16850 consensus_peers.cc:597] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.630119 16850 consensus_peers.cc:597] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.773093 16850 consensus_peers.cc:597] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:54.796592 17492 consensus_peers.cc:597] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.839989 16850 consensus_peers.cc:597] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:54.924764 16924 consensus_peers.cc:597] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.032790 17492 consensus_peers.cc:597] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:55.044821 16850 consensus_peers.cc:597] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.113232 16694 catalog_manager.cc:4755] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2bff4b982e59440089e2d3d5b8ada66f: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:55.141284 17492 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:55.148115 16850 consensus_peers.cc:597] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:55.255992 17492 consensus_peers.cc:597] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:55.289172 15720 tablet_server.cc:196] TabletServer@127.15.90.1:0 shutdown complete.
W20260709 13:20:55.358101 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.439158 16850 consensus_peers.cc:597] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:55.444921 16924 consensus_peers.cc:597] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:55.589133 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.654574 17492 consensus_peers.cc:597] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.655117 17492 consensus_peers.cc:597] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.724442 17492 consensus_peers.cc:597] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:55.745100 17492 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:55.770237 15720 tablet_server.cc:179] TabletServer@127.15.90.2:0 shutting down...
W20260709 13:20:55.790886 16924 consensus_peers.cc:597] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.842064 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:55.886466 16924 consensus_peers.cc:597] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.904950 16924 consensus_peers.cc:597] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.905335 17492 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.908107 17492 consensus_peers.cc:597] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.929035 16924 consensus_peers.cc:597] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.929438 17492 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:55.930581 17492 consensus_peers.cc:597] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.931113 17492 consensus_peers.cc:597] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.933504 16924 consensus_peers.cc:597] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.935766 16924 consensus_peers.cc:597] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.942898 16924 consensus_peers.cc:597] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.947189 16924 consensus_peers.cc:597] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.962941 16924 consensus_peers.cc:597] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.981693 16924 consensus_peers.cc:597] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:55.987991 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:55.997906 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:56.001382 15720 tablet_replica.cc:333] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.002267 15720 raft_consensus.cc:2243] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.002921 15720 raft_consensus.cc:2272] T 7fe476f65c0445399ab9cd51828acf2f P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.006207 15720 tablet_replica.cc:333] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.007715 15720 raft_consensus.cc:2243] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.010634 15720 raft_consensus.cc:2272] T 8abf86e7719a4c7bae84b69e92b761bb P 4b60b701acc7473e87e3e529a2a34689 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.019930 15720 tablet_replica.cc:333] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
W20260709 13:20:56.021106 16924 consensus_peers.cc:597] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.021117 15720 raft_consensus.cc:2243] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.022590 15720 raft_consensus.cc:2272] T 4b0d07e74a6f4d4b9accba26620d27f9 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:56.025779 16924 consensus_peers.cc:597] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.026273 15720 tablet_replica.cc:333] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
W20260709 13:20:56.026396 16924 consensus_peers.cc:597] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.027223 15720 raft_consensus.cc:2243] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:56.032387 16924 consensus_peers.cc:597] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.034740 17492 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.035594 16924 consensus_peers.cc:597] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.027884 15720 raft_consensus.cc:2272] T f4f36dd72a75406881b100b0ebbaeaff P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:56.040638 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.047302 16924 consensus_peers.cc:597] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.049871 15720 tablet_replica.cc:333] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.051438 15720 raft_consensus.cc:2243] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.053666 15720 raft_consensus.cc:2272] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.067994 15720 tablet_replica.cc:333] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.068840 15720 raft_consensus.cc:2243] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.069830 15720 raft_consensus.cc:2272] T 2bff4b982e59440089e2d3d5b8ada66f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.072412 15720 tablet_replica.cc:333] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.073429 15720 raft_consensus.cc:2243] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.074535 15720 raft_consensus.cc:2272] T 2db7a71cf1004eaab193504169d474c4 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.081674 15720 tablet_replica.cc:333] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.082509 15720 raft_consensus.cc:2243] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.083513 15720 raft_consensus.cc:2272] T c61e860f8a8d481aa272d36c7e4a93e0 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.086198 15720 tablet_replica.cc:333] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.087069 15720 raft_consensus.cc:2243] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.087739 15720 raft_consensus.cc:2272] T 5bc0e6e74a524cd59d8c8341367e62b3 P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.090301 15720 tablet_replica.cc:333] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.091046 15720 raft_consensus.cc:2243] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:20:56.099642 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.100376 15720 raft_consensus.cc:2272] T c1b0416e641248ecbd3052388f5edf59 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:56.109764 17492 consensus_peers.cc:597] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:56.111951 15720 tablet_replica.cc:333] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.113214 15720 raft_consensus.cc:2243] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.114347 15720 raft_consensus.cc:2272] T 778275eedaec440eb9d6de3b4984d656 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.118840 15720 tablet_replica.cc:333] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.131079 15720 raft_consensus.cc:2243] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.131906 15720 raft_consensus.cc:2272] T f8b8274145134eaa8f14229eceeca799 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.135149 15720 tablet_replica.cc:333] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.136022 15720 raft_consensus.cc:2243] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:56.140831 17492 consensus_peers.cc:597] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.141314 15720 raft_consensus.cc:2272] T dbad0fc0e5714f879e763bb34b5f172f P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:56.149958 16924 consensus_peers.cc:597] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.151000 17492 consensus_peers.cc:597] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:20:56.156322 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:56.160048 15720 tablet_replica.cc:333] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.167408 15720 raft_consensus.cc:2243] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:20:56.172586 16924 consensus_peers.cc:597] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:56.173928 15720 raft_consensus.cc:2272] T 6fb5156c6c9245bfaeffc22854718789 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.177003 15720 tablet_replica.cc:333] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.177913 15720 raft_consensus.cc:2243] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.178519 15720 raft_consensus.cc:2272] T 7c407adc8efe4ee9859c31d64a280e7a P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.193683 15720 tablet_replica.cc:333] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.194618 15720 raft_consensus.cc:2243] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.195499 15720 raft_consensus.cc:2272] T 2ea18b0f585149f0a5558b066b194a9d P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.198239 15720 tablet_replica.cc:333] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.199141 15720 raft_consensus.cc:2243] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.199724 15720 raft_consensus.cc:2272] T 2a9fb47e66dc4499902e4f88e8774c9c P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.202183 15720 tablet_replica.cc:333] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.203235 15720 raft_consensus.cc:2243] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.204320 15720 raft_consensus.cc:2272] T caf243a747f348a29b25b4642b64788e P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:56.215718 16850 consensus_peers.cc:597] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:56.224074 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.226908 15720 tablet_replica.cc:333] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.228480 15720 raft_consensus.cc:2243] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.229564 15720 raft_consensus.cc:2272] T 89c4a22bddc9425886aa0574ae085451 P 4b60b701acc7473e87e3e529a2a34689 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:56.239185 17492 consensus_peers.cc:597] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.247200 16924 consensus_peers.cc:597] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:56.246783 17492 consensus_peers.cc:597] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:56.253511 16924 consensus_peers.cc:597] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:56.256312 15720 tablet_replica.cc:333] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.260671 15720 raft_consensus.cc:2243] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.261818 15720 raft_consensus.cc:2272] T 3291b51968ff4989a89ff1c802955900 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:56.302910 17492 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:56.306545 15720 tablet_replica.cc:333] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.309237 15720 raft_consensus.cc:2243] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.310321 15720 raft_consensus.cc:2272] T 1555b08c459f47689fc0d1a7cf582a1b P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.322168 15720 tablet_replica.cc:333] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.323103 15720 raft_consensus.cc:2243] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.323916 15720 raft_consensus.cc:2272] T 671210bca23f4566a684a188613c1665 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.360140 15720 tablet_replica.cc:333] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
W20260709 13:20:56.362676 16924 consensus_peers.cc:597] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:56.367065 15720 raft_consensus.cc:2243] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.367857 15720 raft_consensus.cc:2272] T 78ca000fd50c4b38bfdd60badc024845 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.370555 15720 tablet_replica.cc:333] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.371310 15720 raft_consensus.cc:2243] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.371836 15720 raft_consensus.cc:2272] T cd1d35ba148544669e52d7293ac9bd82 P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:56.376173 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:56.378509 15720 tablet_replica.cc:333] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.379417 15720 raft_consensus.cc:2243] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.383190 15720 raft_consensus.cc:2272] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.391091 15720 tablet_replica.cc:333] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.391896 15720 raft_consensus.cc:2243] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.393042 15720 raft_consensus.cc:2272] T 168ed6dff4844944aff3337d23ee2950 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.395663 15720 tablet_replica.cc:333] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.397148 15720 raft_consensus.cc:2243] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.399566 15720 raft_consensus.cc:2272] T deabeb68cc1e4f73b9a6b49f9f29da22 P 4b60b701acc7473e87e3e529a2a34689 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.403566 15720 tablet_replica.cc:333] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.404930 15720 raft_consensus.cc:2243] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.405522 15720 raft_consensus.cc:2272] T 043a927eb1a442999f1930b07d059e8f P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:56.406978 16924 consensus_peers.cc:597] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:56.408772 15720 tablet_replica.cc:333] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
W20260709 13:20:56.416931 16924 consensus_peers.cc:597] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:56.409652 15720 raft_consensus.cc:2243] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.418185 15720 raft_consensus.cc:2272] T 3a7411023b914822890ea380b2bf8efc P 4b60b701acc7473e87e3e529a2a34689 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.420823 15720 tablet_replica.cc:333] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.421588 15720 raft_consensus.cc:2243] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.424572 15720 raft_consensus.cc:2272] T a51b55458c5a45c78b6a978ce6a10d31 P 4b60b701acc7473e87e3e529a2a34689 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.427253 15720 tablet_replica.cc:333] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.428036 15720 raft_consensus.cc:2243] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.428581 15720 raft_consensus.cc:2272] T 4c50b9c8ead54558a785ce80fcc5fb62 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.431219 15720 tablet_replica.cc:333] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.431975 15720 raft_consensus.cc:2243] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.432629 15720 raft_consensus.cc:2272] T 406d9b96060f4833ba26879d81f73bdc P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.435429 15720 tablet_replica.cc:333] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.436158 15720 raft_consensus.cc:2243] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.436924 15720 raft_consensus.cc:2272] T 06e6de173e42433e8df1572e54437e03 P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:56.460533 17492 consensus_peers.cc:597] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:56.467844 16924 consensus_peers.cc:597] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:56.468345 16924 consensus_peers.cc:597] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:56.475003 16924 consensus_peers.cc:597] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:56.477728 15720 tablet_replica.cc:333] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.478592 15720 raft_consensus.cc:2243] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.479626 15720 raft_consensus.cc:2272] T 109354c29850459b80f792dad016fc0d P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.482652 15720 tablet_replica.cc:333] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.483389 15720 raft_consensus.cc:2243] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.484635 15720 raft_consensus.cc:2272] T 57dfb70986d346cdb015b37c0f58dce3 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.487241 15720 tablet_replica.cc:333] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.488006 15720 raft_consensus.cc:2243] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.488838 15720 raft_consensus.cc:2272] T 05d0b0f25f26402cb5f324812a9f12c4 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.491298 15720 tablet_replica.cc:333] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.492022 15720 raft_consensus.cc:2243] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.493525 15720 raft_consensus.cc:2272] T be49fe28fec04ec88f4f84bc7aa2149f P 4b60b701acc7473e87e3e529a2a34689 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.497462 15720 tablet_replica.cc:333] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.498102 15720 raft_consensus.cc:2243] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.498807 15720 raft_consensus.cc:2272] T e60cb274e4a7404ebaf6480f093cdf56 P 4b60b701acc7473e87e3e529a2a34689 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.501482 15720 tablet_replica.cc:333] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.502259 15720 raft_consensus.cc:2243] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.502893 15720 raft_consensus.cc:2272] T aa815b919c824fb196befa2fd6eeac35 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.505764 15720 tablet_replica.cc:333] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.506513 15720 raft_consensus.cc:2243] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:20:56.512971 16924 consensus_peers.cc:597] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:56.514149 15720 raft_consensus.cc:2272] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 4b60b701acc7473e87e3e529a2a34689 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.516898 15720 tablet_replica.cc:333] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.517622 15720 raft_consensus.cc:2243] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.519220 15720 raft_consensus.cc:2272] T 6455509d1ac14e1d961f38607a869924 P 4b60b701acc7473e87e3e529a2a34689 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.522303 15720 tablet_replica.cc:333] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.523027 15720 raft_consensus.cc:2243] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.523562 15720 raft_consensus.cc:2272] T 98d04db01c024df0a2b3bb75c0fcd76f P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.526083 15720 tablet_replica.cc:333] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.526783 15720 raft_consensus.cc:2243] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.527377 15720 raft_consensus.cc:2272] T d757b655f89a468ab8fc0ad2914716b7 P 4b60b701acc7473e87e3e529a2a34689 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.531337 15720 tablet_replica.cc:333] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.532222 15720 raft_consensus.cc:2243] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.532902 15720 raft_consensus.cc:2272] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.535352 15720 tablet_replica.cc:333] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.536055 15720 raft_consensus.cc:2243] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.537110 15720 raft_consensus.cc:2272] T 595865d470ea4e5489bcc4699f26ff4a P 4b60b701acc7473e87e3e529a2a34689 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.546653 15720 tablet_replica.cc:333] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.547703 15720 raft_consensus.cc:2243] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:56.548419 15720 raft_consensus.cc:2272] T 5e604fa8c1b148ea9842f341b4a2c000 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:56.550952 15720 tablet_replica.cc:333] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689: stopping tablet replica
I20260709 13:20:56.551538 15720 raft_consensus.cc:2243] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:56.552910 15720 raft_consensus.cc:2272] T 7e5bdf407d5944728fca8072489ee727 P 4b60b701acc7473e87e3e529a2a34689 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:56.671229 16924 consensus_peers.cc:597] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:56.744028 16924 consensus_peers.cc:597] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:56.780356 16924 consensus_peers.cc:597] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:56.873273 16924 consensus_peers.cc:597] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:56.936765 16924 consensus_peers.cc:597] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:57.096855 17492 consensus_peers.cc:597] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:57.136109 16924 consensus_peers.cc:597] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:57.211642 16694 catalog_manager.cc:4755] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2bff4b982e59440089e2d3d5b8ada66f: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:57.247205 22600 raft_consensus.cc:493] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.247814 22600 raft_consensus.cc:515] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:57.249842 22600 leader_election.cc:290] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:57.260453 22600 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.260912 22600 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.265798 22600 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:57.266275 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:57.265836 16924 leader_election.cc:336] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:57.268080 16924 leader_election.cc:336] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.268535 16924 leader_election.cc:304] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.269316 22600 raft_consensus.cc:2749] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:20:57.280378 16924 leader_election.cc:336] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.280902 16924 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:57.281664 22601 raft_consensus.cc:2749] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:57.303614 22601 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.304173 22601 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.306346 22601 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:57.307916 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:57.316668 22595 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.317236 22595 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.322256 22595 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:57.324643 22595 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.324726 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:57.325268 22595 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:57.328668 16924 leader_election.cc:336] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.329178 16924 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
I20260709 13:20:57.330788 22601 raft_consensus.cc:2749] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:57.346091 22595 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:57.353044 17492 leader_election.cc:336] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.353518 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:57.355321 22540 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:20:57.365453 17492 leader_election.cc:336] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:57.374126 17492 leader_election.cc:336] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.374557 17492 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.375444 22595 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:57.388381 22540 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.388947 22540 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.390966 22540 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:57.391368 22540 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.392824 22540 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.393721 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:57.395330 22600 raft_consensus.cc:493] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.395839 22600 raft_consensus.cc:515] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
W20260709 13:20:57.397440 17492 leader_election.cc:336] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.397668 22600 leader_election.cc:290] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:57.397878 17492 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:57.398597 22595 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:20:57.399318 22540 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:57.402213 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
W20260709 13:20:57.407357 17492 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:57.407801 17492 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:57.408443 22540 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:20:57.408583 17492 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.424649 22600 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.425154 22600 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.427058 22600 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:57.428593 16924 leader_election.cc:336] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:57.430769 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:57.431427 17519 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
W20260709 13:20:57.433248 16924 leader_election.cc:336] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.433773 16924 leader_election.cc:304] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.434712 22600 raft_consensus.cc:2749] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:20:57.439939 22600 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.440263 16922 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:57.440397 22600 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:57.442749 22600 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:57.443899 22601 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:57.444353 22601 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.444808 22601 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:57.459240 22595 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.459806 22595 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.461779 22595 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:57.460227 22601 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.466540 22601 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:57.468421 16924 leader_election.cc:336] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:57.478171 16924 leader_election.cc:336] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:57.479715 16924 leader_election.cc:336] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:57.480298 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:57.480381 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.481034 16954 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
I20260709 13:20:57.481264 22601 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:57.482542 22595 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.483067 22595 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.485499 22595 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:57.493120 16924 leader_election.cc:336] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:57.493937 16924 consensus_peers.cc:597] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:57.494938 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:57.497812 22540 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:20:57.498165 22540 raft_consensus.cc:493] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.498507 22540 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:57.498814 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bff4b982e59440089e2d3d5b8ada66f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:57.499395 17519 raft_consensus.cc:3060] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:20:57.504786 22608 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.505259 22540 raft_consensus.cc:515] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.505355 22608 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.507169 22540 leader_election.cc:290] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:57.507571 22608 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:57.508203 22601 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.508423 17519 raft_consensus.cc:2468] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 16.
I20260709 13:20:57.508688 22601 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.510758 22601 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:57.512696 22601 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.513159 22601 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.516418 22601 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:57.522020 16924 leader_election.cc:336] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.524751 16922 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:57.526644 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:57.527210 16957 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
I20260709 13:20:57.528070 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0d07e74a6f4d4b9accba26620d27f9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:57.528625 16954 raft_consensus.cc:3060] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:20:57.528662 22606 raft_consensus.cc:2804] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:57.529260 22606 raft_consensus.cc:697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:57.530086 22606 consensus_queue.cc:237] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.531805 22600 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.532307 22600 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.534135 22600 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:57.535300 16954 raft_consensus.cc:2468] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 13.
W20260709 13:20:57.546234 16924 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:57.551326 17492 leader_election.cc:336] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:57.560142 16924 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:57.560647 16924 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.561622 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:57.562265 17519 raft_consensus.cc:2468] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 13.
I20260709 13:20:57.561023 16707 catalog_manager.cc:5697] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 15 to 16, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 16 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:57.566047 22606 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:57.566756 22606 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.567279 22606 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.569941 22606 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:57.571187 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8abf86e7719a4c7bae84b69e92b761bb" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:57.573117 17519 raft_consensus.cc:2468] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 19.
I20260709 13:20:57.572376 17522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:57.573693 17522 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 18.
I20260709 13:20:57.584451 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:57.587071 17492 leader_election.cc:336] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:57.591092 16924 leader_election.cc:336] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:57.595585 17492 leader_election.cc:336] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:57.601140 17492 leader_election.cc:336] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.614771 16922 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:57.616107 16922 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:57.618970 22601 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:20:57.621321 22601 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.621716 22601 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:57.623028 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:57.620879 22600 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:20:57.624150 22600 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.624514 22600 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:57.631742 22600 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.632824 22540 raft_consensus.cc:2804] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:20:57.623626 16924 consensus_peers.cc:597] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:57.633181 22540 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:20:57.633392 16924 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:57.635056 22540 raft_consensus.cc:3060] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:20:57.635778 17492 leader_election.cc:304] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:57.638476 22608 raft_consensus.cc:2804] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:20:57.638922 22608 raft_consensus.cc:697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:57.639732 22608 consensus_queue.cc:237] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.633780 22601 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.642833 22540 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.644534 22540 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:57.645525 17492 leader_election.cc:336] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:57.649417 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.634876 22600 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 19 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:57.643406 22601 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:57.646788 16924 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.652804 16924 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.654209 22606 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:57.654659 22540 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.654644 22607 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:57.655349 22540 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.657156 22540 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:57.666462 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:57.667162 16954 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 599f9a88b6cd4e818a1c59a0b4522480 in current term 14: Already voted for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in this term.
I20260709 13:20:57.677783 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e860f8a8d481aa272d36c7e4a93e0" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:57.678364 17524 raft_consensus.cc:3060] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:20:57.678926 16705 catalog_manager.cc:5697] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 12 to 13, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 13 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:57.685544 17524 raft_consensus.cc:2468] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 19.
I20260709 13:20:57.688762 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fb5156c6c9245bfaeffc22854718789" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:57.691645 17524 raft_consensus.cc:2393] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ca1b60a074dc47cd8e68cc57a33a94a3 in current term 14: Already voted for candidate 599f9a88b6cd4e818a1c59a0b4522480 in this term.
I20260709 13:20:57.693018 16954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:57.698220 16922 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:57.699725 22601 raft_consensus.cc:2804] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:20:57.700199 22601 raft_consensus.cc:697] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:57.700981 22601 consensus_queue.cc:237] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:57.707463 16924 leader_election.cc:336] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:57.708503 17492 leader_election.cc:336] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.715263 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
W20260709 13:20:57.715502 16924 leader_election.cc:336] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.715934 16924 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 599f9a88b6cd4e818a1c59a0b4522480
W20260709 13:20:57.716136 17492 leader_election.cc:336] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.717450 22608 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:57.718361 22616 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:20:57.716571 17492 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:57.719707 22540 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:57.723203 17492 consensus_peers.cc:597] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:57.730307 16705 catalog_manager.cc:5697] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 18 to 19, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 19 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:57.735649 17492 consensus_peers.cc:597] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:20:57.738355 22540 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.738811 22540 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.740490 22540 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:57.752568 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:57.753167 16957 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 15.
I20260709 13:20:57.759516 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:57.760305 22540 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:20:57.760627 22540 raft_consensus.cc:493] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.760916 22540 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:57.761013 17492 leader_election.cc:336] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.765192 22601 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.766351 22601 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.769697 22601 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:57.771588 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:57.771967 22540 raft_consensus.cc:515] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.773833 22540 leader_election.cc:290] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:57.776311 16924 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:57.776753 16924 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 599f9a88b6cd4e818a1c59a0b4522480, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.777132 22601 raft_consensus.cc:493] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
W20260709 13:20:57.777653 17492 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:57.777591 22601 raft_consensus.cc:515] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:57.779134 22616 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:57.779515 22601 leader_election.cc:290] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:57.779922 16924 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.780916 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291b51968ff4989a89ff1c802955900" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3"
I20260709 13:20:57.781422 16957 raft_consensus.cc:3060] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:20:57.782740 17492 leader_election.cc:336] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.787665 16957 raft_consensus.cc:2468] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 16.
I20260709 13:20:57.791051 17492 leader_election.cc:304] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:57.792785 22540 raft_consensus.cc:2804] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:20:57.793251 22540 raft_consensus.cc:697] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 LEADER]: Becoming Leader. State: Replica: 599f9a88b6cd4e818a1c59a0b4522480, State: Running, Role: LEADER
I20260709 13:20:57.794049 22540 consensus_queue.cc:237] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:57.796039 16924 leader_election.cc:336] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:57.799358 16924 leader_election.cc:336] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.799803 16924 leader_election.cc:304] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.801070 22601 raft_consensus.cc:2749] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:57.804093 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:57.824776 16705 catalog_manager.cc:5697] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 reported cstate change: term changed from 15 to 16, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4). New cstate: current_term: 16 leader_uuid: "599f9a88b6cd4e818a1c59a0b4522480" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:20:57.828126 22616 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.828765 22616 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.831261 22616 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:57.832523 22616 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.835822 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
W20260709 13:20:57.836310 16924 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:57.838325 16924 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:57.838776 16924 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.836382 22616 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.840804 22616 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
I20260709 13:20:57.841954 22600 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:20:57.846423 17524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480" is_pre_election: true
I20260709 13:20:57.847064 17524 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 14.
I20260709 13:20:57.851306 16922 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 
I20260709 13:20:57.852386 22600 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:20:57.852744 22600 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.853103 22600 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:57.860060 22600 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:20:57.862598 16924 leader_election.cc:336] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.865144 17519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5bdf407d5944728fca8072489ee727" candidate_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "599f9a88b6cd4e818a1c59a0b4522480"
I20260709 13:20:57.865691 17519 raft_consensus.cc:3060] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:20:57.867415 22600 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Requested vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), 599f9a88b6cd4e818a1c59a0b4522480 (127.15.90.4:35369)
W20260709 13:20:57.869726 16924 leader_election.cc:336] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.872917 17519 raft_consensus.cc:2468] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca1b60a074dc47cd8e68cc57a33a94a3 in term 15.
I20260709 13:20:57.878494 16922 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689
I20260709 13:20:57.879495 22600 raft_consensus.cc:2804] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:20:57.879961 22600 raft_consensus.cc:697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Becoming Leader. State: Replica: ca1b60a074dc47cd8e68cc57a33a94a3, State: Running, Role: LEADER
I20260709 13:20:57.880730 22600 consensus_queue.cc:237] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.896425 16705 catalog_manager.cc:5697] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 reported cstate change: term changed from 14 to 15, leader changed from 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2) to ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3). New cstate: current_term: 15 leader_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:57.906925 17492 consensus_peers.cc:597] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:57.912757 22540 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.913312 22540 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.925064 22540 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:57.925663 17492 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:57.926370 17492 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.926787 17492 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.928013 22540 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:20:57.928525 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be49fe28fec04ec88f4f84bc7aa2149f" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:57.929121 16957 raft_consensus.cc:2468] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 16.
I20260709 13:20:57.953819 22600 raft_consensus.cc:493] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.954320 22600 raft_consensus.cc:515] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:57.956235 22600 leader_election.cc:290] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:57.964069 22540 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.964556 22540 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:57.966854 22540 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:20:57.970043 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6455509d1ac14e1d961f38607a869924" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:57.970669 16957 raft_consensus.cc:2468] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 12.
W20260709 13:20:57.978638 17492 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:57.979364 17492 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.979842 17492 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.981328 22540 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:20:57.982838 16924 leader_election.cc:336] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:57.991005 16924 consensus_peers.cc:597] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:57.991391 16924 leader_election.cc:336] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:57.991761 16924 leader_election.cc:304] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:57.992501 22616 raft_consensus.cc:2749] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:20:57.998354 22608 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:57.998965 22608 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:58.001621 22608 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:58.005512 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:58.016790 16957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5fe95d8fc442c7ad6fda1ba72b8ea9" candidate_uuid: "599f9a88b6cd4e818a1c59a0b4522480" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" is_pre_election: true
I20260709 13:20:58.017391 16957 raft_consensus.cc:2468] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 599f9a88b6cd4e818a1c59a0b4522480 in term 19.
W20260709 13:20:58.025684 17492 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:58.031229 17519 raft_consensus.cc:1275] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:20:58.032704 17492 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:58.034387 17492 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480, ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:58.035161 22540 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:20:58.040664 22616 consensus_queue.cc:1048] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:20:58.161835 16957 raft_consensus.cc:1275] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:20:58.184835 17519 raft_consensus.cc:1275] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:20:58.189131 22600 consensus_queue.cc:1048] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:20:58.191063 16924 consensus_peers.cc:597] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.187390 22540 consensus_queue.cc:1048] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
W20260709 13:20:58.218597 16924 consensus_peers.cc:597] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.240705 16924 consensus_peers.cc:597] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.252161 17492 consensus_peers.cc:597] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.265065 17492 consensus_peers.cc:597] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.266858 17492 consensus_peers.cc:597] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.281608 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:20:58.289830 16954 raft_consensus.cc:1275] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Refusing update from remote peer 599f9a88b6cd4e818a1c59a0b4522480: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:20:58.294598 22540 consensus_queue.cc:1048] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:20:58.300257 16924 consensus_peers.cc:597] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.303467 17492 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:58.307289 16924 consensus_peers.cc:597] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.316046 17492 consensus_peers.cc:597] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:58.334131 17492 consensus_peers.cc:597] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:58.362532 15720 tablet_server.cc:196] TabletServer@127.15.90.2:0 shutdown complete.
W20260709 13:20:58.364982 17492 consensus_peers.cc:597] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:58.393364 16924 consensus_peers.cc:597] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.406271 16924 consensus_peers.cc:597] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:58.411945 16924 consensus_peers.cc:597] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:58.430648 17524 raft_consensus.cc:1275] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Refusing update from remote peer ca1b60a074dc47cd8e68cc57a33a94a3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:20:58.434141 22614 consensus_queue.cc:1048] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:20:58.447400 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.451159 16924 consensus_peers.cc:597] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.451887 16924 consensus_peers.cc:597] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.466090 16924 consensus_peers.cc:597] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.487370 17492 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.489125 17492 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:58.493968 16924 consensus_peers.cc:597] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.498080 16924 consensus_peers.cc:597] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.500416 16924 consensus_peers.cc:597] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.506624 17492 consensus_peers.cc:597] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.519528 16924 consensus_peers.cc:597] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.533337 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.576568 16924 consensus_peers.cc:597] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:58.579523 16924 consensus_peers.cc:597] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.589329 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.623329 16924 consensus_peers.cc:597] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.626209 16924 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111) [suppressed 650 similar messages]
W20260709 13:20:58.670919 17492 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.693733 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:58.716948 16924 consensus_peers.cc:597] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.723268 16924 consensus_peers.cc:597] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:58.735379 17492 consensus_peers.cc:597] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:58.736218 16924 consensus_peers.cc:597] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:58.772621 17492 consensus_peers.cc:597] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.775161 17492 consensus_peers.cc:597] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:20:58.795652 16924 consensus_peers.cc:597] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.829759 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.846203 17492 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.892765 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:58.902352 16924 consensus_peers.cc:597] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:58.906344 17492 consensus_peers.cc:597] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:58.912848 16924 consensus_peers.cc:597] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:58.915500 16924 consensus_peers.cc:597] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:58.917691 16924 consensus_peers.cc:597] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:20:58.925402 22625 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:58.926067 22625 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:58.928318 22625 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:20:58.959543 17492 leader_election.cc:336] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:58.961117 17492 leader_election.cc:336] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:58.961546 17492 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:58.962779 22625 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:58.962227 15720 tablet_server.cc:179] TabletServer@127.15.90.3:0 shutting down...
W20260709 13:20:58.984143 17492 consensus_peers.cc:597] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:59.032380 16924 consensus_peers.cc:597] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:59.035807 16924 consensus_peers.cc:597] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:59.049306 17492 consensus_peers.cc:597] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:59.054746 16924 consensus_peers.cc:597] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:59.075665 17492 consensus_peers.cc:597] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:59.086522 17492 consensus_peers.cc:597] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:59.106621 17492 consensus_peers.cc:597] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:59.115111 16924 consensus_peers.cc:597] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:20:59.120440 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:59.131493 17492 consensus_peers.cc:597] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:59.148097 17492 consensus_peers.cc:597] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.151050 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:59.154071 15720 tablet_replica.cc:333] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.155172 15720 raft_consensus.cc:2243] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.156579 15720 raft_consensus.cc:2272] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.161311 15720 tablet_replica.cc:333] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.162441 15720 raft_consensus.cc:2243] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:20:59.166193 17492 consensus_peers.cc:597] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.171955 15720 raft_consensus.cc:2272] T 2bff4b982e59440089e2d3d5b8ada66f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.174784 15720 tablet_replica.cc:333] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.180339 15720 raft_consensus.cc:2243] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.181068 15720 raft_consensus.cc:2272] T 4b0d07e74a6f4d4b9accba26620d27f9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.185667 15720 tablet_replica.cc:333] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.188345 15720 raft_consensus.cc:2243] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.189652 15720 raft_consensus.cc:2272] T 8abf86e7719a4c7bae84b69e92b761bb P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.204131 22600 raft_consensus.cc:493] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:59.204734 22600 raft_consensus.cc:515] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } }
I20260709 13:20:59.207693 22600 leader_election.cc:290] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:59.202016 15720 tablet_replica.cc:333] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.209036 15720 raft_consensus.cc:2243] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:59.209358 16924 consensus_peers.cc:597] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:20:59.215489 16924 leader_election.cc:336] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:20:59.217252 16924 leader_election.cc:336] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:59.217677 16924 leader_election.cc:304] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca1b60a074dc47cd8e68cc57a33a94a3; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:59.218402 22600 raft_consensus.cc:2749] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:20:59.209766 15720 raft_consensus.cc:2272] T 778275eedaec440eb9d6de3b4984d656 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.222795 15720 tablet_replica.cc:333] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.223778 15720 raft_consensus.cc:2243] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.228751 15720 raft_consensus.cc:2272] T f4f36dd72a75406881b100b0ebbaeaff P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:59.230682 17492 consensus_peers.cc:597] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.231992 15720 tablet_replica.cc:333] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.233047 15720 raft_consensus.cc:2243] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.234719 15720 raft_consensus.cc:2272] T 5bc0e6e74a524cd59d8c8341367e62b3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.238638 15720 tablet_replica.cc:333] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.239439 15720 raft_consensus.cc:2243] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.240196 15720 raft_consensus.cc:2272] T 2db7a71cf1004eaab193504169d474c4 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.245024 15720 tablet_replica.cc:333] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.246016 15720 raft_consensus.cc:2243] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.247203 15720 raft_consensus.cc:2272] T c61e860f8a8d481aa272d36c7e4a93e0 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.250555 15720 tablet_replica.cc:333] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.251405 15720 raft_consensus.cc:2243] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.252022 15720 raft_consensus.cc:2272] T 3291b51968ff4989a89ff1c802955900 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.256403 15720 tablet_replica.cc:333] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.257262 15720 raft_consensus.cc:2243] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.259805 15720 raft_consensus.cc:2272] T 1555b08c459f47689fc0d1a7cf582a1b P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.262529 15720 tablet_replica.cc:333] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.263401 15720 raft_consensus.cc:2243] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.264330 15720 raft_consensus.cc:2272] T 671210bca23f4566a684a188613c1665 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.273607 15720 tablet_replica.cc:333] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
W20260709 13:20:59.273636 17492 consensus_peers.cc:597] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.275048 15720 raft_consensus.cc:2243] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.279603 15720 raft_consensus.cc:2272] T 78ca000fd50c4b38bfdd60badc024845 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.282267 15720 tablet_replica.cc:333] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
W20260709 13:20:59.282985 17492 consensus_peers.cc:597] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.286216 15720 raft_consensus.cc:2243] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.290016 15720 raft_consensus.cc:2272] T 168ed6dff4844944aff3337d23ee2950 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.301884 15720 tablet_replica.cc:333] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.302784 15720 raft_consensus.cc:2243] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.305684 15720 raft_consensus.cc:2272] T deabeb68cc1e4f73b9a6b49f9f29da22 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.309979 15720 tablet_replica.cc:333] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.310808 15720 raft_consensus.cc:2243] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.313858 15720 raft_consensus.cc:2272] T 0fd370afa4144ee3b93ac6dc4ae63e07 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.318385 15720 tablet_replica.cc:333] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.319322 15720 raft_consensus.cc:2243] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.320052 15720 raft_consensus.cc:2272] T c1b0416e641248ecbd3052388f5edf59 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.322742 15720 tablet_replica.cc:333] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.323547 15720 raft_consensus.cc:2243] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.325064 15720 raft_consensus.cc:2272] T 2a9fb47e66dc4499902e4f88e8774c9c P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:59.331830 16924 consensus_peers.cc:597] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:20:59.332453 15720 tablet_replica.cc:333] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.333387 15720 raft_consensus.cc:2243] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.334081 15720 raft_consensus.cc:2272] T 6fb5156c6c9245bfaeffc22854718789 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.337211 15720 tablet_replica.cc:333] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.344652 15720 raft_consensus.cc:2243] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.346726 15720 raft_consensus.cc:2272] T 7c407adc8efe4ee9859c31d64a280e7a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.350692 15720 tablet_replica.cc:333] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.356247 15720 raft_consensus.cc:2243] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.357949 15720 raft_consensus.cc:2272] T e37840a1d83b4fe5be57618ff85b8a47 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.360648 15720 tablet_replica.cc:333] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.373319 15720 raft_consensus.cc:2243] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.374631 15720 raft_consensus.cc:2272] T 2ea18b0f585149f0a5558b066b194a9d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.377561 15720 tablet_replica.cc:333] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.380229 15720 raft_consensus.cc:2243] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.383741 15720 raft_consensus.cc:2272] T 043a927eb1a442999f1930b07d059e8f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.386672 15720 tablet_replica.cc:333] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.387574 15720 raft_consensus.cc:2243] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.388429 15720 raft_consensus.cc:2272] T efa1a19816094c78802287ff39e74b62 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.392864 15720 tablet_replica.cc:333] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.393929 15720 raft_consensus.cc:2243] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.394610 15720 raft_consensus.cc:2272] T 949d7afc13ea44af96dab1af3a1dd354 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.397207 15720 tablet_replica.cc:333] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.398059 15720 raft_consensus.cc:2243] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.399302 15720 raft_consensus.cc:2272] T a51b55458c5a45c78b6a978ce6a10d31 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.404502 15720 tablet_replica.cc:333] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
W20260709 13:20:59.405817 17492 consensus_peers.cc:597] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.406973 15720 raft_consensus.cc:2243] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.407630 15720 raft_consensus.cc:2272] T 72998e8e2cff40f3be2ce73539159ecf P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.410422 15720 tablet_replica.cc:333] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.412017 15720 raft_consensus.cc:2243] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.413266 15720 raft_consensus.cc:2272] T 06e6de173e42433e8df1572e54437e03 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.415927 15720 tablet_replica.cc:333] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.416746 15720 raft_consensus.cc:2243] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.417919 15720 raft_consensus.cc:2272] T 109354c29850459b80f792dad016fc0d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:59.422520 17492 consensus_peers.cc:597] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.425139 15720 tablet_replica.cc:333] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.425983 15720 raft_consensus.cc:2243] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.429338 15720 raft_consensus.cc:2272] T 32f35f41a8f1466fb1831fe03e474c4d P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:59.431128 17492 consensus_peers.cc:597] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.435053 15720 tablet_replica.cc:333] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.435983 15720 raft_consensus.cc:2243] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.437222 15720 raft_consensus.cc:2272] T e9f7a2a0447a4956b36d1e9902e62f56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.441852 15720 tablet_replica.cc:333] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.442617 15720 raft_consensus.cc:2243] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.443392 15720 raft_consensus.cc:2272] T 57dfb70986d346cdb015b37c0f58dce3 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.446035 15720 tablet_replica.cc:333] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.446798 15720 raft_consensus.cc:2243] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.447395 15720 raft_consensus.cc:2272] T 2e62b3fa7cbf498099f802cfe999bd65 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.469645 15720 tablet_replica.cc:333] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.470463 15720 raft_consensus.cc:2243] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.472306 15720 raft_consensus.cc:2272] T d157a8f033dd43d5a5c824d9e6235fe9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.477404 15720 tablet_replica.cc:333] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.478190 15720 raft_consensus.cc:2243] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.479656 15720 raft_consensus.cc:2272] T be49fe28fec04ec88f4f84bc7aa2149f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.482520 15720 tablet_replica.cc:333] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.483316 15720 raft_consensus.cc:2243] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.484038 15720 raft_consensus.cc:2272] T 17115e8a13c346f1998df3bc8f52ec52 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.486593 15720 tablet_replica.cc:333] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.487318 15720 raft_consensus.cc:2243] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.488632 15720 raft_consensus.cc:2272] T e60cb274e4a7404ebaf6480f093cdf56 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.491032 15720 tablet_replica.cc:333] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.491783 15720 raft_consensus.cc:2243] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.492445 15720 raft_consensus.cc:2272] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.506392 15720 tablet_replica.cc:333] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.507251 15720 raft_consensus.cc:2243] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.507884 15720 raft_consensus.cc:2272] T dbad0fc0e5714f879e763bb34b5f172f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.510660 15720 tablet_replica.cc:333] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.511407 15720 raft_consensus.cc:2243] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.512804 22608 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:59.513362 22608 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:59.515563 22608 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:59.527036 17492 leader_election.cc:336] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:59.529132 17492 leader_election.cc:336] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:20:59.529610 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:20:59.530556 22632 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:20:59.533985 17492 consensus_peers.cc:597] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:59.534865 15720 raft_consensus.cc:2272] T 98d04db01c024df0a2b3bb75c0fcd76f P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.537712 15720 tablet_replica.cc:333] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.538513 15720 raft_consensus.cc:2243] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.539131 15720 raft_consensus.cc:2272] T efdef9f5ee0b4225ba140b5208412fde P ca1b60a074dc47cd8e68cc57a33a94a3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.541693 15720 tablet_replica.cc:333] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.542416 15720 raft_consensus.cc:2243] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.543618 15720 raft_consensus.cc:2272] T 1bcc7a68c24d41ef9c36f0bbfdb0e774 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.551396 15720 tablet_replica.cc:333] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.552253 15720 raft_consensus.cc:2243] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.553515 15720 raft_consensus.cc:2272] T 6455509d1ac14e1d961f38607a869924 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.570726 15720 tablet_replica.cc:333] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.571768 15720 raft_consensus.cc:2243] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:59.572681 15720 raft_consensus.cc:2272] T 595865d470ea4e5489bcc4699f26ff4a P ca1b60a074dc47cd8e68cc57a33a94a3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.575992 15720 tablet_replica.cc:333] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.576752 15720 raft_consensus.cc:2243] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.577847 15720 raft_consensus.cc:2272] T 5e604fa8c1b148ea9842f341b4a2c000 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.580341 15720 tablet_replica.cc:333] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.581025 15720 raft_consensus.cc:2243] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.582609 15720 raft_consensus.cc:2272] T 7e5bdf407d5944728fca8072489ee727 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.585172 15720 tablet_replica.cc:333] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.589334 22608 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:59.589861 22608 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:59.591838 22608 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
I20260709 13:20:59.586241 15720 raft_consensus.cc:2243] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:59.615337 17492 leader_election.cc:336] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:59.616007 15720 raft_consensus.cc:2272] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:59.618866 15720 tablet_replica.cc:333] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3: stopping tablet replica
I20260709 13:20:59.619527 15720 raft_consensus.cc:2243] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:20:59.620798 15720 raft_consensus.cc:2272] T efa7919f3d1c40e096823aab461b0e25 P ca1b60a074dc47cd8e68cc57a33a94a3 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:59.621559 17492 leader_election.cc:336] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:20:59.622058 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:59.622987 22608 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:20:59.678697 17492 consensus_peers.cc:597] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:20:59.743343 22608 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:20:59.744349 22608 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:20:59.747454 22608 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:20:59.865617 17492 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:20:59.867048 17492 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:20:59.867621 17492 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:20:59.961589 22633 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:20:59.991472 17492 consensus_peers.cc:597] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:21:00.038866 22633 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:21:00.039533 22633 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.044266 22633 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.050398 17492 consensus_peers.cc:597] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:00.073789 17492 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:00.075736 17492 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:00.076216 17492 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:21:00.077155 22634 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:00.082170 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:00.085263 17492 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.087531 17492 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:00.152232 22633 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:21:00.152911 22633 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.155633 22633 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.167204 17492 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:00.167941 17492 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:00.168380 17492 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:21:00.169068 22633 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:21:00.170944 17492 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:00.177512 17492 connection.cc:573] client connection to 127.15.90.3:33725 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:21:00.242841 17492 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:21:00.334172 22633 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:21:00.334784 22633 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.337499 22633 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.343859 17492 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:00.346184 17492 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:00.346653 17492 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:00.347343 22633 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:00.348851 17492 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:00.353657 22633 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:00.354166 22633 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.356014 22633 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.364210 17492 consensus_peers.cc:597] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:00.364905 17492 leader_election.cc:336] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:00.365978 17492 leader_election.cc:336] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:00.366369 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:00.367059 22633 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:21:00.375078 22633 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:00.375641 22633 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.377859 22633 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.383877 17492 leader_election.cc:336] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:00.385783 17492 leader_election.cc:336] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:00.386173 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:00.386871 22633 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:00.452437 22634 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:00.453014 22634 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.455300 22634 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.462225 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:00.462988 17492 leader_election.cc:336] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:00.463929 17492 leader_election.cc:336] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:00.464372 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:00.465073 22634 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:00.468672 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:00.500775 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:00.594089 22633 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:00.594673 22633 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.596789 22633 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.602088 17492 leader_election.cc:336] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:00.603094 17492 leader_election.cc:336] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:00.603560 17492 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:00.604239 22633 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:00.636691 22633 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:00.637274 22633 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.639393 22633 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.648881 17492 leader_election.cc:336] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:00.649646 17492 leader_election.cc:336] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:00.650035 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:00.650786 22633 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:00.665026 17492 consensus_peers.cc:597] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:00.669610 17492 consensus_peers.cc:597] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:00.695356 17492 consensus_peers.cc:597] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:00.726238 22633 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:00.726842 22633 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.729621 22633 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.736425 17492 leader_election.cc:336] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:00.737211 17492 leader_election.cc:336] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:00.737607 17492 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:21:00.738300 22633 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:00.738386 17492 leader_election.cc:336] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:00.741396 22633 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:00.741910 22633 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.744000 22633 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.748726 17492 leader_election.cc:336] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:00.749469 17492 leader_election.cc:336] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:00.749833 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:00.750572 22633 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:00.767009 22634 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:00.767514 22634 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.769467 22634 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.775665 17492 leader_election.cc:336] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:00.776270 17492 leader_election.cc:336] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:00.776624 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:00.777289 22634 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:00.848681 17492 consensus_peers.cc:597] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:00.880468 17492 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:00.887742 17492 consensus_peers.cc:597] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:00.932358 22633 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:00.932941 22633 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
W20260709 13:21:00.934824 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:00.935575 22633 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.942292 17492 leader_election.cc:336] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:00.943698 17492 leader_election.cc:336] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:00.944242 17492 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:00.944983 22633 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:21:00.958153 22633 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:00.958635 22633 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:00.960705 22633 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:00.965901 17492 leader_election.cc:336] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:00.967558 17492 leader_election.cc:336] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:00.967979 17492 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:00.968698 22633 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:00.978410 17492 consensus_peers.cc:597] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:01.000492 22634 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:01.001134 22634 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:01.003412 22634 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:01.011706 17492 leader_election.cc:336] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
W20260709 13:21:01.012777 17492 leader_election.cc:336] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:21:01.013232 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:01.014081 22634 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:01.048799 17548 debug-util.cc:398] Leaking SignalData structure 0x7b08003ecba0 after lost signal to thread 15723
W20260709 13:21:01.050031 17548 debug-util.cc:398] Leaking SignalData structure 0x7b08002dce60 after lost signal to thread 16742
W20260709 13:21:01.050734 17548 debug-util.cc:398] Leaking SignalData structure 0x7b08003db520 after lost signal to thread 16983
W20260709 13:21:01.051986 17548 debug-util.cc:398] Leaking SignalData structure 0x7b0800287fe0 after lost signal to thread 17551
W20260709 13:21:01.101925 17492 consensus_peers.cc:597] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:01.103927 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:01.106689 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:01.112936 17492 consensus_peers.cc:597] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:01.118147 17492 consensus_peers.cc:597] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:01.129190 17492 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:01.152355 17492 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:01.193990 15720 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16980)
W20260709 13:21:01.225018 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:01.255187 17492 consensus_peers.cc:597] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:01.277820 17492 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:01.289898 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:01.367462 16694 catalog_manager.cc:4755] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2bff4b982e59440089e2d3d5b8ada66f: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:01.386644 17492 consensus_peers.cc:597] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:01.387353 17492 consensus_peers.cc:597] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.508050 17492 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:01.557660 17492 consensus_peers.cc:597] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.562235 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.569173 17492 consensus_peers.cc:597] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.583411 17492 consensus_peers.cc:597] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:01.664698 17492 consensus_peers.cc:597] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:01.703527 17492 consensus_peers.cc:597] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.717479 17492 consensus_peers.cc:597] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.860126 22633 raft_consensus.cc:493] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:21:01.860631 22633 raft_consensus.cc:515] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:01.862536 22633 leader_election.cc:290] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:21:01.869092 17492 consensus_peers.cc:597] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.879563 22633 raft_consensus.cc:493] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:21:01.880105 22633 raft_consensus.cc:515] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:01.882570 22633 leader_election.cc:290] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:01.886930 17492 leader_election.cc:336] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:01.887877 17492 leader_election.cc:336] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:01.888280 17492 leader_election.cc:304] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:21:01.888958 22633 raft_consensus.cc:2749] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:21:01.894343 17492 consensus_peers.cc:597] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.899958 17492 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
W20260709 13:21:01.903609 17492 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:21:01.904246 17492 leader_election.cc:304] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:01.904934 22633 raft_consensus.cc:2749] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:01.905865 17492 leader_election.cc:336] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:01.906818 17492 consensus_peers.cc:597] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.909516 17492 consensus_peers.cc:597] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.954282 17492 consensus_peers.cc:597] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:01.959889 22633 raft_consensus.cc:493] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:01.960338 22633 raft_consensus.cc:515] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:01.962234 22633 leader_election.cc:290] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:21:01.963665 22633 raft_consensus.cc:493] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:21:01.964207 22633 raft_consensus.cc:515] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:01.966708 22633 leader_election.cc:290] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:01.994235 17492 leader_election.cc:336] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
W20260709 13:21:01.994925 17492 consensus_peers.cc:597] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:01.996361 17492 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
W20260709 13:21:01.997965 17492 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:21:01.998420 17492 leader_election.cc:304] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:01.999178 22633 raft_consensus.cc:2749] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:02.002338 17492 leader_election.cc:336] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:02.002780 17492 leader_election.cc:304] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:02.003559 22633 raft_consensus.cc:2749] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:02.004638 17492 leader_election.cc:336] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:02.081295 22633 raft_consensus.cc:493] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:21:02.081848 22633 raft_consensus.cc:515] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.085064 22633 leader_election.cc:290] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931)
W20260709 13:21:02.095850 17492 leader_election.cc:336] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:02.096644 17492 leader_election.cc:336] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:02.097066 17492 leader_election.cc:304] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:21:02.097848 22633 raft_consensus.cc:2749] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:21:02.100596 22633 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:02.101037 22633 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.102932 22633 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:02.113740 17492 leader_election.cc:336] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:02.114444 17492 leader_election.cc:336] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:02.114849 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:02.115559 22633 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:21:02.118650 22633 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:21:02.119097 22633 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.121379 22633 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:02.143963 17492 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:02.144801 17492 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:02.145212 17492 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:21:02.145977 22633 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:02.146875 17492 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
W20260709 13:21:02.194517 15720 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16980)
W20260709 13:21:02.250694 17492 consensus_peers.cc:597] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:02.262216 17492 consensus_peers.cc:597] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:02.266525 22633 raft_consensus.cc:493] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:02.267040 22633 raft_consensus.cc:515] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.268960 22633 leader_election.cc:290] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:21:02.269819 22633 raft_consensus.cc:493] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:02.270315 22633 raft_consensus.cc:515] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.272221 22633 leader_election.cc:290] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:21:02.285851 22633 raft_consensus.cc:493] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:02.286435 22633 raft_consensus.cc:515] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.288369 22633 leader_election.cc:290] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:02.293663 17492 leader_election.cc:336] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:02.294219 17492 leader_election.cc:336] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:02.299583 17492 leader_election.cc:336] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:02.300115 17492 leader_election.cc:304] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:02.300915 22633 raft_consensus.cc:2749] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:02.303109 17492 leader_election.cc:336] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:02.303587 17492 leader_election.cc:304] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:02.304369 22633 raft_consensus.cc:2749] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:21:02.307063 22633 raft_consensus.cc:493] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:02.307531 22633 raft_consensus.cc:515] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.310910 22633 leader_election.cc:290] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:02.340672 17492 leader_election.cc:336] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
W20260709 13:21:02.348660 17492 leader_election.cc:336] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:21:02.349182 17492 leader_election.cc:304] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:02.349962 22633 raft_consensus.cc:2749] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:02.351908 17492 consensus_peers.cc:597] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:21:02.355093 17492 leader_election.cc:336] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:02.359735 17492 leader_election.cc:336] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:02.360206 17492 leader_election.cc:304] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:02.360973 22633 raft_consensus.cc:2749] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:02.419498 17492 consensus_peers.cc:597] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:02.440917 22633 raft_consensus.cc:493] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:02.441512 22633 raft_consensus.cc:515] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } attrs { replace: true } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.444017 22633 leader_election.cc:290] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:21:02.445150 22633 raft_consensus.cc:493] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:02.445667 22633 raft_consensus.cc:515] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.449015 22633 leader_election.cc:290] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:02.472443 17492 leader_election.cc:336] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:02.473301 17492 leader_election.cc:336] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:02.473734 17492 leader_election.cc:304] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:21:02.474496 22633 raft_consensus.cc:2749] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:21:02.476429 17492 leader_election.cc:336] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:02.479270 17492 leader_election.cc:336] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
W20260709 13:21:02.480119 17492 leader_election.cc:336] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:02.480544 17492 leader_election.cc:304] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:02.481315 22633 raft_consensus.cc:2749] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:21:02.493686 22633 raft_consensus.cc:493] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:02.494179 22633 raft_consensus.cc:515] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.496194 22633 leader_election.cc:290] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:02.525789 17492 leader_election.cc:336] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
W20260709 13:21:02.526717 17492 leader_election.cc:336] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:21:02.527185 17492 leader_election.cc:304] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:02.528234 22633 raft_consensus.cc:2749] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:21:02.607765 22633 raft_consensus.cc:493] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:02.608320 22633 raft_consensus.cc:515] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.610486 22633 leader_election.cc:290] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:02.627022 17492 leader_election.cc:336] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:02.630065 17492 leader_election.cc:336] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:02.630581 17492 leader_election.cc:304] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:02.631309 22633 raft_consensus.cc:2749] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:02.633587 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:02.691439 22633 raft_consensus.cc:493] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:02.691969 22633 raft_consensus.cc:515] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.693782 22633 leader_election.cc:290] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:02.706496 17492 leader_election.cc:336] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:02.708149 17492 leader_election.cc:336] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:02.708673 17492 leader_election.cc:304] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:02.710541 22633 raft_consensus.cc:2749] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:21:02.762228 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:02.784271 17492 consensus_peers.cc:597] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:02.791003 17492 consensus_peers.cc:597] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:02.873692 22633 raft_consensus.cc:493] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:02.874191 22633 raft_consensus.cc:515] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:02.876518 22633 leader_election.cc:290] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:02.888975 17492 leader_election.cc:336] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
W20260709 13:21:02.889739 17492 leader_election.cc:336] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
I20260709 13:21:02.891223 17492 leader_election.cc:304] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:02.892022 22633 raft_consensus.cc:2749] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:21:02.964025 17492 consensus_peers.cc:597] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:21:02.985963 17492 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:03.031826 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:03.177276 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:03.195015 15720 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 16980)
W20260709 13:21:03.246804 17492 consensus_peers.cc:597] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:03.251538 17492 consensus_peers.cc:597] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:03.256006 17492 consensus_peers.cc:597] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:03.276038 22642 raft_consensus.cc:493] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:21:03.276579 22642 raft_consensus.cc:515] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:03.280128 22642 leader_election.cc:290] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:03.286410 17492 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:03.287525 17492 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:03.287963 17492 leader_election.cc:304] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:21:03.288960 22633 raft_consensus.cc:2749] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:21:03.289737 17492 leader_election.cc:336] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
W20260709 13:21:03.293751 17492 consensus_peers.cc:597] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:03.317716 17492 consensus_peers.cc:597] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:03.320035 17492 consensus_peers.cc:597] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:03.364077 17492 consensus_peers.cc:597] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:21:03.602294 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:21:03.621143 15720 tablet_server.cc:196] TabletServer@127.15.90.3:0 shutdown complete.
W20260709 13:21:03.632647 17492 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111) [suppressed 587 similar messages]
W20260709 13:21:03.636816 17492 consensus_peers.cc:597] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:03.639003 17492 consensus_peers.cc:597] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:03.652249 17492 consensus_peers.cc:597] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:21:03.661404 22644 raft_consensus.cc:493] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4b60b701acc7473e87e3e529a2a34689)
I20260709 13:21:03.661984 22644 raft_consensus.cc:515] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "4b60b701acc7473e87e3e529a2a34689" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33931 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } attrs { replace: true } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:03.665145 22644 leader_election.cc:290] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
I20260709 13:21:03.665833 22644 raft_consensus.cc:493] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ca1b60a074dc47cd8e68cc57a33a94a3)
I20260709 13:21:03.666383 22644 raft_consensus.cc:515] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "96eaa6dafb3e4bbe914e54dc12507912" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46655 } } peers { permanent_uuid: "ca1b60a074dc47cd8e68cc57a33a94a3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33725 } } peers { permanent_uuid: "599f9a88b6cd4e818a1c59a0b4522480" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 35369 } attrs { promote: false } }
I20260709 13:21:03.668570 22644 leader_election.cc:290] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655), ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725)
W20260709 13:21:03.675601 17492 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:03.676646 17492 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111)
I20260709 13:21:03.677078 17492 leader_election.cc:304] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 4b60b701acc7473e87e3e529a2a34689, 96eaa6dafb3e4bbe914e54dc12507912
I20260709 13:21:03.678248 22644 raft_consensus.cc:2749] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:21:03.679988 17492 leader_election.cc:336] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
W20260709 13:21:03.680852 17492 leader_election.cc:336] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111)
W20260709 13:21:03.681777 17492 leader_election.cc:336] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:21:03.682166 17492 leader_election.cc:304] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 599f9a88b6cd4e818a1c59a0b4522480; no voters: 96eaa6dafb3e4bbe914e54dc12507912, ca1b60a074dc47cd8e68cc57a33a94a3
I20260709 13:21:03.682854 22644 raft_consensus.cc:2749] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:21:03.685766 17492 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:21:03.693425 17492 consensus_peers.cc:597] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:03.700348 17492 consensus_peers.cc:597] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): Couldn't send request to peer 96eaa6dafb3e4bbe914e54dc12507912. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:21:03.740154 15720 tablet_server.cc:179] TabletServer@127.15.90.4:0 shutting down...
W20260709 13:21:03.760568 17492 consensus_peers.cc:597] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:21:03.783627 17492 consensus_peers.cc:597] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:03.789093 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:03.789964 15720 tablet_replica.cc:333] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.791102 15720 raft_consensus.cc:2243] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.791882 15720 raft_consensus.cc:2272] T deabeb68cc1e4f73b9a6b49f9f29da22 P 599f9a88b6cd4e818a1c59a0b4522480 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.794415 15720 tablet_replica.cc:333] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.795166 15720 raft_consensus.cc:2243] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.795965 15720 raft_consensus.cc:2272] T 6455509d1ac14e1d961f38607a869924 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.798208 15720 tablet_replica.cc:333] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.798801 15720 raft_consensus.cc:2243] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.799391 15720 raft_consensus.cc:2272] T 1d5fe95d8fc442c7ad6fda1ba72b8ea9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.801286 15720 tablet_replica.cc:333] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.801864 15720 raft_consensus.cc:2243] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.802407 15720 raft_consensus.cc:2272] T be49fe28fec04ec88f4f84bc7aa2149f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.804296 15720 tablet_replica.cc:333] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.804912 15720 raft_consensus.cc:2243] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.805485 15720 raft_consensus.cc:2272] T 7e5bdf407d5944728fca8072489ee727 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.807291 15720 tablet_replica.cc:333] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.807904 15720 raft_consensus.cc:2243] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.809047 15720 raft_consensus.cc:2272] T efa1a19816094c78802287ff39e74b62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.811018 15720 tablet_replica.cc:333] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.811617 15720 raft_consensus.cc:2243] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.812304 15720 raft_consensus.cc:2272] T d157a8f033dd43d5a5c824d9e6235fe9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.814075 15720 tablet_replica.cc:333] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.814644 15720 raft_consensus.cc:2243] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.815393 15720 raft_consensus.cc:2272] T 949d7afc13ea44af96dab1af3a1dd354 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.817575 15720 tablet_replica.cc:333] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.818118 15720 raft_consensus.cc:2243] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.818743 15720 raft_consensus.cc:2272] T 6a0f9edf7f0a4d878e6da7c3949d2dbe P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.821192 15720 tablet_replica.cc:333] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.821780 15720 raft_consensus.cc:2243] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 LEADER]: Raft consensus shutting down.
W20260709 13:21:03.822131 17492 consensus_peers.cc:597] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:03.822837 15720 raft_consensus.cc:2272] T 7fe476f65c0445399ab9cd51828acf2f P 599f9a88b6cd4e818a1c59a0b4522480 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.824889 15720 tablet_replica.cc:333] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.825433 15720 raft_consensus.cc:2243] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.826252 15720 raft_consensus.cc:2272] T 6f6df2c313bf4b0a8bb4d3b4422f4da1 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.828145 15720 tablet_replica.cc:333] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.828694 15720 raft_consensus.cc:2243] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.829452 15720 raft_consensus.cc:2272] T 78ca000fd50c4b38bfdd60badc024845 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.831462 15720 tablet_replica.cc:333] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.832051 15720 raft_consensus.cc:2243] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.833065 15720 raft_consensus.cc:2272] T 3291b51968ff4989a89ff1c802955900 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.834889 15720 tablet_replica.cc:333] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.835441 15720 raft_consensus.cc:2243] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.836181 15720 raft_consensus.cc:2272] T efdef9f5ee0b4225ba140b5208412fde P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.838055 15720 tablet_replica.cc:333] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.838580 15720 raft_consensus.cc:2243] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.839344 15720 raft_consensus.cc:2272] T 4b0d07e74a6f4d4b9accba26620d27f9 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.841087 15720 tablet_replica.cc:333] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.841591 15720 raft_consensus.cc:2243] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.842298 15720 raft_consensus.cc:2272] T 3a7411023b914822890ea380b2bf8efc P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.844061 15720 tablet_replica.cc:333] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.844587 15720 raft_consensus.cc:2243] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.845176 15720 raft_consensus.cc:2272] T caf243a747f348a29b25b4642b64788e P 599f9a88b6cd4e818a1c59a0b4522480 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.847087 15720 tablet_replica.cc:333] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.847626 15720 raft_consensus.cc:2243] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.848197 15720 raft_consensus.cc:2272] T 8abf86e7719a4c7bae84b69e92b761bb P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.850677 15720 tablet_replica.cc:333] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.851264 15720 raft_consensus.cc:2243] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.852142 15720 raft_consensus.cc:2272] T 2e62b3fa7cbf498099f802cfe999bd65 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:03.853135 17492 consensus_peers.cc:597] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer 4b60b701acc7473e87e3e529a2a34689 (127.15.90.2:33931): Couldn't send request to peer 4b60b701acc7473e87e3e529a2a34689. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33931: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:21:03.854652 15720 tablet_replica.cc:333] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.855363 15720 raft_consensus.cc:2243] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.856456 15720 raft_consensus.cc:2272] T 05d0b0f25f26402cb5f324812a9f12c4 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.858759 15720 tablet_replica.cc:333] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.859324 15720 raft_consensus.cc:2243] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.860249 15720 raft_consensus.cc:2272] T 406d9b96060f4833ba26879d81f73bdc P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.862069 15720 tablet_replica.cc:333] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.862548 15720 raft_consensus.cc:2243] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.863291 15720 raft_consensus.cc:2272] T 4c50b9c8ead54558a785ce80fcc5fb62 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.865154 15720 tablet_replica.cc:333] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.865657 15720 raft_consensus.cc:2243] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.866444 15720 raft_consensus.cc:2272] T dbad0fc0e5714f879e763bb34b5f172f P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.868352 15720 tablet_replica.cc:333] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.868909 15720 raft_consensus.cc:2243] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.869625 15720 raft_consensus.cc:2272] T 778275eedaec440eb9d6de3b4984d656 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.871446 15720 tablet_replica.cc:333] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.872014 15720 raft_consensus.cc:2243] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.872490 15720 raft_consensus.cc:2272] T 89c4a22bddc9425886aa0574ae085451 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.874207 15720 tablet_replica.cc:333] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.874714 15720 raft_consensus.cc:2243] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.875475 15720 raft_consensus.cc:2272] T 72998e8e2cff40f3be2ce73539159ecf P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.877291 15720 tablet_replica.cc:333] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.877779 15720 raft_consensus.cc:2243] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.878348 15720 raft_consensus.cc:2272] T 6fb5156c6c9245bfaeffc22854718789 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.880316 15720 tablet_replica.cc:333] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.880832 15720 raft_consensus.cc:2243] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.881613 15720 raft_consensus.cc:2272] T d757b655f89a468ab8fc0ad2914716b7 P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.883352 15720 tablet_replica.cc:333] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.883891 15720 raft_consensus.cc:2243] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.884661 15720 raft_consensus.cc:2272] T aa815b919c824fb196befa2fd6eeac35 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.886495 15720 tablet_replica.cc:333] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.887133 15720 raft_consensus.cc:2243] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.887646 15720 raft_consensus.cc:2272] T e37840a1d83b4fe5be57618ff85b8a47 P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.889923 15720 tablet_replica.cc:333] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.890678 15720 raft_consensus.cc:2243] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.891165 15720 raft_consensus.cc:2272] T c61e860f8a8d481aa272d36c7e4a93e0 P 599f9a88b6cd4e818a1c59a0b4522480 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.893051 15720 tablet_replica.cc:333] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.893527 15720 raft_consensus.cc:2243] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.893965 15720 raft_consensus.cc:2272] T 2ea18b0f585149f0a5558b066b194a9d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.895763 15720 tablet_replica.cc:333] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.896246 15720 raft_consensus.cc:2243] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.897193 15720 raft_consensus.cc:2272] T 0fd370afa4144ee3b93ac6dc4ae63e07 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.899475 15720 tablet_replica.cc:333] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.900275 15720 raft_consensus.cc:2243] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.901010 15720 raft_consensus.cc:2272] T 2bff4b982e59440089e2d3d5b8ada66f P 599f9a88b6cd4e818a1c59a0b4522480 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:03.903229 17492 consensus_peers.cc:597] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 -> Peer ca1b60a074dc47cd8e68cc57a33a94a3 (127.15.90.3:33725): Couldn't send request to peer ca1b60a074dc47cd8e68cc57a33a94a3. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:33725: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:21:03.903491 15720 tablet_replica.cc:333] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.904165 15720 raft_consensus.cc:2243] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.904964 15720 raft_consensus.cc:2272] T f8b8274145134eaa8f14229eceeca799 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.906800 15720 tablet_replica.cc:333] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.907301 15720 raft_consensus.cc:2243] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.907825 15720 raft_consensus.cc:2272] T e9f7a2a0447a4956b36d1e9902e62f56 P 599f9a88b6cd4e818a1c59a0b4522480 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.909780 15720 tablet_replica.cc:333] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.910271 15720 raft_consensus.cc:2243] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.911000 15720 raft_consensus.cc:2272] T 32f35f41a8f1466fb1831fe03e474c4d P 599f9a88b6cd4e818a1c59a0b4522480 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.912863 15720 tablet_replica.cc:333] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.913348 15720 raft_consensus.cc:2243] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.914028 15720 raft_consensus.cc:2272] T 671210bca23f4566a684a188613c1665 P 599f9a88b6cd4e818a1c59a0b4522480 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.915983 15720 tablet_replica.cc:333] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.916517 15720 raft_consensus.cc:2243] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:03.917070 15720 raft_consensus.cc:2272] T efa7919f3d1c40e096823aab461b0e25 P 599f9a88b6cd4e818a1c59a0b4522480 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.918838 15720 tablet_replica.cc:333] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.919291 15720 raft_consensus.cc:2243] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.920109 15720 raft_consensus.cc:2272] T 17115e8a13c346f1998df3bc8f52ec52 P 599f9a88b6cd4e818a1c59a0b4522480 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:03.921849 15720 tablet_replica.cc:333] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480: stopping tablet replica
I20260709 13:21:03.922307 15720 raft_consensus.cc:2243] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:21:03.923101 15720 raft_consensus.cc:2272] T cd1d35ba148544669e52d7293ac9bd82 P 599f9a88b6cd4e818a1c59a0b4522480 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:04.261590 15720 tablet_server.cc:196] TabletServer@127.15.90.4:0 shutdown complete.
I20260709 13:21:04.328096 15720 master.cc:562] Master@127.15.90.62:35161 shutting down...
W20260709 13:21:04.359946 16756 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:21:04.360225 16756 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:04.360446 16756 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:21:09.602074 16694 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20260709 13:21:09.606475 16694 catalog_manager.cc:4755] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 2bff4b982e59440089e2d3d5b8ada66f: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:18.781555 16694 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
W20260709 13:21:18.785552 16694 catalog_manager.cc:4755] TS 96eaa6dafb3e4bbe914e54dc12507912 (127.15.90.1:46655): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7e5bdf407d5944728fca8072489ee727: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46655: connect: Connection refused (error 111)
I20260709 13:21:21.370671 15720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:21.371923 15720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:21.372316 15720 tablet_replica.cc:333] T 00000000000000000000000000000000 P c8653aabbcbd4e268c41b15906779d0b: stopping tablet replica
I20260709 13:21:21.513572 15720 master.cc:584] Master@127.15.90.62:35161 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (186689 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:21:21.640693 15720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.90.62:36463
I20260709 13:21:21.641898 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:21.648461 22651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:21.648821 22652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:21.649708 22654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:21.650151 15720 server_base.cc:1061] running on GCE node
I20260709 13:21:21.653363 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:21.653555 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:21.653743 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603281653725 us; error 0 us; skew 500 ppm
I20260709 13:21:21.654353 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:21.657492 15720 webserver.cc:533] Webserver started at http://127.15.90.62:45567/ using document root <none> and password file <none>
I20260709 13:21:21.658150 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:21.658387 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:21.658699 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:21.660236 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/master-0-root/instance:
uuid: "eaea83fbf998431c991b081d9626e112"
format_stamp: "Formatted at 2026-07-09 13:21:21 on dist-test-slave-fpp7"
I20260709 13:21:21.665109 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:21:21.668762 22659 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:21.669704 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:21:21.670035 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/master-0-root
uuid: "eaea83fbf998431c991b081d9626e112"
format_stamp: "Formatted at 2026-07-09 13:21:21 on dist-test-slave-fpp7"
I20260709 13:21:21.670313 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:21.689713 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:21.691118 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:21.736760 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.62:36463
I20260709 13:21:21.736876 22710 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.62:36463 every 8 connection(s)
I20260709 13:21:21.741390 22711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:21.751968 22711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112: Bootstrap starting.
I20260709 13:21:21.756685 22711 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:21.761060 22711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112: No bootstrap required, opened a new log
I20260709 13:21:21.763245 22711 raft_consensus.cc:359] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaea83fbf998431c991b081d9626e112" member_type: VOTER }
I20260709 13:21:21.763729 22711 raft_consensus.cc:385] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:21.763944 22711 raft_consensus.cc:740] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaea83fbf998431c991b081d9626e112, State: Initialized, Role: FOLLOWER
I20260709 13:21:21.764520 22711 consensus_queue.cc:260] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaea83fbf998431c991b081d9626e112" member_type: VOTER }
I20260709 13:21:21.764959 22711 raft_consensus.cc:399] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:21.765161 22711 raft_consensus.cc:493] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:21.765389 22711 raft_consensus.cc:3060] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:21.770886 22711 raft_consensus.cc:515] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaea83fbf998431c991b081d9626e112" member_type: VOTER }
I20260709 13:21:21.771344 22711 leader_election.cc:304] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eaea83fbf998431c991b081d9626e112; no voters: 
I20260709 13:21:21.772651 22711 leader_election.cc:290] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:21.773051 22714 raft_consensus.cc:2804] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:21.774662 22714 raft_consensus.cc:697] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [term 1 LEADER]: Becoming Leader. State: Replica: eaea83fbf998431c991b081d9626e112, State: Running, Role: LEADER
I20260709 13:21:21.775458 22714 consensus_queue.cc:237] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaea83fbf998431c991b081d9626e112" member_type: VOTER }
I20260709 13:21:21.775738 22711 sys_catalog.cc:565] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:21.783797 22715 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eaea83fbf998431c991b081d9626e112" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaea83fbf998431c991b081d9626e112" member_type: VOTER } }
I20260709 13:21:21.783995 22716 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eaea83fbf998431c991b081d9626e112. Latest consensus state: current_term: 1 leader_uuid: "eaea83fbf998431c991b081d9626e112" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaea83fbf998431c991b081d9626e112" member_type: VOTER } }
I20260709 13:21:21.784708 22715 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:21.784870 22716 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:21.793821 22724 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:21.799480 22724 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:21.800679 15720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:21.809026 22724 catalog_manager.cc:1383] Generated new cluster ID: 57e3477bcdcf41858caba82206ea2490
I20260709 13:21:21.809334 22724 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:21.838976 22724 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:21.840517 22724 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:21.857652 22724 catalog_manager.cc:6070] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112: Generated new TSK 0
I20260709 13:21:21.858290 22724 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:21.867782 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:21.874065 22732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:21.874910 22733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:21.877398 15720 server_base.cc:1061] running on GCE node
W20260709 13:21:21.877882 22735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:21.879428 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:21.879654 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:21.879887 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603281879868 us; error 0 us; skew 500 ppm
I20260709 13:21:21.880460 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:21.882802 15720 webserver.cc:533] Webserver started at http://127.15.90.1:46377/ using document root <none> and password file <none>
I20260709 13:21:21.883332 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:21.883536 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:21.883831 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:21.885062 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/instance:
uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
format_stamp: "Formatted at 2026-07-09 13:21:21 on dist-test-slave-fpp7"
I20260709 13:21:21.889739 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:21:21.893110 22740 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:21.893980 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:21:21.894335 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-0-root
uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
format_stamp: "Formatted at 2026-07-09 13:21:21 on dist-test-slave-fpp7"
I20260709 13:21:21.894686 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:21.919665 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:21.920845 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:21.922259 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:21.924563 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:21.924741 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:21.925053 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:21.925328 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:21.966465 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.1:34811
I20260709 13:21:21.966645 22802 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.1:34811 every 8 connection(s)
I20260709 13:21:21.971872 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:21.980134 22807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:21.981262 22808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:21.984988 15720 server_base.cc:1061] running on GCE node
W20260709 13:21:21.986246 22810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:21.987756 22803 heartbeater.cc:344] Connected to a master server at 127.15.90.62:36463
I20260709 13:21:21.987830 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:21.988206 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:21.988227 22803 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:21.988473 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603281988436 us; error 0 us; skew 500 ppm
I20260709 13:21:21.989120 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:21.989169 22803 heartbeater.cc:507] Master 127.15.90.62:36463 requested a full tablet report, sending...
I20260709 13:21:21.991608 22676 ts_manager.cc:194] Registered new tserver with Master: e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:21.991923 15720 webserver.cc:533] Webserver started at http://127.15.90.2:44279/ using document root <none> and password file <none>
I20260709 13:21:21.992507 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:21.992720 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:21.992990 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:21.993754 22676 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34304
I20260709 13:21:21.994347 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/instance:
uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
format_stamp: "Formatted at 2026-07-09 13:21:21 on dist-test-slave-fpp7"
I20260709 13:21:21.999073 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:21:22.002827 22815 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.003741 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:21:22.003994 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-1-root
uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
format_stamp: "Formatted at 2026-07-09 13:21:21 on dist-test-slave-fpp7"
I20260709 13:21:22.004218 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:22.032936 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:22.034117 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:22.035627 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:22.037869 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:22.038039 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.038338 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:22.038475 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.083750 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.2:43687
I20260709 13:21:22.083868 22877 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.2:43687 every 8 connection(s)
I20260709 13:21:22.088775 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:22.096309 22881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:22.097265 22882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:22.100196 22884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:22.101601 15720 server_base.cc:1061] running on GCE node
I20260709 13:21:22.101727 22878 heartbeater.cc:344] Connected to a master server at 127.15.90.62:36463
I20260709 13:21:22.102231 22878 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:22.102629 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:22.102892 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:22.103000 22878 heartbeater.cc:507] Master 127.15.90.62:36463 requested a full tablet report, sending...
I20260709 13:21:22.103077 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603282103060 us; error 0 us; skew 500 ppm
I20260709 13:21:22.103994 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:22.105453 22676 ts_manager.cc:194] Registered new tserver with Master: 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:22.107084 15720 webserver.cc:533] Webserver started at http://127.15.90.3:46113/ using document root <none> and password file <none>
I20260709 13:21:22.107383 22676 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34318
I20260709 13:21:22.107836 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:22.108127 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:22.108455 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:22.109654 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/instance:
uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
format_stamp: "Formatted at 2026-07-09 13:21:22 on dist-test-slave-fpp7"
I20260709 13:21:22.114123 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:22.117324 22889 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.117996 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:21:22.118286 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-2-root
uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
format_stamp: "Formatted at 2026-07-09 13:21:22 on dist-test-slave-fpp7"
I20260709 13:21:22.118561 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:22.137332 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:22.138589 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:22.140134 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:22.142354 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:22.142580 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.142824 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:22.143006 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.185668 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.3:34985
I20260709 13:21:22.185810 22951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.3:34985 every 8 connection(s)
I20260709 13:21:22.190805 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:22.199115 22955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:22.199350 22956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:22.202775 22958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:22.203933 15720 server_base.cc:1061] running on GCE node
I20260709 13:21:22.204195 22952 heartbeater.cc:344] Connected to a master server at 127.15.90.62:36463
I20260709 13:21:22.204628 22952 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:22.205036 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:22.205368 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:22.205592 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603282205571 us; error 0 us; skew 500 ppm
I20260709 13:21:22.205621 22952 heartbeater.cc:507] Master 127.15.90.62:36463 requested a full tablet report, sending...
I20260709 13:21:22.206530 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:22.208168 22676 ts_manager.cc:194] Registered new tserver with Master: 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:22.209475 15720 webserver.cc:533] Webserver started at http://127.15.90.4:37941/ using document root <none> and password file <none>
I20260709 13:21:22.210000 22676 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34322
I20260709 13:21:22.210127 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:22.210453 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:22.210805 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:22.212334 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-3-root/instance:
uuid: "f825e4bed376497e95838e1b82dc1a03"
format_stamp: "Formatted at 2026-07-09 13:21:22 on dist-test-slave-fpp7"
I20260709 13:21:22.217573 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:21:22.222512 22963 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.223373 15720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:21:22.223776 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-3-root
uuid: "f825e4bed376497e95838e1b82dc1a03"
format_stamp: "Formatted at 2026-07-09 13:21:22 on dist-test-slave-fpp7"
I20260709 13:21:22.224112 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:22.235858 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:22.237063 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:22.238474 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:22.240641 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:22.240864 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.241098 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:22.241281 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:22.282685 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.4:44325
I20260709 13:21:22.282781 23025 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.4:44325 every 8 connection(s)
I20260709 13:21:22.296901 23026 heartbeater.cc:344] Connected to a master server at 127.15.90.62:36463
I20260709 13:21:22.297418 23026 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:22.298233 23026 heartbeater.cc:507] Master 127.15.90.62:36463 requested a full tablet report, sending...
I20260709 13:21:22.300185 22676 ts_manager.cc:194] Registered new tserver with Master: f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:22.301004 15720 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014874107s
I20260709 13:21:22.301667 22676 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34332
I20260709 13:21:22.327883 22676 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34346:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:21:22.555938 22991 tablet_service.cc:1511] Processing CreateTablet for tablet 48d3f266650349d2a9181aebd298df50 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:22.557874 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d3f266650349d2a9181aebd298df50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.566540 22843 tablet_service.cc:1511] Processing CreateTablet for tablet 48d3f266650349d2a9181aebd298df50 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:22.568033 22843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d3f266650349d2a9181aebd298df50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.570693 22842 tablet_service.cc:1511] Processing CreateTablet for tablet 16cd39cc57d84d3db47221d4164f3086 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:22.572094 22842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16cd39cc57d84d3db47221d4164f3086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.585279 23046 tablet_bootstrap.cc:492] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:22.589619 22991 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7056b89dcd402082c0a745eb8e9b79 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:22.590121 22841 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7056b89dcd402082c0a745eb8e9b79 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:22.591147 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7056b89dcd402082c0a745eb8e9b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.591503 22841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7056b89dcd402082c0a745eb8e9b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.592918 22768 tablet_service.cc:1511] Processing CreateTablet for tablet 16cd39cc57d84d3db47221d4164f3086 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:22.594305 22768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16cd39cc57d84d3db47221d4164f3086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.596896 22767 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7056b89dcd402082c0a745eb8e9b79 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:21:22.598316 22767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7056b89dcd402082c0a745eb8e9b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.602512 22763 tablet_service.cc:1511] Processing CreateTablet for tablet 3cac43f433204c9d8dc8d65558ae3269 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:22.603587 22764 tablet_service.cc:1511] Processing CreateTablet for tablet 89d50aaee99348959ee8e1d85e3c18bb (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:22.605804 22766 tablet_service.cc:1511] Processing CreateTablet for tablet 4f88630e7ac244caa791ca47a1ef8031 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:22.606989 22990 tablet_service.cc:1511] Processing CreateTablet for tablet 4f88630e7ac244caa791ca47a1ef8031 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:22.608455 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f88630e7ac244caa791ca47a1ef8031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.608228 22837 tablet_service.cc:1511] Processing CreateTablet for tablet bc14860c91ac4d97bc55ddecd79c6ac5 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:22.609885 22837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc14860c91ac4d97bc55ddecd79c6ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.609802 22839 tablet_service.cc:1511] Processing CreateTablet for tablet 89d50aaee99348959ee8e1d85e3c18bb (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:22.611224 22839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d50aaee99348959ee8e1d85e3c18bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.602515 22765 tablet_service.cc:1511] Processing CreateTablet for tablet 4d21ac823716443b908d3e64bd1270a8 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:22.608249 22986 tablet_service.cc:1511] Processing CreateTablet for tablet c42f0026e60841c6b5a416128dc2f590 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:22.613186 22986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42f0026e60841c6b5a416128dc2f590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.612936 22989 tablet_service.cc:1511] Processing CreateTablet for tablet 89d50aaee99348959ee8e1d85e3c18bb (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:21:22.614331 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d50aaee99348959ee8e1d85e3c18bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.614833 22762 tablet_service.cc:1511] Processing CreateTablet for tablet bc14860c91ac4d97bc55ddecd79c6ac5 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:22.612931 22838 tablet_service.cc:1511] Processing CreateTablet for tablet be0ee46f570945638b5a510259726a6c (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:22.618664 22987 tablet_service.cc:1511] Processing CreateTablet for tablet be0ee46f570945638b5a510259726a6c (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:22.619263 22838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0ee46f570945638b5a510259726a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.618999 22759 tablet_service.cc:1511] Processing CreateTablet for tablet e393e8c4349b473abd5f35159d141168 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:22.620388 22763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cac43f433204c9d8dc8d65558ae3269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.620332 22761 tablet_service.cc:1511] Processing CreateTablet for tablet c42f0026e60841c6b5a416128dc2f590 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:22.621603 22764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d50aaee99348959ee8e1d85e3c18bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.621891 22988 tablet_service.cc:1511] Processing CreateTablet for tablet 3cac43f433204c9d8dc8d65558ae3269 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:22.622052 22760 tablet_service.cc:1511] Processing CreateTablet for tablet ea7e2a19f1474c1fb8f98ee12a3be096 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:22.623334 22988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cac43f433204c9d8dc8d65558ae3269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.608237 22840 tablet_service.cc:1511] Processing CreateTablet for tablet 4d21ac823716443b908d3e64bd1270a8 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:22.625303 22840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d21ac823716443b908d3e64bd1270a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.625072 22836 tablet_service.cc:1511] Processing CreateTablet for tablet c42f0026e60841c6b5a416128dc2f590 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:21:22.626837 22836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42f0026e60841c6b5a416128dc2f590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.622705 22765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d21ac823716443b908d3e64bd1270a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.628389 22766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f88630e7ac244caa791ca47a1ef8031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.629460 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7e2a19f1474c1fb8f98ee12a3be096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.630286 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc14860c91ac4d97bc55ddecd79c6ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.632810 22987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0ee46f570945638b5a510259726a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.634083 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42f0026e60841c6b5a416128dc2f590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.635532 22759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e393e8c4349b473abd5f35159d141168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.646358 22835 tablet_service.cc:1511] Processing CreateTablet for tablet e8f26f54e66f4e90be987ab9d14e554f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:22.648411 22835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f26f54e66f4e90be987ab9d14e554f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.650038 22985 tablet_service.cc:1511] Processing CreateTablet for tablet ea7e2a19f1474c1fb8f98ee12a3be096 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:22.651494 22985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7e2a19f1474c1fb8f98ee12a3be096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.657796 22834 tablet_service.cc:1511] Processing CreateTablet for tablet e393e8c4349b473abd5f35159d141168 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:22.659199 22834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e393e8c4349b473abd5f35159d141168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.662201 22984 tablet_service.cc:1511] Processing CreateTablet for tablet e8f26f54e66f4e90be987ab9d14e554f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:22.663653 22984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f26f54e66f4e90be987ab9d14e554f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.668936 22917 tablet_service.cc:1511] Processing CreateTablet for tablet 48d3f266650349d2a9181aebd298df50 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:21:22.670425 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d3f266650349d2a9181aebd298df50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.672971 22916 tablet_service.cc:1511] Processing CreateTablet for tablet 16cd39cc57d84d3db47221d4164f3086 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:21:22.674396 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16cd39cc57d84d3db47221d4164f3086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.676921 22915 tablet_service.cc:1511] Processing CreateTablet for tablet 4f88630e7ac244caa791ca47a1ef8031 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:21:22.678375 22915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f88630e7ac244caa791ca47a1ef8031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.680968 22914 tablet_service.cc:1511] Processing CreateTablet for tablet 4d21ac823716443b908d3e64bd1270a8 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:21:22.682368 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d21ac823716443b908d3e64bd1270a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.684872 22913 tablet_service.cc:1511] Processing CreateTablet for tablet 3cac43f433204c9d8dc8d65558ae3269 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:21:22.686775 22913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cac43f433204c9d8dc8d65558ae3269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.687556 22912 tablet_service.cc:1511] Processing CreateTablet for tablet be0ee46f570945638b5a510259726a6c (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:21:22.688952 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0ee46f570945638b5a510259726a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.693006 23046 tablet_bootstrap.cc:654] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.692950 22910 tablet_service.cc:1511] Processing CreateTablet for tablet ea7e2a19f1474c1fb8f98ee12a3be096 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:21:22.694465 22910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7e2a19f1474c1fb8f98ee12a3be096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.696918 22911 tablet_service.cc:1511] Processing CreateTablet for tablet bc14860c91ac4d97bc55ddecd79c6ac5 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:21:22.698213 22911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc14860c91ac4d97bc55ddecd79c6ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.701329 22983 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6efd72b4114248adef337292eaede0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:22.701678 22909 tablet_service.cc:1511] Processing CreateTablet for tablet e8f26f54e66f4e90be987ab9d14e554f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:21:22.702680 22983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6efd72b4114248adef337292eaede0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.709599 22909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8f26f54e66f4e90be987ab9d14e554f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.716850 22908 tablet_service.cc:1511] Processing CreateTablet for tablet e393e8c4349b473abd5f35159d141168 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:21:22.718139 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e393e8c4349b473abd5f35159d141168. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.733258 22982 tablet_service.cc:1511] Processing CreateTablet for tablet f864d0fd88e94640a4e91ad8ebdb19d6 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:22.734643 22982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f864d0fd88e94640a4e91ad8ebdb19d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.783644 23048 tablet_bootstrap.cc:492] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
W20260709 13:21:22.789377 22723 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:22.793335 23047 tablet_bootstrap.cc:492] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:22.801836 22842 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6efd72b4114248adef337292eaede0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:22.803176 22842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6efd72b4114248adef337292eaede0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.810405 23047 tablet_bootstrap.cc:654] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.812189 22839 tablet_service.cc:1511] Processing CreateTablet for tablet 4740c47164894cbe8add259947545a4e (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:22.813530 22839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4740c47164894cbe8add259947545a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.839079 22989 tablet_service.cc:1511] Processing CreateTablet for tablet 4740c47164894cbe8add259947545a4e (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:22.839514 22841 tablet_service.cc:1511] Processing CreateTablet for tablet cf330fe4b59c472a9c3bcb18161ff906 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:22.848707 22768 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6efd72b4114248adef337292eaede0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:21:22.851133 22765 tablet_service.cc:1511] Processing CreateTablet for tablet f864d0fd88e94640a4e91ad8ebdb19d6 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:22.856817 22767 tablet_service.cc:1511] Processing CreateTablet for tablet cf330fe4b59c472a9c3bcb18161ff906 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:22.857230 22761 tablet_service.cc:1511] Processing CreateTablet for tablet 5e4bbf8e1a12402f8ecefd83160f4672 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:22.857899 22760 tablet_service.cc:1511] Processing CreateTablet for tablet 7915d0ecd98c4c04b76169d6a45314e3 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:22.859772 22987 tablet_service.cc:1511] Processing CreateTablet for tablet 5e4bbf8e1a12402f8ecefd83160f4672 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:22.860877 22766 tablet_service.cc:1511] Processing CreateTablet for tablet d5b8344825d146b8b8c05ae651fb0d9a (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:22.868325 22984 tablet_service.cc:1511] Processing CreateTablet for tablet 7915d0ecd98c4c04b76169d6a45314e3 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:22.869392 22909 tablet_service.cc:1511] Processing CreateTablet for tablet 4740c47164894cbe8add259947545a4e (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:21:22.871811 22983 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8ad0acb5ce4ffc9edaa00062e64060 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:22.877220 22834 tablet_service.cc:1511] Processing CreateTablet for tablet 5e4bbf8e1a12402f8ecefd83160f4672 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:21:22.922380 22917 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8ad0acb5ce4ffc9edaa00062e64060 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:22.941164 22909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4740c47164894cbe8add259947545a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.879050 22836 tablet_service.cc:1511] Processing CreateTablet for tablet 3c8ad0acb5ce4ffc9edaa00062e64060 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:21:22.879248 22911 tablet_service.cc:1511] Processing CreateTablet for tablet cf330fe4b59c472a9c3bcb18161ff906 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:21:22.941931 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8ad0acb5ce4ffc9edaa00062e64060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.942732 22911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf330fe4b59c472a9c3bcb18161ff906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.942772 22768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6efd72b4114248adef337292eaede0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.891981 22914 tablet_service.cc:1511] Processing CreateTablet for tablet 7915d0ecd98c4c04b76169d6a45314e3 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:21:22.899151 23048 tablet_bootstrap.cc:654] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:22.948513 22766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b8344825d146b8b8c05ae651fb0d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.919495 22988 tablet_service.cc:1511] Processing CreateTablet for tablet b29fe64535814ccd8d9f4f20f00c6f1d (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:22.938314 23050 tablet_bootstrap.cc:492] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:22.924443 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4740c47164894cbe8add259947545a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.950733 22765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f864d0fd88e94640a4e91ad8ebdb19d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.955381 22982 tablet_service.cc:1511] Processing CreateTablet for tablet ac2381149a5f40939b61970905b68e8e (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:22.956354 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7915d0ecd98c4c04b76169d6a45314e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.965804 22983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8ad0acb5ce4ffc9edaa00062e64060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.956019 22912 tablet_service.cc:1511] Processing CreateTablet for tablet f864d0fd88e94640a4e91ad8ebdb19d6 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:21:22.968017 22982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2381149a5f40939b61970905b68e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.968545 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f864d0fd88e94640a4e91ad8ebdb19d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.969537 23046 tablet_bootstrap.cc:492] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:22.949674 22759 tablet_service.cc:1511] Processing CreateTablet for tablet b29fe64535814ccd8d9f4f20f00c6f1d (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:22.970041 23046 ts_tablet_manager.cc:1403] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.385s	user 0.037s	sys 0.041s
I20260709 13:21:22.934549 22843 tablet_service.cc:1511] Processing CreateTablet for tablet d5b8344825d146b8b8c05ae651fb0d9a (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:22.962914 22763 tablet_service.cc:1511] Processing CreateTablet for tablet ac2381149a5f40939b61970905b68e8e (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:22.973502 22913 tablet_service.cc:1511] Processing CreateTablet for tablet ac2381149a5f40939b61970905b68e8e (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:21:22.974934 22913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2381149a5f40939b61970905b68e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.965044 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7915d0ecd98c4c04b76169d6a45314e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.993120 22835 tablet_service.cc:1511] Processing CreateTablet for tablet b29fe64535814ccd8d9f4f20f00c6f1d (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:21:22.939961 22841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf330fe4b59c472a9c3bcb18161ff906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.976038 22987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e4bbf8e1a12402f8ecefd83160f4672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.996096 22836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c8ad0acb5ce4ffc9edaa00062e64060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.979944 23046 raft_consensus.cc:359] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:22.999859 23046 raft_consensus.cc:385] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.000054 22767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf330fe4b59c472a9c3bcb18161ff906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.000190 23046 raft_consensus.cc:740] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.001226 23046 consensus_queue.cc:260] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:22.933857 22910 tablet_service.cc:1511] Processing CreateTablet for tablet d5b8344825d146b8b8c05ae651fb0d9a (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:21:22.996591 22803 heartbeater.cc:499] Master 127.15.90.62:36463 was elected leader, sending a full tablet report...
I20260709 13:21:23.007975 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e4bbf8e1a12402f8ecefd83160f4672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.011983 22984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7915d0ecd98c4c04b76169d6a45314e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.012372 22910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b8344825d146b8b8c05ae651fb0d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.015993 22763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2381149a5f40939b61970905b68e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.020457 22834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e4bbf8e1a12402f8ecefd83160f4672. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.023761 22759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29fe64535814ccd8d9f4f20f00c6f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:22.980036 23047 tablet_bootstrap.cc:492] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:23.031474 23047 ts_tablet_manager.cc:1403] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.238s	user 0.021s	sys 0.044s
I20260709 13:21:23.041961 22988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29fe64535814ccd8d9f4f20f00c6f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.042109 22843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5b8344825d146b8b8c05ae651fb0d9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.049592 22842 tablet_service.cc:1511] Processing CreateTablet for tablet d0f2c58a06ac445b85ec78b0e8531134 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:23.060732 23046 ts_tablet_manager.cc:1434] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.090s	user 0.013s	sys 0.017s
I20260709 13:21:23.061100 22985 tablet_service.cc:1511] Processing CreateTablet for tablet d0f2c58a06ac445b85ec78b0e8531134 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:23.061528 23026 heartbeater.cc:499] Master 127.15.90.62:36463 was elected leader, sending a full tablet report...
I20260709 13:21:23.063898 22909 tablet_service.cc:1511] Processing CreateTablet for tablet d0f2c58a06ac445b85ec78b0e8531134 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:21:23.064049 22768 tablet_service.cc:1511] Processing CreateTablet for tablet b5f1e1efb4c24fafb2972dda3ab17c89 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:23.065204 22909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f2c58a06ac445b85ec78b0e8531134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.065357 22768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f1e1efb4c24fafb2972dda3ab17c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.066800 22839 tablet_service.cc:1511] Processing CreateTablet for tablet b5f1e1efb4c24fafb2972dda3ab17c89 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:23.070736 22991 tablet_service.cc:1511] Processing CreateTablet for tablet 670cb5d0cf514ec78871a6a32e316c13 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:23.072212 22839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f1e1efb4c24fafb2972dda3ab17c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.072840 23050 tablet_bootstrap.cc:654] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.073451 22916 tablet_service.cc:1511] Processing CreateTablet for tablet b5f1e1efb4c24fafb2972dda3ab17c89 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:21:23.074687 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f1e1efb4c24fafb2972dda3ab17c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.084900 22835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29fe64535814ccd8d9f4f20f00c6f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.090377 22985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f2c58a06ac445b85ec78b0e8531134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.094841 23046 tablet_bootstrap.cc:492] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:23.099452 22842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f2c58a06ac445b85ec78b0e8531134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.100016 22762 tablet_service.cc:1511] Processing CreateTablet for tablet 670cb5d0cf514ec78871a6a32e316c13 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:23.100085 22838 tablet_service.cc:1511] Processing CreateTablet for tablet 670cb5d0cf514ec78871a6a32e316c13 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:21:23.101366 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670cb5d0cf514ec78871a6a32e316c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.101426 22838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670cb5d0cf514ec78871a6a32e316c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.111570 22878 heartbeater.cc:499] Master 127.15.90.62:36463 was elected leader, sending a full tablet report...
I20260709 13:21:23.124264 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670cb5d0cf514ec78871a6a32e316c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.174052 22908 tablet_service.cc:1511] Processing CreateTablet for tablet aac6ba45a5de4dfdab02fd99a9ba3976 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:23.175406 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac6ba45a5de4dfdab02fd99a9ba3976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.193534 23048 tablet_bootstrap.cc:492] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:23.194142 23048 ts_tablet_manager.cc:1403] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.411s	user 0.010s	sys 0.016s
I20260709 13:21:23.197754 22990 tablet_service.cc:1511] Processing CreateTablet for tablet aac6ba45a5de4dfdab02fd99a9ba3976 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:23.199051 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac6ba45a5de4dfdab02fd99a9ba3976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.199112 22765 tablet_service.cc:1511] Processing CreateTablet for tablet aac6ba45a5de4dfdab02fd99a9ba3976 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:21:23.205353 23046 tablet_bootstrap.cc:654] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.206840 23047 raft_consensus.cc:359] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:23.207096 22912 tablet_service.cc:1511] Processing CreateTablet for tablet ea82caef4f4f439c84611d5e6a9c10df (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:23.207620 23047 raft_consensus.cc:385] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.208046 23047 raft_consensus.cc:740] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.208410 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea82caef4f4f439c84611d5e6a9c10df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.208854 23047 consensus_queue.cc:260] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:23.213591 22952 heartbeater.cc:499] Master 127.15.90.62:36463 was elected leader, sending a full tablet report...
I20260709 13:21:23.214570 22838 tablet_service.cc:1511] Processing CreateTablet for tablet ea82caef4f4f439c84611d5e6a9c10df (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:23.215832 22838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea82caef4f4f439c84611d5e6a9c10df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.221671 23048 raft_consensus.cc:359] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:23.222536 23048 raft_consensus.cc:385] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.222892 23048 raft_consensus.cc:740] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.223812 23048 consensus_queue.cc:260] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:23.222160 22986 tablet_service.cc:1511] Processing CreateTablet for tablet ea82caef4f4f439c84611d5e6a9c10df (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:21:23.228374 22765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac6ba45a5de4dfdab02fd99a9ba3976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.230711 22986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea82caef4f4f439c84611d5e6a9c10df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.271560 23047 ts_tablet_manager.cc:1434] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.227s	user 0.007s	sys 0.000s
I20260709 13:21:23.272905 23047 tablet_bootstrap.cc:492] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:23.288442 23050 tablet_bootstrap.cc:492] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:23.289073 23050 ts_tablet_manager.cc:1403] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.351s	user 0.021s	sys 0.011s
I20260709 13:21:23.290772 22762 tablet_service.cc:1511] Processing CreateTablet for tablet 2e393b9cf9a849f4ad63eea1da23ea42 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 13:21:23.292941 23027 tablet.cc:2406] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:23.302973 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e393b9cf9a849f4ad63eea1da23ea42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.306316 23048 ts_tablet_manager.cc:1434] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.000s
I20260709 13:21:23.312016 23050 raft_consensus.cc:359] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:23.315178 23050 raft_consensus.cc:385] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.314791 23046 tablet_bootstrap.cc:492] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:23.315961 23046 ts_tablet_manager.cc:1403] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.230s	user 0.018s	sys 0.004s
I20260709 13:21:23.318924 23046 raft_consensus.cc:359] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:23.319694 23046 raft_consensus.cc:385] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.322350 23048 tablet_bootstrap.cc:492] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:23.324730 22761 tablet_service.cc:1511] Processing CreateTablet for tablet 33209c9cbc0949fb933224b7cb5dce53 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:23.330664 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33209c9cbc0949fb933224b7cb5dce53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.333317 22983 tablet_service.cc:1511] Processing CreateTablet for tablet e3b1972dac5349e4b8f76620d14d5d10 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:23.334614 22983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b1972dac5349e4b8f76620d14d5d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.327440 22842 tablet_service.cc:1511] Processing CreateTablet for tablet 2e393b9cf9a849f4ad63eea1da23ea42 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:23.335820 22842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e393b9cf9a849f4ad63eea1da23ea42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.350920 22759 tablet_service.cc:1511] Processing CreateTablet for tablet 748bcf9f05f946f89a17dd918d410984 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:23.351765 23050 raft_consensus.cc:740] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.352382 22759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748bcf9f05f946f89a17dd918d410984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.352698 22836 tablet_service.cc:1511] Processing CreateTablet for tablet 748bcf9f05f946f89a17dd918d410984 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:23.354000 22836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748bcf9f05f946f89a17dd918d410984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.331166 22984 tablet_service.cc:1511] Processing CreateTablet for tablet 33209c9cbc0949fb933224b7cb5dce53 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:23.355798 22984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33209c9cbc0949fb933224b7cb5dce53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.356525 22988 tablet_service.cc:1511] Processing CreateTablet for tablet 8785be4ba2dd4539af50dfdc6562cde0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:23.356683 22911 tablet_service.cc:1511] Processing CreateTablet for tablet 8785be4ba2dd4539af50dfdc6562cde0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:23.357897 22988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8785be4ba2dd4539af50dfdc6562cde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.358913 22760 tablet_service.cc:1511] Processing CreateTablet for tablet 8785be4ba2dd4539af50dfdc6562cde0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:21:23.331950 22914 tablet_service.cc:1511] Processing CreateTablet for tablet e3b1972dac5349e4b8f76620d14d5d10 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:23.360359 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8785be4ba2dd4539af50dfdc6562cde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.361006 22839 tablet_service.cc:1511] Processing CreateTablet for tablet 988592b5b572476ea8821180ae41bcda (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:23.361110 22915 tablet_service.cc:1511] Processing CreateTablet for tablet 988592b5b572476ea8821180ae41bcda (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:23.328608 22843 tablet_service.cc:1511] Processing CreateTablet for tablet 33209c9cbc0949fb933224b7cb5dce53 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:21:23.362257 22839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988592b5b572476ea8821180ae41bcda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.362911 22843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33209c9cbc0949fb933224b7cb5dce53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.363780 23050 consensus_queue.cc:260] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:23.365939 22991 tablet_service.cc:1511] Processing CreateTablet for tablet 988592b5b572476ea8821180ae41bcda (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:21:23.335877 22767 tablet_service.cc:1511] Processing CreateTablet for tablet e3b1972dac5349e4b8f76620d14d5d10 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:21:23.369279 22767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b1972dac5349e4b8f76620d14d5d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.369118 22912 tablet_service.cc:1511] Processing CreateTablet for tablet 2e393b9cf9a849f4ad63eea1da23ea42 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:21:23.369603 22840 tablet_service.cc:1511] Processing CreateTablet for tablet 0e757b2ce6374ff88418cc08fe5cfd25 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:23.370939 22840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e757b2ce6374ff88418cc08fe5cfd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.375734 22913 tablet_service.cc:1511] Processing CreateTablet for tablet 0e757b2ce6374ff88418cc08fe5cfd25 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:23.337580 22834 tablet_service.cc:1511] Processing CreateTablet for tablet f67ba2c2d8c24fe581aab7a2463846ad (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:23.378010 22990 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaa4be81c4a4ce6bc080164640cab8a (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:23.338078 22910 tablet_service.cc:1511] Processing CreateTablet for tablet f67ba2c2d8c24fe581aab7a2463846ad (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:23.340081 22987 tablet_service.cc:1511] Processing CreateTablet for tablet f67ba2c2d8c24fe581aab7a2463846ad (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:21:23.343430 22841 tablet_service.cc:1511] Processing CreateTablet for tablet 9928bc913a6d4447b83c59ac19cbcf25 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:23.380065 22764 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaa4be81c4a4ce6bc080164640cab8a (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:23.381446 22764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaa4be81c4a4ce6bc080164640cab8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.346959 22908 tablet_service.cc:1511] Processing CreateTablet for tablet 9928bc913a6d4447b83c59ac19cbcf25 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:23.348949 22989 tablet_service.cc:1511] Processing CreateTablet for tablet 748bcf9f05f946f89a17dd918d410984 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:21:23.391042 22917 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6596aca14e4f31bea39731d8a95dfc (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:23.397034 22837 tablet_service.cc:1511] Processing CreateTablet for tablet 5d1fb76060d7483698646276d085257f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:23.400908 22982 tablet_service.cc:1511] Processing CreateTablet for tablet 5d1fb76060d7483698646276d085257f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:23.406337 22838 tablet_service.cc:1511] Processing CreateTablet for tablet 1aaa4be81c4a4ce6bc080164640cab8a (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:21:23.408399 22986 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6596aca14e4f31bea39731d8a95dfc (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:23.329540 23047 tablet_bootstrap.cc:654] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.367213 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988592b5b572476ea8821180ae41bcda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.320034 23046 raft_consensus.cc:740] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.367717 22766 tablet_service.cc:1511] Processing CreateTablet for tablet 0e757b2ce6374ff88418cc08fe5cfd25 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:21:23.378585 22834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67ba2c2d8c24fe581aab7a2463846ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.341979 22765 tablet_service.cc:1511] Processing CreateTablet for tablet 9928bc913a6d4447b83c59ac19cbcf25 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:21:23.426245 22766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e757b2ce6374ff88418cc08fe5cfd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.428610 22982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1fb76060d7483698646276d085257f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.432008 22987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67ba2c2d8c24fe581aab7a2463846ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.432546 22765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9928bc913a6d4447b83c59ac19cbcf25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.438338 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9928bc913a6d4447b83c59ac19cbcf25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.438548 23058 raft_consensus.cc:493] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.439061 23058 raft_consensus.cc:515] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:23.441679 23058 leader_election.cc:290] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:23.440794 22768 tablet_service.cc:1511] Processing CreateTablet for tablet b1c5e4b2a4d642ef918c312a6ab1b808 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:23.446379 22768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c5e4b2a4d642ef918c312a6ab1b808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.446003 23046 consensus_queue.cc:260] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:23.443645 22837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1fb76060d7483698646276d085257f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.446822 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 748bcf9f05f946f89a17dd918d410984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.468622 22916 tablet_service.cc:1511] Processing CreateTablet for tablet b1c5e4b2a4d642ef918c312a6ab1b808 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:23.473997 22835 tablet_service.cc:1511] Processing CreateTablet for tablet 62e34545b8f644c28059e013cdd0590b (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:23.475435 22835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e34545b8f644c28059e013cdd0590b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.479645 22909 tablet_service.cc:1511] Processing CreateTablet for tablet 5d1fb76060d7483698646276d085257f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:21:23.460127 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6596aca14e4f31bea39731d8a95dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.491186 22909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1fb76060d7483698646276d085257f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.500954 22838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaa4be81c4a4ce6bc080164640cab8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.501219 23053 raft_consensus.cc:493] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.501786 23056 raft_consensus.cc:493] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.502121 22841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9928bc913a6d4447b83c59ac19cbcf25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.501749 23053 raft_consensus.cc:515] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:23.502439 23056 raft_consensus.cc:515] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:23.517325 22986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6596aca14e4f31bea39731d8a95dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.516319 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e393b9cf9a849f4ad63eea1da23ea42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.508455 23056 leader_election.cc:290] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:23.544399 22763 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6596aca14e4f31bea39731d8a95dfc (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:21:23.549120 22763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6596aca14e4f31bea39731d8a95dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.550904 23048 tablet_bootstrap.cc:654] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.563645 23046 ts_tablet_manager.cc:1434] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.247s	user 0.007s	sys 0.001s
I20260709 13:21:23.564741 23046 tablet_bootstrap.cc:492] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:23.565397 22985 tablet_service.cc:1511] Processing CreateTablet for tablet 62e34545b8f644c28059e013cdd0590b (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:23.566824 22762 tablet_service.cc:1511] Processing CreateTablet for tablet 62e34545b8f644c28059e013cdd0590b (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:21:23.571851 23050 ts_tablet_manager.cc:1434] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.282s	user 0.010s	sys 0.004s
I20260709 13:21:23.573020 23050 tablet_bootstrap.cc:492] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:23.575814 23053 leader_election.cc:290] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:23.576282 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e34545b8f644c28059e013cdd0590b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.576427 23053 raft_consensus.cc:493] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.576911 23053 raft_consensus.cc:515] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:23.578279 22759 tablet_service.cc:1511] Processing CreateTablet for tablet 5c86d847eb114cb684092a456952e795 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:23.557299 22913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e757b2ce6374ff88418cc08fe5cfd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.557428 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aaa4be81c4a4ce6bc080164640cab8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.624730 22759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c86d847eb114cb684092a456952e795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.632532 23053 leader_election.cc:290] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:23.632807 22760 tablet_service.cc:1511] Processing CreateTablet for tablet d06a32d57e66460a8d02d5a285d93261 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:23.637245 22843 tablet_service.cc:1511] Processing CreateTablet for tablet f8427d8842704b1e8a7d20c6a4baf90f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:23.627535 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b1972dac5349e4b8f76620d14d5d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.629258 22985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e34545b8f644c28059e013cdd0590b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.650591 23047 tablet_bootstrap.cc:492] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:23.651144 23047 ts_tablet_manager.cc:1403] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.378s	user 0.022s	sys 0.009s
I20260709 13:21:23.614797 22839 tablet_service.cc:1511] Processing CreateTablet for tablet b1c5e4b2a4d642ef918c312a6ab1b808 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:21:23.660516 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06a32d57e66460a8d02d5a285d93261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.680270 22983 tablet_service.cc:1511] Processing CreateTablet for tablet 5c86d847eb114cb684092a456952e795 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:23.687949 23055 raft_consensus.cc:493] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.688529 23055 raft_consensus.cc:515] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:23.691143 23055 leader_election.cc:290] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:23.725910 22915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988592b5b572476ea8821180ae41bcda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.735456 22843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8427d8842704b1e8a7d20c6a4baf90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.737224 22983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c86d847eb114cb684092a456952e795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.750998 22910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67ba2c2d8c24fe581aab7a2463846ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.753748 22982 tablet_service.cc:1511] Processing CreateTablet for tablet 028d1f3901024609a35947274e016368 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:23.755436 22917 tablet_service.cc:1511] Processing CreateTablet for tablet 5c86d847eb114cb684092a456952e795 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:21:23.762084 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c86d847eb114cb684092a456952e795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.760730 22984 tablet_service.cc:1511] Processing CreateTablet for tablet 4c48bfd3488f4ab8b00547a92e0eb843 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:23.764779 22839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c5e4b2a4d642ef918c312a6ab1b808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.767577 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:23.772055 22987 tablet_service.cc:1511] Processing CreateTablet for tablet f8427d8842704b1e8a7d20c6a4baf90f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:23.777518 22982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028d1f3901024609a35947274e016368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.788759 22984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c48bfd3488f4ab8b00547a92e0eb843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.791946 22911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8785be4ba2dd4539af50dfdc6562cde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.793419 22834 tablet_service.cc:1511] Processing CreateTablet for tablet 4c48bfd3488f4ab8b00547a92e0eb843 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:23.794762 22834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c48bfd3488f4ab8b00547a92e0eb843. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:23.793823 22723 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:23.798357 23048 tablet_bootstrap.cc:492] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:23.798920 23048 ts_tablet_manager.cc:1403] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.477s	user 0.010s	sys 0.017s
I20260709 13:21:23.798985 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d50aaee99348959ee8e1d85e3c18bb" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:23.799783 22778 raft_consensus.cc:2468] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:23.802134 23048 raft_consensus.cc:359] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:23.802837 23048 raft_consensus.cc:385] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.803134 23048 raft_consensus.cc:740] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.804339 22966 leader_election.cc:304] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:23.805532 23053 raft_consensus.cc:2804] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:23.805847 22890 leader_election.cc:343] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.805949 23053 raft_consensus.cc:493] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:23.806427 23053 raft_consensus.cc:3060] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.807811 22987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8427d8842704b1e8a7d20c6a4baf90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.817839 22908 tablet_service.cc:1511] Processing CreateTablet for tablet f8427d8842704b1e8a7d20c6a4baf90f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:21:23.824230 22840 tablet_service.cc:1511] Processing CreateTablet for tablet 37f868d307ca42e9bbdac5db09aa91d0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:23.825654 22840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f868d307ca42e9bbdac5db09aa91d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.826109 23053 raft_consensus.cc:515] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:23.829816 23046 tablet_bootstrap.cc:654] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.838449 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:23.840029 22818 leader_election.cc:343] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:23.841218 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d50aaee99348959ee8e1d85e3c18bb" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:23.841121 23047 raft_consensus.cc:359] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:23.841902 22778 raft_consensus.cc:3060] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:23.841998 23047 raft_consensus.cc:385] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:23.842198 23053 leader_election.cc:290] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:23.868043 22767 tablet_service.cc:1511] Processing CreateTablet for tablet 4c48bfd3488f4ab8b00547a92e0eb843 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:21:23.894202 22767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c48bfd3488f4ab8b00547a92e0eb843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.842424 23047 raft_consensus.cc:740] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:23.856200 23048 consensus_queue.cc:260] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:23.897541 23047 consensus_queue.cc:260] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:23.897578 22837 tablet_service.cc:1511] Processing CreateTablet for tablet d06a32d57e66460a8d02d5a285d93261 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:23.819834 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8427d8842704b1e8a7d20c6a4baf90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.900861 23048 ts_tablet_manager.cc:1434] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.102s	user 0.011s	sys 0.006s
I20260709 13:21:23.902050 23048 tablet_bootstrap.cc:492] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:23.867522 22761 tablet_service.cc:1511] Processing CreateTablet for tablet d5a393acc19e45f49ed5e6b17ee64d81 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:23.906088 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a393acc19e45f49ed5e6b17ee64d81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.905871 22837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06a32d57e66460a8d02d5a285d93261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.908466 22909 tablet_service.cc:1511] Processing CreateTablet for tablet d06a32d57e66460a8d02d5a285d93261 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:21:23.863129 22991 tablet_service.cc:1511] Processing CreateTablet for tablet 37f868d307ca42e9bbdac5db09aa91d0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:23.909104 23047 ts_tablet_manager.cc:1434] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.252s	user 0.006s	sys 0.002s
I20260709 13:21:23.909345 22911 tablet_service.cc:1511] Processing CreateTablet for tablet 028d1f3901024609a35947274e016368 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:23.912869 22834 tablet_service.cc:1511] Processing CreateTablet for tablet d5a393acc19e45f49ed5e6b17ee64d81 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:23.953608 22834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a393acc19e45f49ed5e6b17ee64d81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.915050 23048 tablet_bootstrap.cc:654] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:23.925660 22778 raft_consensus.cc:2468] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:23.926194 22912 tablet_service.cc:1511] Processing CreateTablet for tablet 37f868d307ca42e9bbdac5db09aa91d0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:21:23.874852 22763 tablet_service.cc:1511] Processing CreateTablet for tablet 028d1f3901024609a35947274e016368 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:21:23.958325 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c5e4b2a4d642ef918c312a6ab1b808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.965582 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f868d307ca42e9bbdac5db09aa91d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.965840 23056 raft_consensus.cc:493] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:23.966459 23056 raft_consensus.cc:515] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:23.967991 22966 leader_election.cc:304] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:23.968835 23053 raft_consensus.cc:2804] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:23.969305 23053 raft_consensus.cc:697] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:23.970108 23053 consensus_queue.cc:237] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:23.970870 22914 tablet_service.cc:1511] Processing CreateTablet for tablet d5a393acc19e45f49ed5e6b17ee64d81 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:21:23.972852 22763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028d1f3901024609a35947274e016368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.980587 22990 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5b0b4e5dc64c67a2830174409b84d9 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:23.981952 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5b0b4e5dc64c67a2830174409b84d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.983029 23056 leader_election.cc:290] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:23.985041 22766 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5b0b4e5dc64c67a2830174409b84d9 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:23.986268 22766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5b0b4e5dc64c67a2830174409b84d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:23.992678 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d50aaee99348959ee8e1d85e3c18bb" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:23.996213 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d50aaee99348959ee8e1d85e3c18bb" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:23.998199 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:24.000499 22892 leader_election.cc:343] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.000958 22892 leader_election.cc:304] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:24.006774 22778 raft_consensus.cc:2393] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 1: Already voted for candidate f825e4bed376497e95838e1b82dc1a03 in this term.
I20260709 13:21:24.019973 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a393acc19e45f49ed5e6b17ee64d81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.024435 22837 tablet_service.cc:1511] Processing CreateTablet for tablet 9c5b0b4e5dc64c67a2830174409b84d9 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:21:24.025744 22837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c5b0b4e5dc64c67a2830174409b84d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.027946 22911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028d1f3901024609a35947274e016368. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.031471 22909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06a32d57e66460a8d02d5a285d93261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.044198 23046 tablet_bootstrap.cc:492] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:24.044893 23046 ts_tablet_manager.cc:1403] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.480s	user 0.006s	sys 0.027s
W20260709 13:21:24.048321 22892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:34811, user_credentials={real_user=slave}} blocked reactor thread for 47989.9us
I20260709 13:21:24.048614 23081 raft_consensus.cc:2749] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.048856 23046 raft_consensus.cc:359] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.049633 23046 raft_consensus.cc:385] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.049932 23046 raft_consensus.cc:740] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.050606 23046 consensus_queue.cc:260] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.055920 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37f868d307ca42e9bbdac5db09aa91d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.038441 23047 tablet_bootstrap.cc:492] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:24.076915 22915 tablet_service.cc:1511] Processing CreateTablet for tablet d4cd6f22ac074dedac9f3eb3ccc1bb80 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:24.087183 22982 tablet_service.cc:1511] Processing CreateTablet for tablet d4cd6f22ac074dedac9f3eb3ccc1bb80 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:24.088625 22982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cd6f22ac074dedac9f3eb3ccc1bb80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.059320 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d50aaee99348959ee8e1d85e3c18bb" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:24.088825 22763 tablet_service.cc:1511] Processing CreateTablet for tablet d4cd6f22ac074dedac9f3eb3ccc1bb80 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:21:24.093909 22816 leader_election.cc:304] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:24.094597 23048 tablet_bootstrap.cc:492] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:24.095120 23048 ts_tablet_manager.cc:1403] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.193s	user 0.013s	sys 0.006s
I20260709 13:21:24.095458 23056 raft_consensus.cc:3060] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.102149 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d50aaee99348959ee8e1d85e3c18bb" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:24.111179 23066 raft_consensus.cc:493] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.112089 23066 raft_consensus.cc:515] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.114887 23066 leader_election.cc:290] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:24.116220 22915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cd6f22ac074dedac9f3eb3ccc1bb80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.116628 23055 raft_consensus.cc:493] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.117142 23055 raft_consensus.cc:515] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.119640 22763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cd6f22ac074dedac9f3eb3ccc1bb80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.124513 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3f266650349d2a9181aebd298df50" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:24.124797 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0ee46f570945638b5a510259726a6c" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:24.143016 22839 tablet_service.cc:1511] Processing CreateTablet for tablet 6089d12187b140b4bb379b9d3bc7816f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:24.144485 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3f266650349d2a9181aebd298df50" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:24.144974 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d50aaee99348959ee8e1d85e3c18bb" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:24.147243 23050 tablet_bootstrap.cc:654] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.147457 23048 raft_consensus.cc:359] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.144454 22839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6089d12187b140b4bb379b9d3bc7816f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.148470 23048 raft_consensus.cc:385] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.148829 23048 raft_consensus.cc:740] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.149559 23048 consensus_queue.cc:260] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.151201 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d50aaee99348959ee8e1d85e3c18bb" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
W20260709 13:21:24.155105 22964 leader_election.cc:343] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.155857 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0ee46f570945638b5a510259726a6c" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:24.158769 22964 leader_election.cc:343] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.148200 23056 raft_consensus.cc:2749] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.159175 22964 leader_election.cc:304] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49
W20260709 13:21:24.161666 22964 leader_election.cc:343] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.162124 23053 raft_consensus.cc:2749] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.164897 22853 raft_consensus.cc:2468] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
W20260709 13:21:24.165608 22964 leader_election.cc:343] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.166043 22964 leader_election.cc:304] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:24.163812 22908 tablet_service.cc:1511] Processing CreateTablet for tablet 6089d12187b140b4bb379b9d3bc7816f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:24.167440 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6089d12187b140b4bb379b9d3bc7816f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.141036 23046 ts_tablet_manager.cc:1434] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.096s	user 0.012s	sys 0.000s
I20260709 13:21:24.172003 22741 leader_election.cc:304] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:24.174072 23053 raft_consensus.cc:2749] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.187412 22676 catalog_manager.cc:5697] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.183727 22991 tablet_service.cc:1511] Processing CreateTablet for tablet 6089d12187b140b4bb379b9d3bc7816f (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:21:24.206305 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6089d12187b140b4bb379b9d3bc7816f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.200239 22834 tablet_service.cc:1511] Processing CreateTablet for tablet d4f722c735b84bd3a526844bda3371c7 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:24.207785 22834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f722c735b84bd3a526844bda3371c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.183719 23046 tablet_bootstrap.cc:492] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:24.191833 23055 leader_election.cc:290] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:24.209540 23055 raft_consensus.cc:2764] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:21:24.183619 23048 ts_tablet_manager.cc:1434] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.004s
I20260709 13:21:24.188041 23047 tablet_bootstrap.cc:654] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.220196 23046 tablet_bootstrap.cc:654] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.225960 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:24.226351 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d21ac823716443b908d3e64bd1270a8" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:24.231567 22816 leader_election.cc:343] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.232039 22816 leader_election.cc:304] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:24.233269 23083 raft_consensus.cc:2749] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.239504 22982 tablet_service.cc:1511] Processing CreateTablet for tablet fde2d13e9f7c4d7880772615ce0d811c (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:24.242465 22982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde2d13e9f7c4d7880772615ce0d811c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.244117 23050 tablet_bootstrap.cc:492] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:24.244608 23050 ts_tablet_manager.cc:1403] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.672s	user 0.030s	sys 0.018s
I20260709 13:21:24.241616 23048 tablet_bootstrap.cc:492] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:24.250115 22989 tablet_service.cc:1511] Processing CreateTablet for tablet 14c24379e8a84ab9890e18d3c00b9a48 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:24.251380 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c24379e8a84ab9890e18d3c00b9a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.252821 23050 raft_consensus.cc:359] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.253592 23050 raft_consensus.cc:385] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.253441 22837 tablet_service.cc:1511] Processing CreateTablet for tablet fde2d13e9f7c4d7880772615ce0d811c (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:24.253924 23050 raft_consensus.cc:740] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.254755 22837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde2d13e9f7c4d7880772615ce0d811c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.278223 22990 tablet_service.cc:1511] Processing CreateTablet for tablet 03c363ea87274bec880ce1c6cdb1faef (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:24.279578 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c363ea87274bec880ce1c6cdb1faef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.281064 22914 tablet_service.cc:1511] Processing CreateTablet for tablet 14c24379e8a84ab9890e18d3c00b9a48 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:24.282724 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c24379e8a84ab9890e18d3c00b9a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.267956 23050 consensus_queue.cc:260] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.289454 22839 tablet_service.cc:1511] Processing CreateTablet for tablet 03c363ea87274bec880ce1c6cdb1faef (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:24.290025 23050 ts_tablet_manager.cc:1434] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:21:24.290764 22839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c363ea87274bec880ce1c6cdb1faef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.290998 23050 tablet_bootstrap.cc:492] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:24.305442 23048 tablet_bootstrap.cc:654] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.317294 22908 tablet_service.cc:1511] Processing CreateTablet for tablet 0436364a6d304d108b9d702cec8086c0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:24.317664 22983 tablet_service.cc:1511] Processing CreateTablet for tablet 3670fb6e5d3143289ff131f8df729e4a (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:24.317999 22766 tablet_service.cc:1511] Processing CreateTablet for tablet d4f722c735b84bd3a526844bda3371c7 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:24.318694 22908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0436364a6d304d108b9d702cec8086c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.319016 22983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3670fb6e5d3143289ff131f8df729e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.319254 22766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f722c735b84bd3a526844bda3371c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.317294 22835 tablet_service.cc:1511] Processing CreateTablet for tablet 0436364a6d304d108b9d702cec8086c0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:24.320595 22763 tablet_service.cc:1511] Processing CreateTablet for tablet fde2d13e9f7c4d7880772615ce0d811c (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:21:24.321168 22835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0436364a6d304d108b9d702cec8086c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.321794 22763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde2d13e9f7c4d7880772615ce0d811c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.340214 23047 tablet_bootstrap.cc:492] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:24.340144 22840 tablet_service.cc:1511] Processing CreateTablet for tablet 3670fb6e5d3143289ff131f8df729e4a (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:21:24.340937 23047 ts_tablet_manager.cc:1403] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.329s	user 0.028s	sys 0.021s
I20260709 13:21:24.341687 22840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3670fb6e5d3143289ff131f8df729e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.343031 23046 tablet_bootstrap.cc:492] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:24.344349 22767 tablet_service.cc:1511] Processing CreateTablet for tablet 14c24379e8a84ab9890e18d3c00b9a48 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:21:24.345714 22767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c24379e8a84ab9890e18d3c00b9a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.312083 22909 tablet_service.cc:1511] Processing CreateTablet for tablet d4f722c735b84bd3a526844bda3371c7 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:21:24.356433 22909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f722c735b84bd3a526844bda3371c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.350492 23047 raft_consensus.cc:359] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.359594 23047 raft_consensus.cc:385] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.360003 23047 raft_consensus.cc:740] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.360877 23047 consensus_queue.cc:260] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.343542 23046 ts_tablet_manager.cc:1403] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.160s	user 0.017s	sys 0.021s
I20260709 13:21:24.361593 22759 tablet_service.cc:1511] Processing CreateTablet for tablet 0436364a6d304d108b9d702cec8086c0 (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:21:24.363417 22759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0436364a6d304d108b9d702cec8086c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.365231 23081 raft_consensus.cc:493] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.364701 23046 raft_consensus.cc:359] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.365551 22761 tablet_service.cc:1511] Processing CreateTablet for tablet 3670fb6e5d3143289ff131f8df729e4a (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 13:21:24.367735 22741 leader_election.cc:343] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.371826 23081 raft_consensus.cc:515] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.372524 22982 tablet_service.cc:1511] Processing CreateTablet for tablet ffa363e792404ff6b11c80dfb5d5d33e (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:24.374157 22912 tablet_service.cc:1511] Processing CreateTablet for tablet ffa363e792404ff6b11c80dfb5d5d33e (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:24.384888 22761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3670fb6e5d3143289ff131f8df729e4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.381106 23046 raft_consensus.cc:385] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.410650 23046 raft_consensus.cc:740] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.405102 22982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa363e792404ff6b11c80dfb5d5d33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.406270 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d21ac823716443b908d3e64bd1270a8" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:24.406909 22760 tablet_service.cc:1511] Processing CreateTablet for tablet ffa363e792404ff6b11c80dfb5d5d33e (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:21:24.407642 23081 leader_election.cc:290] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:24.411469 23046 consensus_queue.cc:260] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.412601 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa363e792404ff6b11c80dfb5d5d33e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:21:24.414345 22741 leader_election.cc:343] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.414826 22741 leader_election.cc:304] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:24.408056 22911 tablet_service.cc:1511] Processing CreateTablet for tablet 03c363ea87274bec880ce1c6cdb1faef (DEFAULT_TABLE table=test-workload [id=927f2757fe764af598822fabcf8c9a98]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:21:24.419159 23050 tablet_bootstrap.cc:654] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.419946 23084 raft_consensus.cc:2749] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.420503 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa363e792404ff6b11c80dfb5d5d33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.432399 22911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c363ea87274bec880ce1c6cdb1faef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:24.439765 23053 consensus_queue.cc:1048] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:24.440205 23047 ts_tablet_manager.cc:1434] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.003s
I20260709 13:21:24.441269 23047 tablet_bootstrap.cc:492] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:24.443686 23084 raft_consensus.cc:493] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.444156 23084 raft_consensus.cc:515] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.448577 23084 leader_election.cc:290] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:24.450088 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7056b89dcd402082c0a745eb8e9b79" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
W20260709 13:21:24.451561 22741 leader_election.cc:343] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.452045 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7056b89dcd402082c0a745eb8e9b79" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:24.453418 22741 leader_election.cc:343] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.453831 22741 leader_election.cc:304] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:24.454854 23084 raft_consensus.cc:2749] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.446616 23046 ts_tablet_manager.cc:1434] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:21:24.457775 23046 tablet_bootstrap.cc:492] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:24.473703 23050 tablet_bootstrap.cc:492] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:24.474277 23050 ts_tablet_manager.cc:1403] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.183s	user 0.011s	sys 0.007s
I20260709 13:21:24.477360 23050 raft_consensus.cc:359] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.478077 23050 raft_consensus.cc:385] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.478410 23050 raft_consensus.cc:740] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.480986 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0ee46f570945638b5a510259726a6c" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:24.481676 23001 raft_consensus.cc:2468] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
I20260709 13:21:24.485749 23046 tablet_bootstrap.cc:654] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.486534 22890 leader_election.cc:304] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:24.496275 23081 raft_consensus.cc:2804] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.496775 23081 raft_consensus.cc:493] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.493706 23048 tablet_bootstrap.cc:492] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:24.497207 23081 raft_consensus.cc:3060] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.497514 23048 ts_tablet_manager.cc:1403] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.263s	user 0.003s	sys 0.015s
I20260709 13:21:24.479169 23050 consensus_queue.cc:260] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.512217 23066 consensus_queue.cc:1048] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:21:24.526499 23047 tablet_bootstrap.cc:654] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.528776 23046 tablet_bootstrap.cc:492] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:24.530632 23046 ts_tablet_manager.cc:1403] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.010s
I20260709 13:21:24.537358 23048 raft_consensus.cc:359] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.544620 23046 raft_consensus.cc:359] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.545403 23046 raft_consensus.cc:385] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.545684 23046 raft_consensus.cc:740] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.546428 23046 consensus_queue.cc:260] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.539986 23048 raft_consensus.cc:385] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.547582 23048 raft_consensus.cc:740] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.548383 23048 consensus_queue.cc:260] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.550467 23081 raft_consensus.cc:515] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.550990 23048 ts_tablet_manager.cc:1434] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.002s
I20260709 13:21:24.552000 23048 tablet_bootstrap.cc:492] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:24.553750 23081 leader_election.cc:290] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:24.558300 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0ee46f570945638b5a510259726a6c" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:24.559532 23048 tablet_bootstrap.cc:654] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.559502 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0ee46f570945638b5a510259726a6c" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:24.560307 23001 raft_consensus.cc:3060] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.560900 23046 ts_tablet_manager.cc:1434] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:21:24.564072 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0ee46f570945638b5a510259726a6c" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:24.564236 23046 tablet_bootstrap.cc:492] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
W20260709 13:21:24.565965 22890 leader_election.cc:343] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:24.567832 22890 leader_election.cc:343] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.570672 23050 ts_tablet_manager.cc:1434] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.096s	user 0.011s	sys 0.009s
I20260709 13:21:24.571931 23050 tablet_bootstrap.cc:492] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:24.573665 23046 tablet_bootstrap.cc:654] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.580533 23001 raft_consensus.cc:2468] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:24.573333 23047 tablet_bootstrap.cc:492] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:24.591500 23047 ts_tablet_manager.cc:1403] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.150s	user 0.009s	sys 0.014s
I20260709 13:21:24.592159 22890 leader_election.cc:304] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:24.593406 23081 raft_consensus.cc:2804] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.594646 23081 raft_consensus.cc:697] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:24.594585 23047 raft_consensus.cc:359] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.595506 23047 raft_consensus.cc:385] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.585269 23050 tablet_bootstrap.cc:654] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.595763 23081 consensus_queue.cc:237] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.597620 23083 raft_consensus.cc:493] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.598107 23083 raft_consensus.cc:515] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.595852 23047 raft_consensus.cc:740] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.600368 23083 leader_election.cc:290] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:24.601408 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f0026e60841c6b5a416128dc2f590" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:24.599715 23047 consensus_queue.cc:260] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.602923 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f0026e60841c6b5a416128dc2f590" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:24.603799 22777 raft_consensus.cc:2468] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:24.604009 23047 ts_tablet_manager.cc:1434] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:21:24.605293 23047 tablet_bootstrap.cc:492] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
W20260709 13:21:24.605746 22816 leader_election.cc:343] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.606956 22818 leader_election.cc:304] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:24.610040 23083 raft_consensus.cc:2804] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.610646 23083 raft_consensus.cc:493] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.610992 23083 raft_consensus.cc:3060] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.615195 23047 tablet_bootstrap.cc:654] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.616405 22676 catalog_manager.cc:5697] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.625406 23046 tablet_bootstrap.cc:492] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:24.626323 23046 ts_tablet_manager.cc:1403] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.062s	user 0.022s	sys 0.024s
I20260709 13:21:24.633404 23048 tablet_bootstrap.cc:492] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:24.633673 23050 tablet_bootstrap.cc:492] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:24.634147 23048 ts_tablet_manager.cc:1403] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.028s
I20260709 13:21:24.634250 23050 ts_tablet_manager.cc:1403] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.004s
I20260709 13:21:24.636022 23083 raft_consensus.cc:515] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.638140 23048 raft_consensus.cc:359] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.639055 23048 raft_consensus.cc:385] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.638993 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f0026e60841c6b5a416128dc2f590" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:24.639827 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42f0026e60841c6b5a416128dc2f590" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:24.633419 23046 raft_consensus.cc:359] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.640452 23046 raft_consensus.cc:385] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.640452 22777 raft_consensus.cc:3060] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:24.640727 22816 leader_election.cc:343] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.639513 23048 raft_consensus.cc:740] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.640866 23046 raft_consensus.cc:740] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.641996 23048 consensus_queue.cc:260] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.642235 23046 consensus_queue.cc:260] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.638175 23083 leader_election.cc:290] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:24.644621 23048 ts_tablet_manager.cc:1434] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:21:24.644728 23046 ts_tablet_manager.cc:1434] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 13:21:24.645871 23048 tablet_bootstrap.cc:492] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:24.646236 23046 tablet_bootstrap.cc:492] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:24.649583 22777 raft_consensus.cc:2468] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:24.650844 22818 leader_election.cc:304] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:24.651638 23083 raft_consensus.cc:2804] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.652172 23083 raft_consensus.cc:697] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:24.652733 23048 tablet_bootstrap.cc:654] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.653020 23083 consensus_queue.cc:237] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.658093 23046 tablet_bootstrap.cc:654] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.642344 23050 raft_consensus.cc:359] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.660096 23050 raft_consensus.cc:385] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.660418 23050 raft_consensus.cc:740] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.661363 23050 consensus_queue.cc:260] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.665928 23047 tablet_bootstrap.cc:492] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:24.666464 23047 ts_tablet_manager.cc:1403] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.012s
I20260709 13:21:24.667205 23048 tablet_bootstrap.cc:492] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:24.667704 23048 ts_tablet_manager.cc:1403] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:21:24.669750 23046 tablet_bootstrap.cc:492] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:24.670145 23046 ts_tablet_manager.cc:1403] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.005s
I20260709 13:21:24.669643 23047 raft_consensus.cc:359] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.670444 23047 raft_consensus.cc:385] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.670768 23047 raft_consensus.cc:740] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.670601 23048 raft_consensus.cc:359] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.671347 23048 raft_consensus.cc:385] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.671666 23048 raft_consensus.cc:740] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.671545 23047 consensus_queue.cc:260] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.672613 23046 raft_consensus.cc:359] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.672657 23048 consensus_queue.cc:260] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.673522 23046 raft_consensus.cc:385] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.673882 23046 raft_consensus.cc:740] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.674270 23047 ts_tablet_manager.cc:1434] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:24.674680 23046 consensus_queue.cc:260] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.675366 23048 ts_tablet_manager.cc:1434] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:24.676360 23048 tablet_bootstrap.cc:492] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:24.677004 23046 ts_tablet_manager.cc:1434] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:21:24.678248 23046 tablet_bootstrap.cc:492] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:24.682843 23048 tablet_bootstrap.cc:654] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.684679 23046 tablet_bootstrap.cc:654] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.693955 23047 tablet_bootstrap.cc:492] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:24.693791 22675 catalog_manager.cc:5697] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:24.708444 23047 tablet_bootstrap.cc:654] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.711190 23050 ts_tablet_manager.cc:1434] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:21:24.712626 23046 tablet_bootstrap.cc:492] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:24.713153 23046 ts_tablet_manager.cc:1403] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.019s
I20260709 13:21:24.713289 23048 tablet_bootstrap.cc:492] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:24.713881 23048 ts_tablet_manager.cc:1403] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.016s
I20260709 13:21:24.716481 23046 raft_consensus.cc:359] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.717226 23046 raft_consensus.cc:385] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.717543 23046 raft_consensus.cc:740] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.717730 23048 raft_consensus.cc:359] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.718374 23046 consensus_queue.cc:260] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.718760 23048 raft_consensus.cc:385] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.719383 23048 raft_consensus.cc:740] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.720533 23048 consensus_queue.cc:260] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.723466 23046 ts_tablet_manager.cc:1434] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:21:24.723637 23048 ts_tablet_manager.cc:1434] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:24.724553 23046 tablet_bootstrap.cc:492] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:24.725080 23048 tablet_bootstrap.cc:492] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:24.730909 23046 tablet_bootstrap.cc:654] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.734288 23048 tablet_bootstrap.cc:654] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.734480 23050 tablet_bootstrap.cc:492] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:24.742486 23046 tablet_bootstrap.cc:492] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:24.743031 23046 ts_tablet_manager.cc:1403] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.010s
I20260709 13:21:24.745711 23046 raft_consensus.cc:359] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.746356 23046 raft_consensus.cc:385] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.746657 23046 raft_consensus.cc:740] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.747339 23046 consensus_queue.cc:260] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.750102 23048 tablet_bootstrap.cc:492] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:24.750801 23048 ts_tablet_manager.cc:1403] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.009s
I20260709 13:21:24.749527 23046 ts_tablet_manager.cc:1434] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:21:24.752513 23046 tablet_bootstrap.cc:492] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:24.754144 23048 raft_consensus.cc:359] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.755110 23048 raft_consensus.cc:385] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.755508 23048 raft_consensus.cc:740] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.756578 23048 consensus_queue.cc:260] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.757526 23081 raft_consensus.cc:493] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.758031 23081 raft_consensus.cc:515] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.759755 23048 ts_tablet_manager.cc:1434] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:24.760105 23081 leader_election.cc:290] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:24.761162 23048 tablet_bootstrap.cc:492] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:24.762061 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc14860c91ac4d97bc55ddecd79c6ac5" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:24.762270 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc14860c91ac4d97bc55ddecd79c6ac5" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:24.762939 22853 raft_consensus.cc:2468] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
W20260709 13:21:24.763481 22892 leader_election.cc:343] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.764070 22890 leader_election.cc:304] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:24.764614 23046 tablet_bootstrap.cc:654] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.765429 23081 raft_consensus.cc:2804] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.765867 23081 raft_consensus.cc:493] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.766211 23081 raft_consensus.cc:3060] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.769464 23048 tablet_bootstrap.cc:654] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.775857 23046 tablet_bootstrap.cc:492] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:24.776330 23046 ts_tablet_manager.cc:1403] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:21:24.779040 23046 raft_consensus.cc:359] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.779706 23046 raft_consensus.cc:385] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.779978 23046 raft_consensus.cc:740] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.780714 23046 consensus_queue.cc:260] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.784235 23048 tablet_bootstrap.cc:492] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:24.784991 23048 ts_tablet_manager.cc:1403] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.006s
I20260709 13:21:24.785698 23046 ts_tablet_manager.cc:1434] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:24.786653 23046 tablet_bootstrap.cc:492] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:24.788767 23048 raft_consensus.cc:359] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.789763 23048 raft_consensus.cc:385] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.790184 23048 raft_consensus.cc:740] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.791260 23048 consensus_queue.cc:260] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.792219 23046 tablet_bootstrap.cc:654] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.799185 23053 raft_consensus.cc:493] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.799957 23053 raft_consensus.cc:515] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.800985 23048 ts_tablet_manager.cc:1434] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:21:24.802369 23048 tablet_bootstrap.cc:492] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:24.803165 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:24.803478 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:24.804620 22964 leader_election.cc:343] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.805135 23053 leader_election.cc:290] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
W20260709 13:21:24.805186 22966 leader_election.cc:343] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.805858 22966 leader_election.cc:304] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:24.806689 23053 raft_consensus.cc:2749] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:24.782111 23081 raft_consensus.cc:515] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.808503 23046 tablet_bootstrap.cc:492] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:24.808996 23046 ts_tablet_manager.cc:1403] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 13:21:24.809262 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc14860c91ac4d97bc55ddecd79c6ac5" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:24.809417 23081 leader_election.cc:290] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:24.809593 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc14860c91ac4d97bc55ddecd79c6ac5" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:24.810082 23048 tablet_bootstrap.cc:654] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.810220 22853 raft_consensus.cc:3060] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:24.810662 22892 leader_election.cc:343] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.811782 23083 raft_consensus.cc:493] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.812296 23083 raft_consensus.cc:515] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.812886 23047 tablet_bootstrap.cc:492] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
W20260709 13:21:24.813040 22723 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:24.813375 23047 ts_tablet_manager.cc:1403] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.138s	user 0.042s	sys 0.053s
I20260709 13:21:24.814034 23056 raft_consensus.cc:493] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.814410 23083 leader_election.cc:290] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:24.814530 23056 raft_consensus.cc:515] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.816556 23056 leader_election.cc:290] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:24.816509 23047 raft_consensus.cc:359] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.817518 23047 raft_consensus.cc:385] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.817921 23047 raft_consensus.cc:740] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.818473 23053 raft_consensus.cc:493] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.818974 23053 raft_consensus.cc:515] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.820310 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7056b89dcd402082c0a745eb8e9b79" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:24.820958 23001 raft_consensus.cc:2468] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:24.822135 23050 tablet_bootstrap.cc:654] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.821949 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3f266650349d2a9181aebd298df50" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:24.822633 23000 raft_consensus.cc:2468] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:24.822935 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7056b89dcd402082c0a745eb8e9b79" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:24.823608 22777 raft_consensus.cc:2468] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:24.825284 22818 leader_election.cc:304] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:24.817834 22853 raft_consensus.cc:2468] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:24.826864 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3f266650349d2a9181aebd298df50" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:24.825533 23046 raft_consensus.cc:359] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.827409 23046 raft_consensus.cc:385] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.827700 23046 raft_consensus.cc:740] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.826867 22890 leader_election.cc:304] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:24.828397 23046 consensus_queue.cc:260] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:24.830060 22816 leader_election.cc:343] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.819002 23047 consensus_queue.cc:260] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.831314 22816 leader_election.cc:304] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:24.831488 23083 raft_consensus.cc:2804] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.831959 23083 raft_consensus.cc:493] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.832324 23083 raft_consensus.cc:3060] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.821949 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7e2a19f1474c1fb8f98ee12a3be096" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:24.832875 23047 ts_tablet_manager.cc:1434] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:21:24.833441 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7e2a19f1474c1fb8f98ee12a3be096" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:24.834026 22777 raft_consensus.cc:2468] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:24.835095 22966 leader_election.cc:304] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:24.835873 23056 raft_consensus.cc:493] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.836119 23102 raft_consensus.cc:2804] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.836591 23102 raft_consensus.cc:493] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.836406 23056 raft_consensus.cc:515] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.836957 23102 raft_consensus.cc:3060] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.838460 23056 leader_election.cc:290] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
W20260709 13:21:24.840152 22964 leader_election.cc:343] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.841271 23056 raft_consensus.cc:2804] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.841501 23098 raft_consensus.cc:2804] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.842747 23050 tablet_bootstrap.cc:492] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:24.841703 23056 raft_consensus.cc:493] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.843303 23050 ts_tablet_manager.cc:1403] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.000s
I20260709 13:21:24.843405 23056 raft_consensus.cc:3060] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.843667 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:24.844396 23000 raft_consensus.cc:2468] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:24.845367 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:24.830245 23046 ts_tablet_manager.cc:1434] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:21:24.845984 22926 raft_consensus.cc:2468] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:24.847395 23102 raft_consensus.cc:515] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.845955 22816 leader_election.cc:304] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:24.822930 23053 leader_election.cc:290] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:24.851022 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7e2a19f1474c1fb8f98ee12a3be096" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:24.851590 22777 raft_consensus.cc:3060] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.851805 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7e2a19f1474c1fb8f98ee12a3be096" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:24.852336 23048 tablet_bootstrap.cc:492] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:24.852842 23048 ts_tablet_manager.cc:1403] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.005s
W20260709 13:21:24.853271 22964 leader_election.cc:343] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.854131 23056 raft_consensus.cc:515] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.839917 23083 raft_consensus.cc:515] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.856848 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3f266650349d2a9181aebd298df50" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:24.857430 23000 raft_consensus.cc:3060] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.858143 23081 raft_consensus.cc:493] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.858623 23081 raft_consensus.cc:515] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.859074 23083 leader_election.cc:290] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:24.860266 23122 raft_consensus.cc:2804] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.860425 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7056b89dcd402082c0a745eb8e9b79" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:24.860746 23122 raft_consensus.cc:493] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.861008 22778 raft_consensus.cc:3060] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.861168 23122 raft_consensus.cc:3060] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.862473 22777 raft_consensus.cc:2468] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:24.863791 22966 leader_election.cc:304] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:24.864617 23053 raft_consensus.cc:2804] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.865317 23053 raft_consensus.cc:697] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:24.866169 23053 consensus_queue.cc:237] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.866811 23047 tablet_bootstrap.cc:492] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:24.866892 22778 raft_consensus.cc:2468] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:24.868975 23046 tablet_bootstrap.cc:492] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:24.870077 23048 raft_consensus.cc:359] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.872365 23048 raft_consensus.cc:385] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.872713 23048 raft_consensus.cc:740] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.873502 23048 consensus_queue.cc:260] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.876942 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7056b89dcd402082c0a745eb8e9b79" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:24.877791 23001 raft_consensus.cc:3060] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.878235 23000 raft_consensus.cc:2468] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:24.879495 22816 leader_election.cc:304] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:24.881028 22818 leader_election.cc:304] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:24.881956 23056 leader_election.cc:290] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:24.892601 23056 raft_consensus.cc:2804] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.893270 23056 raft_consensus.cc:697] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:24.894404 23056 consensus_queue.cc:237] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.900314 23083 raft_consensus.cc:2804] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.902772 23046 tablet_bootstrap.cc:654] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.905314 23083 raft_consensus.cc:697] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:24.859021 23050 raft_consensus.cc:359] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.906582 23083 consensus_queue.cc:237] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.872733 23102 leader_election.cc:290] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:24.910786 23048 ts_tablet_manager.cc:1434] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:21:24.913039 23066 raft_consensus.cc:493] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:24.911142 23098 raft_consensus.cc:697] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:24.914898 23048 tablet_bootstrap.cc:492] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:24.918309 23122 raft_consensus.cc:515] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.911054 23001 raft_consensus.cc:2468] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:24.913677 23066 raft_consensus.cc:515] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.911320 23050 raft_consensus.cc:385] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.922649 23050 raft_consensus.cc:740] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.924038 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:24.925024 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3f266650349d2a9181aebd298df50" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:24.925524 22927 raft_consensus.cc:2468] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:24.925669 23066 leader_election.cc:290] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:24.927299 22964 leader_election.cc:304] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:24.927392 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:24.932288 22966 leader_election.cc:343] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.932612 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:24.933502 22853 raft_consensus.cc:2393] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 1: Already voted for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in this term.
I20260709 13:21:24.933525 23066 raft_consensus.cc:2804] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.933827 23098 consensus_queue.cc:237] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.934746 23047 tablet_bootstrap.cc:654] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.934566 23066 raft_consensus.cc:493] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.935892 23066 raft_consensus.cc:3060] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.927410 23081 leader_election.cc:290] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
W20260709 13:21:24.936609 22816 leader_election.cc:343] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.937777 23048 tablet_bootstrap.cc:654] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:24.943768 23122 leader_election.cc:290] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:24.945396 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:24.951282 23001 raft_consensus.cc:2468] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
I20260709 13:21:24.952870 22890 leader_election.cc:304] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:24.953769 23066 raft_consensus.cc:515] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:24.954377 23081 raft_consensus.cc:2804] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:24.953882 22675 catalog_manager.cc:5697] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:24.954916 23081 raft_consensus.cc:493] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:24.955400 23081 raft_consensus.cc:3060] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.956754 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:24.957412 22926 raft_consensus.cc:3060] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.957612 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:24.958197 23000 raft_consensus.cc:3060] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:24.939788 23050 consensus_queue.cc:260] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:24.949018 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:24.965210 22926 raft_consensus.cc:2468] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:24.966626 22964 leader_election.cc:304] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:24.969049 23000 raft_consensus.cc:2468] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:24.971333 23053 raft_consensus.cc:2804] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.973515 23066 leader_election.cc:290] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:24.975015 23053 raft_consensus.cc:697] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:24.975338 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:24.976245 23053 consensus_queue.cc:237] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:24.977392 22966 leader_election.cc:343] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:24.966569 23050 ts_tablet_manager.cc:1434] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.111s	user 0.003s	sys 0.010s
I20260709 13:21:24.968984 23081 raft_consensus.cc:515] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.980919 22816 leader_election.cc:304] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:24.986444 23122 raft_consensus.cc:2804] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:24.987087 23122 raft_consensus.cc:697] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:24.988399 23046 tablet_bootstrap.cc:492] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:24.988161 23122 consensus_queue.cc:237] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:24.988957 23046 ts_tablet_manager.cc:1403] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.120s	user 0.005s	sys 0.020s
I20260709 13:21:24.990167 22675 catalog_manager.cc:5697] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:24.992458 23050 tablet_bootstrap.cc:492] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:24.993515 23048 tablet_bootstrap.cc:492] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:24.994048 23048 ts_tablet_manager.cc:1403] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.016s
I20260709 13:21:24.992201 23046 raft_consensus.cc:359] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.995851 23046 raft_consensus.cc:385] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:24.996165 23046 raft_consensus.cc:740] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:24.996971 23046 consensus_queue.cc:260] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:24.998011 22927 raft_consensus.cc:2393] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 1: Already voted for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in this term.
I20260709 13:21:24.998274 23081 leader_election.cc:290] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:24.999873 23047 tablet_bootstrap.cc:492] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:25.000393 23047 ts_tablet_manager.cc:1403] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.016s
I20260709 13:21:25.001475 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:25.002281 23000 raft_consensus.cc:2393] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 1: Already voted for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in this term.
I20260709 13:21:25.004205 23066 raft_consensus.cc:493] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.004679 23066 raft_consensus.cc:515] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.006088 23046 ts_tablet_manager.cc:1434] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:21:25.007047 23046 tablet_bootstrap.cc:492] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:25.007463 23066 leader_election.cc:290] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:25.007539 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:25.004665 23050 tablet_bootstrap.cc:654] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.008590 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f88630e7ac244caa791ca47a1ef8031" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:25.012959 22890 leader_election.cc:304] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:25.013914 23081 raft_consensus.cc:2749] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.015729 23048 raft_consensus.cc:359] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.016464 23048 raft_consensus.cc:385] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.016786 23048 raft_consensus.cc:740] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.003422 23047 raft_consensus.cc:359] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
W20260709 13:21:25.018283 22964 leader_election.cc:343] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.018826 23047 raft_consensus.cc:385] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.018023 23048 consensus_queue.cc:260] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.017405 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f88630e7ac244caa791ca47a1ef8031" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.019729 23046 tablet_bootstrap.cc:654] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.023422 23081 raft_consensus.cc:493] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.023944 23081 raft_consensus.cc:515] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.019467 23047 raft_consensus.cc:740] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.029328 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d21ac823716443b908d3e64bd1270a8" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:25.031042 22890 leader_election.cc:343] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.031373 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d21ac823716443b908d3e64bd1270a8" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.029343 23048 ts_tablet_manager.cc:1434] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 13:21:25.032335 23066 raft_consensus.cc:493] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.033155 22777 raft_consensus.cc:2468] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
I20260709 13:21:25.033710 23048 tablet_bootstrap.cc:492] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:25.035076 22892 leader_election.cc:304] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:25.036248 23098 raft_consensus.cc:2804] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.036711 23098 raft_consensus.cc:493] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.037138 23098 raft_consensus.cc:3060] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.037313 22675 catalog_manager.cc:5697] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:25.040221 23048 tablet_bootstrap.cc:654] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.026623 23081 leader_election.cc:290] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:25.033773 23066 raft_consensus.cc:515] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.039383 22675 catalog_manager.cc:5697] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:25.046581 23066 leader_election.cc:290] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:25.041947 23083 raft_consensus.cc:493] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.047433 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6efd72b4114248adef337292eaede0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.048362 23083 raft_consensus.cc:515] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
W20260709 13:21:25.049651 22966 leader_election.cc:343] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.052021 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4740c47164894cbe8add259947545a4e" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:25.053030 23083 leader_election.cc:290] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
W20260709 13:21:25.053941 22816 leader_election.cc:343] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.053242 22674 catalog_manager.cc:5697] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:25.055667 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4740c47164894cbe8add259947545a4e" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:25.047950 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6efd72b4114248adef337292eaede0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:25.063876 22816 leader_election.cc:343] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.064328 22816 leader_election.cc:304] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:25.065637 22853 raft_consensus.cc:2468] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:25.066562 23083 raft_consensus.cc:2749] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.067132 22964 leader_election.cc:304] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:25.068768 23102 raft_consensus.cc:2804] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.069255 23102 raft_consensus.cc:493] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.069696 23102 raft_consensus.cc:3060] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.062522 23047 consensus_queue.cc:260] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.077849 22778 raft_consensus.cc:2468] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:25.078752 23102 raft_consensus.cc:515] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.079283 23047 ts_tablet_manager.cc:1434] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.000s
I20260709 13:21:25.080153 22966 leader_election.cc:304] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:25.081763 23053 raft_consensus.cc:2804] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.082687 23053 raft_consensus.cc:493] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.083132 23053 raft_consensus.cc:3060] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.083766 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6efd72b4114248adef337292eaede0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:25.088176 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6efd72b4114248adef337292eaede0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:25.088399 23083 raft_consensus.cc:493] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.088769 22851 raft_consensus.cc:3060] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.088850 23083 raft_consensus.cc:515] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.091023 23083 leader_election.cc:290] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:25.091738 23102 leader_election.cc:290] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:25.076588 23098 raft_consensus.cc:515] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:25.093587 22966 leader_election.cc:343] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.093936 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.095228 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:25.095494 23098 leader_election.cc:290] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:25.097164 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d21ac823716443b908d3e64bd1270a8" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:25.098429 23053 raft_consensus.cc:515] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
W20260709 13:21:25.102900 22816 leader_election.cc:343] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.103886 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f88630e7ac244caa791ca47a1ef8031" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
W20260709 13:21:25.106462 22818 leader_election.cc:343] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.107008 22818 leader_election.cc:304] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:25.099520 22851 raft_consensus.cc:2468] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:25.107411 23046 tablet_bootstrap.cc:492] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:25.108178 23046 ts_tablet_manager.cc:1403] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.101s	user 0.008s	sys 0.044s
W20260709 13:21:25.108417 22890 leader_election.cc:343] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.108479 23122 raft_consensus.cc:2749] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.111131 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d21ac823716443b908d3e64bd1270a8" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:25.111466 23122 consensus_queue.cc:1048] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.111163 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f88630e7ac244caa791ca47a1ef8031" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
W20260709 13:21:25.112180 22964 leader_election.cc:343] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.112353 22775 raft_consensus.cc:3060] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.111259 23046 raft_consensus.cc:359] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.114010 23046 raft_consensus.cc:385] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.114362 23046 raft_consensus.cc:740] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.115993 23053 leader_election.cc:290] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:25.117442 22777 raft_consensus.cc:3060] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.118149 22964 leader_election.cc:304] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:25.120486 23046 consensus_queue.cc:260] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.117449 23098 consensus_queue.cc:1048] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:21:25.124220 23066 raft_consensus.cc:2804] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.126353 23066 raft_consensus.cc:697] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:25.123929 22851 raft_consensus.cc:3060] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.138028 23046 ts_tablet_manager.cc:1434] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.005s
I20260709 13:21:25.140010 23102 raft_consensus.cc:493] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.140511 23102 raft_consensus.cc:515] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.142583 23102 leader_election.cc:290] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:25.144065 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.144191 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:25.145861 22966 leader_election.cc:343] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.128863 23066 consensus_queue.cc:237] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.146968 22777 raft_consensus.cc:2468] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:25.147512 23001 raft_consensus.cc:3060] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:25.148205 22964 leader_election.cc:343] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.152110 22964 leader_election.cc:304] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:25.155242 23102 raft_consensus.cc:2749] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.156876 23047 tablet_bootstrap.cc:492] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:25.135798 23084 raft_consensus.cc:493] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.161180 23046 tablet_bootstrap.cc:492] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:25.160010 23084 raft_consensus.cc:515] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.168423 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:25.169075 22853 raft_consensus.cc:2468] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:25.169178 22674 catalog_manager.cc:5697] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:25.170703 22775 raft_consensus.cc:2468] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:25.171320 23083 consensus_queue.cc:1048] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.173110 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:25.175596 22741 leader_election.cc:304] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:25.176839 22966 leader_election.cc:304] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
W20260709 13:21:25.178817 22741 leader_election.cc:343] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.179525 23066 raft_consensus.cc:2804] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.180048 23066 raft_consensus.cc:697] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:25.172291 23084 leader_election.cc:290] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:25.180945 23084 raft_consensus.cc:2804] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.180856 23066 consensus_queue.cc:237] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.188297 23098 consensus_queue.cc:1048] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.188985 23084 raft_consensus.cc:493] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.189594 23084 raft_consensus.cc:3060] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.182521 22892 leader_election.cc:304] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:25.184026 23122 raft_consensus.cc:493] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.192335 23122 raft_consensus.cc:515] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.184631 23050 tablet_bootstrap.cc:492] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:25.193363 23098 raft_consensus.cc:2804] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.193568 23050 ts_tablet_manager.cc:1403] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.201s	user 0.013s	sys 0.008s
I20260709 13:21:25.193889 23098 raft_consensus.cc:697] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:25.194742 23098 consensus_queue.cc:237] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.181435 23047 tablet_bootstrap.cc:654] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.197563 23048 tablet_bootstrap.cc:492] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:25.198973 23122 leader_election.cc:290] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:25.200649 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0ee46f570945638b5a510259726a6c" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:25.204998 23048 ts_tablet_manager.cc:1403] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.171s	user 0.041s	sys 0.041s
I20260709 13:21:25.202409 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0ee46f570945638b5a510259726a6c" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:25.207383 22816 leader_election.cc:304] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:25.208751 23048 raft_consensus.cc:359] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.209686 23048 raft_consensus.cc:385] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.210017 23048 raft_consensus.cc:740] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.217495 23048 consensus_queue.cc:260] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.220202 23084 raft_consensus.cc:515] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.222903 23084 leader_election.cc:290] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:25.224009 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:25.223773 22675 catalog_manager.cc:5697] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:25.224587 22853 raft_consensus.cc:3060] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.225798 23048 ts_tablet_manager.cc:1434] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:21:25.227012 23048 tablet_bootstrap.cc:492] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:25.232275 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:25.233420 23046 tablet_bootstrap.cc:654] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:25.233749 22741 leader_election.cc:343] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.235526 22853 raft_consensus.cc:2468] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:25.237236 23050 raft_consensus.cc:359] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.237994 23050 raft_consensus.cc:385] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.238385 23050 raft_consensus.cc:740] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.239383 23050 consensus_queue.cc:260] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.239923 22741 leader_election.cc:304] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:25.242134 23048 tablet_bootstrap.cc:654] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.262575 23084 raft_consensus.cc:2804] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.263098 23084 raft_consensus.cc:697] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:25.253345 23047 tablet_bootstrap.cc:492] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:25.263983 23047 ts_tablet_manager.cc:1403] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.005s
I20260709 13:21:25.263919 23084 consensus_queue.cc:237] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.265828 23050 ts_tablet_manager.cc:1434] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 13:21:25.271552 23050 tablet_bootstrap.cc:492] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:25.274080 22674 catalog_manager.cc:5697] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:25.276456 23122 raft_consensus.cc:2749] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:25.277275 23047 raft_consensus.cc:359] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.277971 23047 raft_consensus.cc:385] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.278223 23047 raft_consensus.cc:740] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.278887 23047 consensus_queue.cc:260] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.283049 23048 tablet_bootstrap.cc:492] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:25.283542 23048 ts_tablet_manager.cc:1403] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.002s
I20260709 13:21:25.286190 23048 raft_consensus.cc:359] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.286834 23048 raft_consensus.cc:385] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.287098 23048 raft_consensus.cc:740] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.291452 23046 tablet_bootstrap.cc:492] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:25.291844 23047 ts_tablet_manager.cc:1434] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 13:21:25.291972 23046 ts_tablet_manager.cc:1403] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.153s	user 0.014s	sys 0.000s
I20260709 13:21:25.293267 23047 tablet_bootstrap.cc:492] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:25.295893 22676 catalog_manager.cc:5697] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:25.296552 23046 raft_consensus.cc:359] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.297195 23046 raft_consensus.cc:385] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.297451 23046 raft_consensus.cc:740] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.298158 23046 consensus_queue.cc:260] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.298262 23048 consensus_queue.cc:260] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.300530 23046 ts_tablet_manager.cc:1434] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:21:25.299751 22673 catalog_manager.cc:5697] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:25.301096 23048 ts_tablet_manager.cc:1434] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
I20260709 13:21:25.301474 23046 tablet_bootstrap.cc:492] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:25.302042 23048 tablet_bootstrap.cc:492] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:25.308730 23046 tablet_bootstrap.cc:654] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.309405 23125 consensus_queue.cc:1048] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:25.317590 23047 tablet_bootstrap.cc:654] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.324522 23048 tablet_bootstrap.cc:654] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.342548 23046 tablet_bootstrap.cc:492] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:25.343173 23046 ts_tablet_manager.cc:1403] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.005s
I20260709 13:21:25.349159 23125 consensus_queue.cc:1048] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.349645 23047 tablet_bootstrap.cc:492] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:25.350123 23047 ts_tablet_manager.cc:1403] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.005s
W20260709 13:21:25.354858 22964 consensus_peers.cc:597] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:25.355175 23083 consensus_queue.cc:1048] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:25.359472 23050 tablet_bootstrap.cc:654] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.363906 23047 raft_consensus.cc:359] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.364817 23047 raft_consensus.cc:385] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.366230 23046 raft_consensus.cc:359] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.366890 23046 raft_consensus.cc:385] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.367134 23046 raft_consensus.cc:740] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.367805 23046 consensus_queue.cc:260] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.369807 23046 ts_tablet_manager.cc:1434] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:21:25.370694 23046 tablet_bootstrap.cc:492] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:25.365149 23047 raft_consensus.cc:740] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.376658 23047 consensus_queue.cc:260] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.379369 23047 ts_tablet_manager.cc:1434] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:21:25.380419 23047 tablet_bootstrap.cc:492] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:25.392606 23047 tablet_bootstrap.cc:654] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.395429 23066 consensus_queue.cc:1048] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:21:25.404721 23046 tablet_bootstrap.cc:654] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.405076 22926 raft_consensus.cc:3060] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.414162 23048 tablet_bootstrap.cc:492] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:25.414656 23048 ts_tablet_manager.cc:1403] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.113s	user 0.042s	sys 0.038s
I20260709 13:21:25.417289 23050 tablet_bootstrap.cc:492] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:25.417837 23050 ts_tablet_manager.cc:1403] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.147s	user 0.010s	sys 0.001s
I20260709 13:21:25.417469 23048 raft_consensus.cc:359] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.418249 23048 raft_consensus.cc:385] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.418606 23048 raft_consensus.cc:740] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.419302 23048 consensus_queue.cc:260] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.426759 23050 raft_consensus.cc:359] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.427520 23050 raft_consensus.cc:385] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.427831 23050 raft_consensus.cc:740] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.429527 23050 consensus_queue.cc:260] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.431223 23056 consensus_queue.cc:1048] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:25.432168 23050 ts_tablet_manager.cc:1434] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:21:25.438472 23098 raft_consensus.cc:493] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.438975 23098 raft_consensus.cc:515] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.439524 23083 consensus_queue.cc:1048] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:25.441663 23098 leader_election.cc:290] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:25.443495 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7e2a19f1474c1fb8f98ee12a3be096" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.443720 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7e2a19f1474c1fb8f98ee12a3be096" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:25.444520 22777 raft_consensus.cc:2393] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 1: Already voted for candidate f825e4bed376497e95838e1b82dc1a03 in this term.
I20260709 13:21:25.433329 23050 tablet_bootstrap.cc:492] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:25.456504 23066 raft_consensus.cc:493] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.457031 23066 raft_consensus.cc:515] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.459239 23066 leader_election.cc:290] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:25.452359 23048 ts_tablet_manager.cc:1434] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:21:25.460767 23048 tablet_bootstrap.cc:492] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:25.461182 22892 leader_election.cc:304] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:25.463400 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:25.464473 23084 raft_consensus.cc:493] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.464846 23047 tablet_bootstrap.cc:492] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:25.465376 23047 ts_tablet_manager.cc:1403] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.008s
I20260709 13:21:25.465677 23098 raft_consensus.cc:3060] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:25.466004 22964 leader_election.cc:343] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.467404 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.470131 23084 raft_consensus.cc:515] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.470355 23138 consensus_queue.cc:1048] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:25.473135 23138 raft_consensus.cc:493] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.473321 23084 leader_election.cc:290] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:25.473585 23138 raft_consensus.cc:515] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.475268 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc14860c91ac4d97bc55ddecd79c6ac5" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:25.475507 23048 tablet_bootstrap.cc:654] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.473232 23047 raft_consensus.cc:359] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.476120 22778 raft_consensus.cc:3060] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.481518 23047 raft_consensus.cc:385] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.481839 23047 raft_consensus.cc:740] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
W20260709 13:21:25.476284 22966 leader_election.cc:343] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.482522 23056 raft_consensus.cc:493] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.482556 22966 leader_election.cc:304] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:25.483079 23056 raft_consensus.cc:515] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.484022 22851 raft_consensus.cc:2393] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9cee38bd2dd4b4e999490708cacd3a9 in current term 1: Already voted for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in this term.
I20260709 13:21:25.485327 23056 leader_election.cc:290] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:25.486028 23102 raft_consensus.cc:2749] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.486027 23047 consensus_queue.cc:260] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.488624 23047 ts_tablet_manager.cc:1434] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.005s
I20260709 13:21:25.481369 23138 leader_election.cc:290] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:25.489557 23047 tablet_bootstrap.cc:492] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:25.489537 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8ad0acb5ce4ffc9edaa00062e64060" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:25.497262 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4740c47164894cbe8add259947545a4e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:25.497920 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4740c47164894cbe8add259947545a4e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:25.498550 22851 raft_consensus.cc:2468] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:25.499424 23084 raft_consensus.cc:493] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.499913 23084 raft_consensus.cc:515] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.500044 22964 leader_election.cc:304] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 
W20260709 13:21:25.500495 22816 leader_election.cc:343] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.501139 23056 consensus_queue.cc:1048] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.501804 23083 raft_consensus.cc:493] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.502534 23083 raft_consensus.cc:515] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.503051 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8ad0acb5ce4ffc9edaa00062e64060" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:25.503750 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:25.505239 23083 leader_election.cc:290] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:25.506881 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:25.507490 23098 raft_consensus.cc:2749] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.508265 23102 raft_consensus.cc:2804] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.508452 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d21ac823716443b908d3e64bd1270a8" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.508684 23102 raft_consensus.cc:493] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.509084 23102 raft_consensus.cc:3060] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.509261 22775 raft_consensus.cc:2393] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 1: Already voted for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in this term.
I20260709 13:21:25.510773 22741 leader_election.cc:304] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:25.511739 23137 raft_consensus.cc:2749] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.501940 23084 leader_election.cc:290] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:25.519035 23046 tablet_bootstrap.cc:492] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:25.519692 23046 ts_tablet_manager.cc:1403] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.149s	user 0.020s	sys 0.014s
W20260709 13:21:25.501291 22964 leader_election.cc:343] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.530993 23046 raft_consensus.cc:359] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.529248 23048 tablet_bootstrap.cc:492] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:25.517952 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc14860c91ac4d97bc55ddecd79c6ac5" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:25.532570 23046 raft_consensus.cc:385] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.533499 23046 raft_consensus.cc:740] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.538156 23050 tablet_bootstrap.cc:654] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.539656 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d21ac823716443b908d3e64bd1270a8" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:25.541165 22741 leader_election.cc:304] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:25.542433 23084 raft_consensus.cc:2749] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.543356 23046 consensus_queue.cc:260] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.541203 23098 consensus_queue.cc:1048] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:21:25.549361 22964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:34985, user_credentials={real_user=slave}} blocked reactor thread for 48113.8us
I20260709 13:21:25.544981 23047 tablet_bootstrap.cc:654] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:25.540217 22816 leader_election.cc:343] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.549714 23046 ts_tablet_manager.cc:1434] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:21:25.553028 23046 tablet_bootstrap.cc:492] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:25.533109 23048 ts_tablet_manager.cc:1403] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.009s
I20260709 13:21:25.550875 22816 leader_election.cc:304] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:25.555579 22816 leader_election.cc:304] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:25.556411 23125 raft_consensus.cc:2749] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.557142 23048 raft_consensus.cc:359] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.557690 23122 raft_consensus.cc:3060] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.557924 23048 raft_consensus.cc:385] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.558214 23048 raft_consensus.cc:740] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.550678 23053 raft_consensus.cc:493] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.560446 23053 raft_consensus.cc:515] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.558863 23048 consensus_queue.cc:260] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.570118 23138 consensus_queue.cc:1048] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.531555 23102 raft_consensus.cc:515] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.577294 23046 tablet_bootstrap.cc:654] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.578392 23123 consensus_queue.cc:1048] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:25.579036 23053 leader_election.cc:290] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:25.580296 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670cb5d0cf514ec78871a6a32e316c13" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:25.580885 23102 leader_election.cc:290] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:25.580917 22853 raft_consensus.cc:2468] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:25.585533 22776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670cb5d0cf514ec78871a6a32e316c13" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.587534 22964 leader_election.cc:304] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:25.588691 23053 raft_consensus.cc:2804] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.589043 23053 raft_consensus.cc:493] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.589368 23053 raft_consensus.cc:3060] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.589706 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4740c47164894cbe8add259947545a4e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:25.591365 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4740c47164894cbe8add259947545a4e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:25.592062 22853 raft_consensus.cc:3060] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.597512 23048 ts_tablet_manager.cc:1434] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
W20260709 13:21:25.589380 22966 leader_election.cc:343] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.599306 22853 raft_consensus.cc:2468] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:25.603003 23048 tablet_bootstrap.cc:492] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:25.603111 22778 raft_consensus.cc:3060] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.614847 23122 raft_consensus.cc:2749] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:25.602738 22966 consensus_peers.cc:597] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:25.617532 23048 tablet_bootstrap.cc:654] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:25.606438 22964 leader_election.cc:343] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.630369 22964 leader_election.cc:304] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:25.631796 23066 raft_consensus.cc:2804] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.650751 23050 tablet_bootstrap.cc:492] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:25.651312 23050 ts_tablet_manager.cc:1403] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.218s	user 0.014s	sys 0.008s
I20260709 13:21:25.660470 23047 tablet_bootstrap.cc:492] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:25.660977 23047 ts_tablet_manager.cc:1403] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.172s	user 0.010s	sys 0.012s
I20260709 13:21:25.661935 23123 consensus_queue.cc:1048] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.664140 23047 raft_consensus.cc:359] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.665303 23047 raft_consensus.cc:385] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.665601 23047 raft_consensus.cc:740] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.666462 23047 consensus_queue.cc:260] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.666551 23138 consensus_queue.cc:1048] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.668560 23047 ts_tablet_manager.cc:1434] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:21:25.669474 23047 tablet_bootstrap.cc:492] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:25.671609 23053 raft_consensus.cc:515] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.673815 23053 leader_election.cc:290] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:25.674628 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670cb5d0cf514ec78871a6a32e316c13" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:25.675081 23047 tablet_bootstrap.cc:654] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:25.676759 22966 leader_election.cc:343] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.676623 23050 raft_consensus.cc:359] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.679324 23050 raft_consensus.cc:385] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.679698 23050 raft_consensus.cc:740] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.684960 23050 consensus_queue.cc:260] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.687309 23050 ts_tablet_manager.cc:1434] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:21:25.683903 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670cb5d0cf514ec78871a6a32e316c13" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:25.692919 23050 tablet_bootstrap.cc:492] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:25.712363 23178 consensus_queue.cc:1048] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:25.708652 22853 raft_consensus.cc:3060] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.709345 23066 raft_consensus.cc:697] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:25.722623 23046 tablet_bootstrap.cc:492] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:25.723871 23046 ts_tablet_manager.cc:1403] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.171s	user 0.031s	sys 0.024s
I20260709 13:21:25.732914 23123 consensus_queue.cc:1048] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.734280 23084 consensus_queue.cc:1048] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:25.734386 23046 raft_consensus.cc:359] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.735069 23046 raft_consensus.cc:385] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.735328 23046 raft_consensus.cc:740] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.745270 23047 tablet_bootstrap.cc:492] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:25.745862 23047 ts_tablet_manager.cc:1403] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.019s
I20260709 13:21:25.742584 23046 consensus_queue.cc:260] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.754736 23047 raft_consensus.cc:359] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.756014 23047 raft_consensus.cc:385] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.767762 23047 raft_consensus.cc:740] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.768559 23047 consensus_queue.cc:260] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:25.769555 22964 consensus_peers.cc:597] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:25.770381 23048 tablet_bootstrap.cc:492] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:25.770911 23048 ts_tablet_manager.cc:1403] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.170s	user 0.008s	sys 0.014s
I20260709 13:21:25.773699 23048 raft_consensus.cc:359] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.740392 23066 consensus_queue.cc:237] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.767241 22853 raft_consensus.cc:2468] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:25.774950 23046 ts_tablet_manager.cc:1434] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:21:25.774386 23047 ts_tablet_manager.cc:1434] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:21:25.778955 23048 raft_consensus.cc:385] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.780831 23046 tablet_bootstrap.cc:492] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:25.780774 23048 raft_consensus.cc:740] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.781654 23047 tablet_bootstrap.cc:492] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
W20260709 13:21:25.785928 22741 consensus_peers.cc:597] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:25.787976 23048 consensus_queue.cc:260] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.792497 22964 leader_election.cc:304] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:25.793220 23138 raft_consensus.cc:2804] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.793685 23138 raft_consensus.cc:697] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:25.794992 23138 consensus_queue.cc:237] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.796689 23050 tablet_bootstrap.cc:654] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.799957 23048 ts_tablet_manager.cc:1434] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:21:25.800726 23048 tablet_bootstrap.cc:492] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:25.807360 23048 tablet_bootstrap.cc:654] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.811285 23047 tablet_bootstrap.cc:654] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.812230 23046 tablet_bootstrap.cc:654] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.844412 23050 tablet_bootstrap.cc:492] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:25.844894 23050 ts_tablet_manager.cc:1403] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.152s	user 0.009s	sys 0.010s
I20260709 13:21:25.844743 22674 catalog_manager.cc:5697] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:25.848001 23083 raft_consensus.cc:493] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.848537 23083 raft_consensus.cc:515] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.849475 23050 raft_consensus.cc:359] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.851150 23050 raft_consensus.cc:385] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.851423 23050 raft_consensus.cc:740] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.852408 23083 leader_election.cc:290] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:25.852744 23050 consensus_queue.cc:260] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.853127 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf330fe4b59c472a9c3bcb18161ff906" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.854548 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf330fe4b59c472a9c3bcb18161ff906" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:25.858306 22818 leader_election.cc:343] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:25.860054 22816 leader_election.cc:343] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.860663 22816 leader_election.cc:304] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:25.862136 23083 raft_consensus.cc:2749] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.865896 23048 tablet_bootstrap.cc:492] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:25.866386 23048 ts_tablet_manager.cc:1403] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.000s
I20260709 13:21:25.867195 23047 tablet_bootstrap.cc:492] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:25.867825 23047 ts_tablet_manager.cc:1403] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.019s
I20260709 13:21:25.869056 23048 raft_consensus.cc:359] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.869745 23048 raft_consensus.cc:385] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.870014 23048 raft_consensus.cc:740] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.870736 23048 consensus_queue.cc:260] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
W20260709 13:21:25.871831 22723 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:25.873090 23048 ts_tablet_manager.cc:1434] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:21:25.873853 23048 tablet_bootstrap.cc:492] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:25.876258 23047 raft_consensus.cc:359] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.877027 23047 raft_consensus.cc:385] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.877287 23047 raft_consensus.cc:740] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.878109 23047 consensus_queue.cc:260] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.880398 23047 ts_tablet_manager.cc:1434] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:21:25.881071 23184 raft_consensus.cc:493] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.881313 23047 tablet_bootstrap.cc:492] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:25.881729 23184 raft_consensus.cc:515] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.887576 23050 ts_tablet_manager.cc:1434] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:21:25.888661 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8ad0acb5ce4ffc9edaa00062e64060" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:25.889364 22851 raft_consensus.cc:2468] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
I20260709 13:21:25.890504 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8ad0acb5ce4ffc9edaa00062e64060" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:25.891150 23000 raft_consensus.cc:2468] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
I20260709 13:21:25.891776 23184 leader_election.cc:290] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:25.892490 22890 leader_election.cc:304] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:25.893918 23046 tablet_bootstrap.cc:492] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:25.894387 23046 ts_tablet_manager.cc:1403] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.114s	user 0.022s	sys 0.004s
I20260709 13:21:25.894783 23184 raft_consensus.cc:2804] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.895197 23184 raft_consensus.cc:493] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.895531 23184 raft_consensus.cc:3060] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.897204 23046 raft_consensus.cc:359] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.897903 23046 raft_consensus.cc:385] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.898190 23046 raft_consensus.cc:740] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.900797 23046 consensus_queue.cc:260] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.902671 23184 raft_consensus.cc:515] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.903179 23046 ts_tablet_manager.cc:1434] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:21:25.888722 23047 tablet_bootstrap.cc:654] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.904139 23046 tablet_bootstrap.cc:492] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:25.909714 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8ad0acb5ce4ffc9edaa00062e64060" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:25.910331 22851 raft_consensus.cc:3060] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.911144 23046 tablet_bootstrap.cc:654] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.917390 23191 raft_consensus.cc:493] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.917899 23191 raft_consensus.cc:515] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.920509 23191 leader_election.cc:290] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:25.922724 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:25.923475 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:25.924139 22850 raft_consensus.cc:2468] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:25.925029 23046 tablet_bootstrap.cc:492] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
W20260709 13:21:25.925107 22741 leader_election.cc:343] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.925632 23046 ts_tablet_manager.cc:1403] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:21:25.926311 22741 leader_election.cc:304] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:25.928437 23046 raft_consensus.cc:359] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.927428 23191 raft_consensus.cc:2804] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.931277 23081 raft_consensus.cc:493] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.888705 23050 tablet_bootstrap.cc:492] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:25.931924 23081 raft_consensus.cc:515] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.934135 23081 leader_election.cc:290] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:25.934787 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:25.935424 23000 raft_consensus.cc:2468] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
I20260709 13:21:25.935370 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.934767 23191 raft_consensus.cc:493] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.936668 23191 raft_consensus.cc:3060] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.936774 22890 leader_election.cc:304] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:25.937311 23048 tablet_bootstrap.cc:654] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:25.937592 22892 leader_election.cc:343] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.938519 23081 raft_consensus.cc:2804] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:25.938930 23081 raft_consensus.cc:493] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:25.939262 23081 raft_consensus.cc:3060] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.946221 23050 tablet_bootstrap.cc:654] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.946311 23081 raft_consensus.cc:515] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.948148 23046 raft_consensus.cc:385] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.948482 23046 raft_consensus.cc:740] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.949277 22851 raft_consensus.cc:2468] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:25.949242 23046 consensus_queue.cc:260] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.951856 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:25.952526 23000 raft_consensus.cc:3060] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.953527 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
W20260709 13:21:25.954917 22892 leader_election.cc:343] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.954873 22890 leader_election.cc:304] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:25.956574 23084 raft_consensus.cc:493] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.957052 23081 leader_election.cc:290] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:25.957190 23084 raft_consensus.cc:515] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.959889 23000 raft_consensus.cc:2468] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:25.960515 23047 tablet_bootstrap.cc:492] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:25.961009 23047 ts_tablet_manager.cc:1403] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.005s
I20260709 13:21:25.943691 23191 raft_consensus.cc:515] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:25.961179 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6efd72b4114248adef337292eaede0" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:25.963160 23084 leader_election.cc:290] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:25.963363 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:25.964342 22851 raft_consensus.cc:3060] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.965025 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6efd72b4114248adef337292eaede0" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:25.967098 23066 raft_consensus.cc:493] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.967770 23183 raft_consensus.cc:2804] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.967584 23066 raft_consensus.cc:515] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:25.968474 23183 raft_consensus.cc:697] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:25.969901 23066 leader_election.cc:290] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:25.969574 23183 consensus_queue.cc:237] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:25.966864 22741 leader_election.cc:304] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:25.972908 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e4bbf8e1a12402f8ecefd83160f4672" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:25.973425 22890 leader_election.cc:304] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:25.974684 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c8ad0acb5ce4ffc9edaa00062e64060" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:25.975431 22999 raft_consensus.cc:3060] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:25.975826 23191 leader_election.cc:290] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
W20260709 13:21:25.977671 22966 leader_election.cc:343] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.978806 23050 tablet_bootstrap.cc:492] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:25.978909 23047 raft_consensus.cc:359] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.979342 23050 ts_tablet_manager.cc:1403] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.006s
I20260709 13:21:25.979080 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e4bbf8e1a12402f8ecefd83160f4672" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:25.979703 23047 raft_consensus.cc:385] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:25.980068 23047 raft_consensus.cc:740] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:25.981102 23046 ts_tablet_manager.cc:1434] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.001s
W20260709 13:21:25.980947 22964 leader_election.cc:343] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:25.982044 23046 tablet_bootstrap.cc:492] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:25.981698 22964 leader_election.cc:304] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:25.982900 23066 raft_consensus.cc:2749] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.983950 23047 consensus_queue.cc:260] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.977568 22851 raft_consensus.cc:2468] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:25.987663 23191 raft_consensus.cc:2749] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:25.988186 23047 ts_tablet_manager.cc:1434] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:21:25.988291 23046 tablet_bootstrap.cc:654] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.989540 23047 tablet_bootstrap.cc:492] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:25.993809 23066 raft_consensus.cc:493] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:25.994318 23066 raft_consensus.cc:515] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:25.996480 23066 leader_election.cc:290] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:25.997032 23123 raft_consensus.cc:2804] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:25.997778 23047 tablet_bootstrap.cc:654] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:25.999416 23050 raft_consensus.cc:359] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.000244 23050 raft_consensus.cc:385] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.000504 23050 raft_consensus.cc:740] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.001192 23048 tablet_bootstrap.cc:492] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:26.001142 23050 consensus_queue.cc:260] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.001633 22999 raft_consensus.cc:2468] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:26.001837 23048 ts_tablet_manager.cc:1403] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.025s
I20260709 13:21:26.005867 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7915d0ecd98c4c04b76169d6a45314e3" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:26.006379 23046 tablet_bootstrap.cc:492] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:25.956156 23184 leader_election.cc:290] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:26.006544 22775 raft_consensus.cc:2468] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:26.007088 23046 ts_tablet_manager.cc:1403] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 13:21:26.007994 22966 leader_election.cc:304] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:26.008394 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7915d0ecd98c4c04b76169d6a45314e3" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:26.010530 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:26.011083 22741 leader_election.cc:304] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
W20260709 13:21:26.012036 22741 leader_election.cc:343] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.012136 23138 raft_consensus.cc:2804] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:21:26.011929 22964 leader_election.cc:343] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.012784 23138 raft_consensus.cc:493] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.013165 23138 raft_consensus.cc:3060] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.011925 23048 raft_consensus.cc:359] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.023052 23048 raft_consensus.cc:385] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.023972 23202 raft_consensus.cc:2804] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:26.024518 23202 raft_consensus.cc:697] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:26.025405 23202 consensus_queue.cc:237] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.023411 23048 raft_consensus.cc:740] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.003518 23050 ts_tablet_manager.cc:1434] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:21:26.030236 23050 tablet_bootstrap.cc:492] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:26.029613 23048 consensus_queue.cc:260] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.032423 23046 raft_consensus.cc:359] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.033073 23046 raft_consensus.cc:385] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.033370 23046 raft_consensus.cc:740] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.034058 23046 consensus_queue.cc:260] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.038784 23047 tablet_bootstrap.cc:492] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:26.039319 23047 ts_tablet_manager.cc:1403] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.050s	user 0.029s	sys 0.011s
I20260709 13:21:26.042500 23046 ts_tablet_manager.cc:1434] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:21:26.043848 23047 raft_consensus.cc:359] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.044644 23047 raft_consensus.cc:385] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.045091 23047 raft_consensus.cc:740] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.043488 23046 tablet_bootstrap.cc:492] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:26.045924 23047 consensus_queue.cc:260] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.048880 23047 ts_tablet_manager.cc:1434] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:26.049721 23048 ts_tablet_manager.cc:1434] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:21:26.049811 23047 tablet_bootstrap.cc:492] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:26.050802 23048 tablet_bootstrap.cc:492] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:26.053157 23046 tablet_bootstrap.cc:654] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.053646 23123 raft_consensus.cc:697] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:26.054589 23123 consensus_queue.cc:237] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.056624 23048 tablet_bootstrap.cc:654] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.066370 22775 raft_consensus.cc:3060] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.067580 23047 tablet_bootstrap.cc:654] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.069429 22674 catalog_manager.cc:5697] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.043488 23138 raft_consensus.cc:515] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.059087 23084 raft_consensus.cc:493] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.074141 23084 raft_consensus.cc:515] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.076598 23125 raft_consensus.cc:493] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.077175 23125 raft_consensus.cc:515] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.076730 23084 leader_election.cc:290] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:26.063895 22671 catalog_manager.cc:5697] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.079994 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7915d0ecd98c4c04b76169d6a45314e3" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
W20260709 13:21:26.081748 22964 leader_election.cc:343] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.060038 23050 tablet_bootstrap.cc:654] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.083653 23125 leader_election.cc:290] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:26.083933 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670cb5d0cf514ec78871a6a32e316c13" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:26.084740 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "670cb5d0cf514ec78871a6a32e316c13" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:26.088841 22851 raft_consensus.cc:2393] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9cee38bd2dd4b4e999490708cacd3a9 in current term 1: Already voted for candidate f825e4bed376497e95838e1b82dc1a03 in this term.
I20260709 13:21:26.090454 23125 raft_consensus.cc:493] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.090653 22741 leader_election.cc:304] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:26.091061 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7915d0ecd98c4c04b76169d6a45314e3" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:26.091820 22778 raft_consensus.cc:3060] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.091140 23125 raft_consensus.cc:515] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.064057 23046 tablet_bootstrap.cc:492] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:26.094866 23046 ts_tablet_manager.cc:1403] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.008s
I20260709 13:21:26.086017 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e4bbf8e1a12402f8ecefd83160f4672" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:26.096005 23000 raft_consensus.cc:2468] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:26.086943 22776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e4bbf8e1a12402f8ecefd83160f4672" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:26.097877 23046 raft_consensus.cc:359] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.098640 23046 raft_consensus.cc:385] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.098937 23046 raft_consensus.cc:740] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
W20260709 13:21:26.099704 22818 leader_election.cc:343] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.099617 23046 consensus_queue.cc:260] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.100644 23202 raft_consensus.cc:3060] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.102998 22778 raft_consensus.cc:2468] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:26.103986 22816 leader_election.cc:304] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:26.104408 22966 leader_election.cc:304] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:26.105460 23122 raft_consensus.cc:2804] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:26.106032 23122 raft_consensus.cc:493] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.106292 23053 raft_consensus.cc:2804] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:26.106499 23122 raft_consensus.cc:3060] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.106861 23053 raft_consensus.cc:697] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:26.107467 23046 ts_tablet_manager.cc:1434] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:21:26.107756 23053 consensus_queue.cc:237] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.108368 23046 tablet_bootstrap.cc:492] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:26.113397 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f2c58a06ac445b85ec78b0e8531134" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:26.113894 23084 raft_consensus.cc:493] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.114423 23084 raft_consensus.cc:515] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:26.115746 22816 leader_election.cc:343] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.117169 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:26.117864 22851 raft_consensus.cc:2468] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:26.118582 23125 leader_election.cc:290] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:26.119100 22741 leader_election.cc:304] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:26.119997 23191 raft_consensus.cc:2804] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:26.120375 23191 raft_consensus.cc:493] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.120723 23191 raft_consensus.cc:3060] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.121076 23122 raft_consensus.cc:515] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.122859 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f2c58a06ac445b85ec78b0e8531134" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:26.123740 23000 raft_consensus.cc:2468] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:26.124431 22673 catalog_manager.cc:5697] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.105612 23138 leader_election.cc:290] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:26.131806 23191 raft_consensus.cc:515] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.133325 23137 raft_consensus.cc:493] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.133841 23137 raft_consensus.cc:515] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.134639 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:26.135211 22850 raft_consensus.cc:3060] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.136240 23137 leader_election.cc:290] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:26.125742 22816 leader_election.cc:304] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:26.138294 23125 raft_consensus.cc:2804] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:26.138779 23125 raft_consensus.cc:493] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.139186 23125 raft_consensus.cc:3060] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.141580 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:26.145264 22741 leader_election.cc:343] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.146485 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:26.147161 22999 raft_consensus.cc:2468] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:26.153165 22741 leader_election.cc:304] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:26.153975 23137 raft_consensus.cc:2804] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:26.126679 23084 leader_election.cc:290] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:26.127276 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e4bbf8e1a12402f8ecefd83160f4672" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:26.154850 23000 raft_consensus.cc:3060] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.157743 22850 raft_consensus.cc:2468] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:26.158787 22741 leader_election.cc:304] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:26.127699 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e4bbf8e1a12402f8ecefd83160f4672" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:26.159885 23084 raft_consensus.cc:2804] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:26.160540 22671 catalog_manager.cc:5697] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:26.161394 22818 leader_election.cc:343] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.162282 23084 raft_consensus.cc:697] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:26.128172 23122 leader_election.cc:290] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:26.163254 23084 consensus_queue.cc:237] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.128252 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:26.129264 23202 raft_consensus.cc:2749] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:26.154333 23137 raft_consensus.cc:493] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.165217 23137 raft_consensus.cc:3060] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:26.165277 22741 leader_election.cc:343] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.182309 23137 raft_consensus.cc:515] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.182915 23191 leader_election.cc:290] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:26.182534 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:26.195964 23138 consensus_queue.cc:1048] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.204064 23137 leader_election.cc:290] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
W20260709 13:21:26.205852 22741 leader_election.cc:343] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.207136 23000 raft_consensus.cc:2468] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:26.196758 23178 raft_consensus.cc:493] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.209218 23178 raft_consensus.cc:515] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.210438 23048 tablet_bootstrap.cc:492] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:26.200966 23050 tablet_bootstrap.cc:492] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:26.211040 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:26.211323 23178 leader_election.cc:290] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:26.211023 23050 ts_tablet_manager.cc:1403] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.181s	user 0.014s	sys 0.000s
I20260709 13:21:26.212747 23048 ts_tablet_manager.cc:1403] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.162s	user 0.077s	sys 0.059s
I20260709 13:21:26.210079 23125 raft_consensus.cc:515] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.219895 22816 leader_election.cc:304] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:26.215902 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:26.222214 23125 leader_election.cc:290] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
W20260709 13:21:26.222398 22966 leader_election.cc:343] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.215338 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:26.197034 23046 tablet_bootstrap.cc:654] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:26.226089 22964 leader_election.cc:343] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.226534 22964 leader_election.cc:304] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:26.227407 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f2c58a06ac445b85ec78b0e8531134" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:26.227743 23178 raft_consensus.cc:2749] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:26.228048 22999 raft_consensus.cc:3060] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.218904 23138 consensus_queue.cc:1048] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.229058 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f2c58a06ac445b85ec78b0e8531134" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:26.218351 22674 catalog_manager.cc:5697] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:26.219146 22741 leader_election.cc:343] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.220865 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:26.231410 23050 raft_consensus.cc:359] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.232782 23050 raft_consensus.cc:385] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.233150 23050 raft_consensus.cc:740] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.218080 23053 consensus_queue.cc:1048] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.235450 23050 consensus_queue.cc:260] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:26.237057 22816 leader_election.cc:343] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.238626 23050 ts_tablet_manager.cc:1434] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:21:26.235389 23000 raft_consensus.cc:3060] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.239324 23138 raft_consensus.cc:493] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.246932 22999 raft_consensus.cc:2468] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:26.235020 23122 raft_consensus.cc:2804] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:26.255924 23122 raft_consensus.cc:697] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:26.256767 23122 consensus_queue.cc:237] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.248143 23050 tablet_bootstrap.cc:492] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:26.249570 23048 raft_consensus.cc:359] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.252086 23047 tablet_bootstrap.cc:492] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:26.260130 23048 raft_consensus.cc:385] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.251648 23138 raft_consensus.cc:515] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.260581 23048 raft_consensus.cc:740] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.260787 23047 ts_tablet_manager.cc:1403] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.211s	user 0.010s	sys 0.004s
I20260709 13:21:26.265604 22816 leader_election.cc:304] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:26.266726 23056 raft_consensus.cc:2804] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:26.267200 23056 raft_consensus.cc:697] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:26.268030 23056 consensus_queue.cc:237] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.224411 22673 catalog_manager.cc:5697] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.277777 23048 consensus_queue.cc:260] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.275059 23138 leader_election.cc:290] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:26.287158 23046 tablet_bootstrap.cc:492] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:26.287772 23046 ts_tablet_manager.cc:1403] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.180s	user 0.022s	sys 0.010s
I20260709 13:21:26.290128 23047 raft_consensus.cc:359] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.290313 23046 raft_consensus.cc:359] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.290871 23047 raft_consensus.cc:385] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.290911 23046 raft_consensus.cc:385] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.291311 23047 raft_consensus.cc:740] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.291422 23046 raft_consensus.cc:740] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.292090 23046 consensus_queue.cc:260] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.292737 23050 tablet_bootstrap.cc:654] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.299937 23047 consensus_queue.cc:260] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.303903 23046 ts_tablet_manager.cc:1434] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:21:26.304561 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea82caef4f4f439c84611d5e6a9c10df" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:26.305848 22964 leader_election.cc:343] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.306299 23046 tablet_bootstrap.cc:492] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:26.310740 23046 tablet_bootstrap.cc:654] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.312584 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea82caef4f4f439c84611d5e6a9c10df" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:26.317070 22926 raft_consensus.cc:3060] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.319085 23000 raft_consensus.cc:2468] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:26.321902 23047 ts_tablet_manager.cc:1434] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.001s
I20260709 13:21:26.322256 22741 leader_election.cc:304] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:26.323031 23047 tablet_bootstrap.cc:492] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:26.323694 23137 raft_consensus.cc:2804] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:26.324592 22964 leader_election.cc:343] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.324240 23137 raft_consensus.cc:697] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:26.324141 23048 ts_tablet_manager.cc:1434] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.000s
I20260709 13:21:26.330740 23048 tablet_bootstrap.cc:492] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:26.334415 22964 leader_election.cc:304] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:26.340354 23137 consensus_queue.cc:237] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.352698 23178 raft_consensus.cc:2749] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:26.356849 22964 consensus_peers.cc:597] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:26.359548 23050 tablet_bootstrap.cc:492] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:26.363664 23050 ts_tablet_manager.cc:1403] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.116s	user 0.019s	sys 0.000s
I20260709 13:21:26.366173 22674 catalog_manager.cc:5697] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:26.368101 22674 catalog_manager.cc:5697] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:26.374552 23047 tablet_bootstrap.cc:654] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.375084 23048 tablet_bootstrap.cc:654] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.380280 23050 raft_consensus.cc:359] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.381248 23050 raft_consensus.cc:385] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.381588 23050 raft_consensus.cc:740] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.390303 23205 consensus_queue.cc:1048] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.395757 23050 consensus_queue.cc:260] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.402873 23050 ts_tablet_manager.cc:1434] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:21:26.402864 22672 catalog_manager.cc:5697] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:26.406473 23050 tablet_bootstrap.cc:492] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:26.413882 23046 tablet_bootstrap.cc:492] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:26.414386 23046 ts_tablet_manager.cc:1403] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.108s	user 0.022s	sys 0.008s
I20260709 13:21:26.415138 23050 tablet_bootstrap.cc:654] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.420835 23046 raft_consensus.cc:359] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.421790 23046 raft_consensus.cc:385] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.422113 23046 raft_consensus.cc:740] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.422931 23046 consensus_queue.cc:260] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.425468 23046 ts_tablet_manager.cc:1434] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:21:26.426775 23046 tablet_bootstrap.cc:492] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:26.433344 23046 tablet_bootstrap.cc:654] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.433578 23048 tablet_bootstrap.cc:492] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:26.434064 23048 ts_tablet_manager.cc:1403] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.104s	user 0.009s	sys 0.016s
I20260709 13:21:26.437089 23178 raft_consensus.cc:493] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.437620 23178 raft_consensus.cc:515] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.439627 23046 tablet_bootstrap.cc:492] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:26.440325 23046 ts_tablet_manager.cc:1403] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 13:21:26.441411 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:26.442355 23178 leader_election.cc:290] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
W20260709 13:21:26.442696 22964 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.443825 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:26.443642 23046 raft_consensus.cc:359] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.444645 23046 raft_consensus.cc:385] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.444988 23046 raft_consensus.cc:740] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
W20260709 13:21:26.445897 22966 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.446434 22966 leader_election.cc:304] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:26.445834 23046 consensus_queue.cc:260] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.447041 23178 raft_consensus.cc:2749] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:26.449839 23047 tablet_bootstrap.cc:492] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:26.450367 23047 ts_tablet_manager.cc:1403] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.128s	user 0.010s	sys 0.008s
I20260709 13:21:26.452898 23047 raft_consensus.cc:359] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.453074 23137 consensus_queue.cc:1048] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.453570 23047 raft_consensus.cc:385] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.453975 23047 raft_consensus.cc:740] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.454677 23047 consensus_queue.cc:260] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.456830 23047 ts_tablet_manager.cc:1434] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:21:26.457753 23047 tablet_bootstrap.cc:492] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:26.467582 23184 consensus_queue.cc:1048] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.471470 23046 ts_tablet_manager.cc:1434] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:21:26.473974 23047 tablet_bootstrap.cc:654] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.476401 23046 tablet_bootstrap.cc:492] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:26.483580 23102 raft_consensus.cc:493] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.484220 23102 raft_consensus.cc:515] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.486915 23102 leader_election.cc:290] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:26.489226 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33209c9cbc0949fb933224b7cb5dce53" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:26.491376 22926 raft_consensus.cc:3060] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.487690 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33209c9cbc0949fb933224b7cb5dce53" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:26.497520 22966 leader_election.cc:343] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:26.503898 22964 leader_election.cc:343] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.506999 22964 leader_election.cc:304] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:26.509321 23215 consensus_queue.cc:1048] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:26.512705 23102 raft_consensus.cc:2749] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:26.527163 23046 tablet_bootstrap.cc:654] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:26.540693 22892 consensus_peers.cc:597] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:26.542822 23048 raft_consensus.cc:359] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.549527 23048 raft_consensus.cc:385] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.549871 23048 raft_consensus.cc:740] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.550679 23048 consensus_queue.cc:260] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.553069 23048 ts_tablet_manager.cc:1434] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.001s
I20260709 13:21:26.553995 23048 tablet_bootstrap.cc:492] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:26.559999 23048 tablet_bootstrap.cc:654] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.565590 23050 tablet_bootstrap.cc:492] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:26.566151 23050 ts_tablet_manager.cc:1403] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.160s	user 0.041s	sys 0.036s
I20260709 13:21:26.568753 23050 raft_consensus.cc:359] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.569447 23050 raft_consensus.cc:385] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.569638 23046 tablet_bootstrap.cc:492] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:26.569761 23050 raft_consensus.cc:740] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.570168 23046 ts_tablet_manager.cc:1403] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.003s
I20260709 13:21:26.570709 23047 tablet_bootstrap.cc:492] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:26.570490 23050 consensus_queue.cc:260] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.571131 23047 ts_tablet_manager.cc:1403] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.114s	user 0.033s	sys 0.032s
I20260709 13:21:26.572753 23046 raft_consensus.cc:359] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.573431 23046 raft_consensus.cc:385] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.573275 23047 raft_consensus.cc:359] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.573784 23046 raft_consensus.cc:740] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.574018 23047 raft_consensus.cc:385] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.574440 23047 raft_consensus.cc:740] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.574487 23046 consensus_queue.cc:260] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.575042 23047 consensus_queue.cc:260] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.577066 23050 ts_tablet_manager.cc:1434] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:21:26.578007 23050 tablet_bootstrap.cc:492] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:26.579517 23047 ts_tablet_manager.cc:1434] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:26.580829 23047 tablet_bootstrap.cc:492] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:26.581828 23056 raft_consensus.cc:493] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.582300 23056 raft_consensus.cc:515] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.584353 23056 leader_election.cc:290] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:26.585512 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:26.586659 23047 tablet_bootstrap.cc:654] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.586491 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:26.588040 22818 leader_election.cc:343] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.591696 23050 tablet_bootstrap.cc:654] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:26.592195 22816 leader_election.cc:343] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.592707 22816 leader_election.cc:304] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:26.593452 23056 raft_consensus.cc:2749] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:26.602154 23046 ts_tablet_manager.cc:1434] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:21:26.602146 23047 tablet_bootstrap.cc:492] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:26.602941 23047 ts_tablet_manager.cc:1403] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.022s	user 0.001s	sys 0.021s
I20260709 13:21:26.603328 23046 tablet_bootstrap.cc:492] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:26.605337 23048 tablet_bootstrap.cc:492] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:26.605502 23047 raft_consensus.cc:359] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.606271 23047 raft_consensus.cc:385] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.606606 23047 raft_consensus.cc:740] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.605993 23048 ts_tablet_manager.cc:1403] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.006s
I20260709 13:21:26.609498 23048 raft_consensus.cc:359] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.610140 23048 raft_consensus.cc:385] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.610417 23048 raft_consensus.cc:740] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.611025 23048 consensus_queue.cc:260] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.612998 23048 ts_tablet_manager.cc:1434] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:26.613463 23047 consensus_queue.cc:260] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.616221 23047 ts_tablet_manager.cc:1434] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:21:26.617084 23047 tablet_bootstrap.cc:492] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:26.617463 23184 consensus_queue.cc:1048] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.618316 23046 tablet_bootstrap.cc:654] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.622640 23050 tablet_bootstrap.cc:492] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:26.622941 23048 tablet_bootstrap.cc:492] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:26.623139 23050 ts_tablet_manager.cc:1403] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 13:21:26.626075 23050 raft_consensus.cc:359] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.626921 23050 raft_consensus.cc:385] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.627249 23050 raft_consensus.cc:740] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.629161 23048 tablet_bootstrap.cc:654] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.629817 23050 consensus_queue.cc:260] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.631978 23047 tablet_bootstrap.cc:654] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.636552 23050 ts_tablet_manager.cc:1434] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:21:26.637524 23050 tablet_bootstrap.cc:492] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
W20260709 13:21:26.638724 22964 consensus_peers.cc:597] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:26.645221 23050 tablet_bootstrap.cc:654] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.657496 23056 consensus_queue.cc:1048] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:26.660058 23047 tablet_bootstrap.cc:492] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:26.660564 23047 ts_tablet_manager.cc:1403] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.013s
I20260709 13:21:26.663098 23047 raft_consensus.cc:359] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.663751 23047 raft_consensus.cc:385] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.664021 23047 raft_consensus.cc:740] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.665915 23050 tablet_bootstrap.cc:492] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:26.666424 23050 ts_tablet_manager.cc:1403] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 13:21:26.666484 23047 consensus_queue.cc:260] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.668579 23191 raft_consensus.cc:493] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.669143 23191 raft_consensus.cc:515] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.671056 23046 tablet_bootstrap.cc:492] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:26.671500 23046 ts_tablet_manager.cc:1403] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 13:21:26.671693 23191 leader_election.cc:290] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:26.673624 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf330fe4b59c472a9c3bcb18161ff906" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:26.674110 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf330fe4b59c472a9c3bcb18161ff906" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:26.674186 23046 raft_consensus.cc:359] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.674998 22851 raft_consensus.cc:2468] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:26.675374 23046 raft_consensus.cc:385] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.675838 23046 raft_consensus.cc:740] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.674957 23191 raft_consensus.cc:493] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.676641 22741 leader_election.cc:304] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:26.676877 23046 consensus_queue.cc:260] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.676635 23191 raft_consensus.cc:515] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.678279 23084 raft_consensus.cc:2804] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:26.678670 23084 raft_consensus.cc:493] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.678985 23084 raft_consensus.cc:3060] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.681351 23191 leader_election.cc:290] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:26.682766 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:26.683279 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:26.685040 22924 raft_consensus.cc:3060] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:26.685201 22741 leader_election.cc:343] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.685885 23046 ts_tablet_manager.cc:1434] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:21:26.686458 23047 ts_tablet_manager.cc:1434] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:21:26.685925 23191 consensus_queue.cc:1048] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:26.688256 23046 tablet_bootstrap.cc:492] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:26.690318 23183 raft_consensus.cc:493] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.690784 23183 raft_consensus.cc:515] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.669185 23050 raft_consensus.cc:359] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.688665 23048 tablet_bootstrap.cc:492] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:26.683998 23001 raft_consensus.cc:2468] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:26.710531 23050 raft_consensus.cc:385] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.710928 23048 ts_tablet_manager.cc:1403] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.011s
I20260709 13:21:26.713478 23050 raft_consensus.cc:740] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.711208 23047 tablet_bootstrap.cc:492] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:26.714247 23050 consensus_queue.cc:260] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.718325 22926 raft_consensus.cc:2468] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:26.718755 23048 raft_consensus.cc:359] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.723666 23048 raft_consensus.cc:385] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.719899 23066 raft_consensus.cc:493] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:26.720547 22741 consensus_peers.cc:597] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:26.723027 23183 leader_election.cc:290] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:26.725271 23047 tablet_bootstrap.cc:654] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.724046 23048 raft_consensus.cc:740] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.730443 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:26.725152 23178 consensus_queue.cc:1048] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:21:26.737879 22741 leader_election.cc:304] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:26.738488 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:26.739403 23215 raft_consensus.cc:2804] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:26.739617 23001 raft_consensus.cc:2393] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 1: Already voted for candidate e9cee38bd2dd4b4e999490708cacd3a9 in this term.
I20260709 13:21:26.740042 23215 raft_consensus.cc:493] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.744377 23215 raft_consensus.cc:3060] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.749419 23050 ts_tablet_manager.cc:1434] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 13:21:26.750674 23050 tablet_bootstrap.cc:492] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:26.751904 23048 consensus_queue.cc:260] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.763202 23048 ts_tablet_manager.cc:1434] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:21:26.764204 23048 tablet_bootstrap.cc:492] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
W20260709 13:21:26.771970 22816 consensus_peers.cc:597] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:26.775844 23048 tablet_bootstrap.cc:654] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.776191 22926 raft_consensus.cc:3060] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.782037 22775 raft_consensus.cc:3060] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.783360 23050 tablet_bootstrap.cc:654] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.787858 23202 raft_consensus.cc:493] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.788573 23202 raft_consensus.cc:515] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.789444 23178 raft_consensus.cc:493] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.790107 23178 raft_consensus.cc:515] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.792974 23137 raft_consensus.cc:493] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.793648 23137 raft_consensus.cc:515] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.797323 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:26.797991 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:26.801122 22890 leader_election.cc:304] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:26.807753 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:26.809551 22964 leader_election.cc:343] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.811036 23178 leader_election.cc:290] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:26.812742 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:26.813060 22741 leader_election.cc:304] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:26.813987 23191 raft_consensus.cc:2749] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:26.814275 22964 leader_election.cc:343] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.814713 22964 leader_election.cc:304] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:26.817911 23178 raft_consensus.cc:2749] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:26.822403 23137 leader_election.cc:290] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:26.823717 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:26.824411 23001 raft_consensus.cc:2468] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:26.825695 22741 leader_election.cc:304] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:26.828297 23191 raft_consensus.cc:2804] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:26.828671 23191 raft_consensus.cc:493] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:26.828997 23191 raft_consensus.cc:3060] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.831794 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:26.833377 22741 leader_election.cc:343] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.833891 23084 raft_consensus.cc:515] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.831812 23202 leader_election.cc:290] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:26.837509 23191 raft_consensus.cc:515] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.727375 23066 raft_consensus.cc:515] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:26.841393 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
W20260709 13:21:26.843147 22741 leader_election.cc:343] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.846076 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:26.846268 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1fb76060d7483698646276d085257f" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:26.846872 23001 raft_consensus.cc:3060] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:26.848250 22964 leader_election.cc:343] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.849288 23066 leader_election.cc:290] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:26.850337 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1fb76060d7483698646276d085257f" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:26.852275 22964 leader_election.cc:343] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:26.852874 22964 leader_election.cc:304] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:26.855955 23056 raft_consensus.cc:493] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.856550 23191 leader_election.cc:290] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:26.856626 23056 raft_consensus.cc:515] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.859509 23183 raft_consensus.cc:493] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.861390 23122 consensus_queue.cc:1048] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:26.862700 23178 raft_consensus.cc:2749] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:26.884362 23084 leader_election.cc:290] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:26.886689 23183 raft_consensus.cc:515] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:26.889065 23183 leader_election.cc:290] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:26.863103 23001 raft_consensus.cc:2468] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:26.877784 23046 tablet_bootstrap.cc:654] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:26.895787 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf330fe4b59c472a9c3bcb18161ff906" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:26.896715 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf330fe4b59c472a9c3bcb18161ff906" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:26.897256 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:26.919598 22925 raft_consensus.cc:3060] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.921346 22850 raft_consensus.cc:3060] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.902598 23137 raft_consensus.cc:493] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:26.947829 23137 raft_consensus.cc:515] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:26.954311 22741 leader_election.cc:304] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:26.955243 23202 raft_consensus.cc:2804] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:26.955773 23202 raft_consensus.cc:697] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:26.956686 23202 consensus_queue.cc:237] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:26.985117 22923 raft_consensus.cc:3060] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.989864 23050 tablet_bootstrap.cc:492] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:26.990479 23050 ts_tablet_manager.cc:1403] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.240s	user 0.022s	sys 0.028s
I20260709 13:21:26.991477 23047 tablet_bootstrap.cc:492] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:27.002461 23050 raft_consensus.cc:359] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:27.003157 23050 raft_consensus.cc:385] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.003425 23050 raft_consensus.cc:740] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:26.994380 23123 raft_consensus.cc:2749] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.006983 23191 consensus_queue.cc:1048] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:27.007900 23048 tablet_bootstrap.cc:492] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:26.997162 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e4bbf8e1a12402f8ecefd83160f4672" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:27.008591 23048 ts_tablet_manager.cc:1403] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.245s	user 0.022s	sys 0.012s
I20260709 13:21:27.008386 23191 consensus_queue.cc:1048] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:26.997784 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:27.009559 23001 raft_consensus.cc:2468] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:26.999254 22778 raft_consensus.cc:3060] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:26.951495 23137 leader_election.cc:290] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:27.003611 23047 ts_tablet_manager.cc:1403] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.294s	user 0.027s	sys 0.050s
I20260709 13:21:27.012630 22850 raft_consensus.cc:2468] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:27.005180 23056 leader_election.cc:290] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:27.013002 23047 raft_consensus.cc:359] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.014007 23047 raft_consensus.cc:385] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:26.993307 23215 raft_consensus.cc:515] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.014299 23047 raft_consensus.cc:740] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.015654 23047 consensus_queue.cc:260] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.014168 23050 consensus_queue.cc:260] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:27.030217 23047 ts_tablet_manager.cc:1434] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:21:27.032477 23050 ts_tablet_manager.cc:1434] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:21:27.033634 23050 tablet_bootstrap.cc:492] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:27.041323 23048 raft_consensus.cc:359] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.047257 23048 raft_consensus.cc:385] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.048795 23047 tablet_bootstrap.cc:492] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:27.047523 23048 raft_consensus.cc:740] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.048203 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:27.054786 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:27.054662 22816 leader_election.cc:304] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:27.049954 23048 consensus_queue.cc:260] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.071662 22775 raft_consensus.cc:2393] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 1: Already voted for candidate e9cee38bd2dd4b4e999490708cacd3a9 in this term.
I20260709 13:21:27.055984 23215 leader_election.cc:290] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:27.067615 22925 raft_consensus.cc:2468] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:27.074246 23255 raft_consensus.cc:2804] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.093321 23122 raft_consensus.cc:493] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.098366 23122 raft_consensus.cc:515] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.100966 23122 leader_election.cc:290] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:27.094924 23255 raft_consensus.cc:493] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.104408 23255 raft_consensus.cc:3060] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.104224 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea82caef4f4f439c84611d5e6a9c10df" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:27.106151 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:27.106804 23000 raft_consensus.cc:3060] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.113379 22741 leader_election.cc:304] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:27.114400 23191 raft_consensus.cc:2804] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.114843 23191 raft_consensus.cc:697] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:27.115046 22890 leader_election.cc:304] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
W20260709 13:21:27.115454 22816 leader_election.cc:343] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.115715 23191 consensus_queue.cc:237] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.116947 23123 raft_consensus.cc:2749] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.115049 23254 consensus_queue.cc:1048] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:21:27.120141 23254 raft_consensus.cc:493] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.120590 23254 raft_consensus.cc:515] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.121236 23048 ts_tablet_manager.cc:1434] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.112s	user 0.008s	sys 0.001s
I20260709 13:21:27.122746 23048 tablet_bootstrap.cc:492] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:27.145648 23050 tablet_bootstrap.cc:654] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.143788 23053 raft_consensus.cc:493] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.165889 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e4bbf8e1a12402f8ecefd83160f4672" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:27.168165 23254 leader_election.cc:290] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:27.169546 22741 leader_election.cc:304] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:27.170281 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:27.175029 23000 raft_consensus.cc:2468] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:27.176469 23048 tablet_bootstrap.cc:654] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.176911 23255 raft_consensus.cc:515] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.164531 23053 raft_consensus.cc:515] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:27.182538 23053 leader_election.cc:290] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:27.183063 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:27.183354 22776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:27.184121 22776 raft_consensus.cc:2393] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 1: Already voted for candidate e9cee38bd2dd4b4e999490708cacd3a9 in this term.
W20260709 13:21:27.184535 22964 leader_election.cc:343] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.186048 22850 raft_consensus.cc:2393] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e9cee38bd2dd4b4e999490708cacd3a9 in current term 1: Already voted for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in this term.
I20260709 13:21:27.188745 22776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:27.190932 23047 tablet_bootstrap.cc:654] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:27.191643 22966 leader_election.cc:343] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.192169 22966 leader_election.cc:304] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
W20260709 13:21:27.195585 22723 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:27.198429 22996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea82caef4f4f439c84611d5e6a9c10df" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:27.198971 22996 raft_consensus.cc:2468] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:27.200372 23255 leader_election.cc:290] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:27.200906 23046 tablet_bootstrap.cc:492] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:27.201426 23046 ts_tablet_manager.cc:1403] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.513s	user 0.022s	sys 0.013s
I20260709 13:21:27.202500 22741 leader_election.cc:304] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
W20260709 13:21:27.163758 22816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:44325, user_credentials={real_user=slave}} blocked reactor thread for 47478.8us
I20260709 13:21:27.215862 23046 raft_consensus.cc:359] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.217237 23046 raft_consensus.cc:385] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.217589 23046 raft_consensus.cc:740] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.204276 23053 raft_consensus.cc:2749] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.216050 23137 raft_consensus.cc:2804] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.228890 23046 consensus_queue.cc:260] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.236158 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988592b5b572476ea8821180ae41bcda" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:27.232445 23137 raft_consensus.cc:697] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:27.242321 22816 leader_election.cc:304] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:27.242645 23137 consensus_queue.cc:237] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.243187 23254 raft_consensus.cc:2804] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.243639 23254 raft_consensus.cc:493] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.244082 23254 raft_consensus.cc:3060] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.249222 22996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:27.250083 22996 raft_consensus.cc:2393] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 1: Already voted for candidate e9cee38bd2dd4b4e999490708cacd3a9 in this term.
I20260709 13:21:27.251546 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988592b5b572476ea8821180ae41bcda" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:27.252179 23000 raft_consensus.cc:2468] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:27.271579 23046 ts_tablet_manager.cc:1434] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.002s
I20260709 13:21:27.276218 23046 tablet_bootstrap.cc:492] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:27.255178 23191 raft_consensus.cc:2749] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:27.286475 23272 raft_consensus.cc:493] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.286991 23272 raft_consensus.cc:515] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.288810 23254 raft_consensus.cc:515] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.293351 23254 leader_election.cc:290] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:27.294505 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:27.294845 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:27.295439 22852 raft_consensus.cc:2468] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:27.299228 23048 tablet_bootstrap.cc:492] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:27.306428 23048 ts_tablet_manager.cc:1403] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.184s	user 0.024s	sys 0.006s
I20260709 13:21:27.289142 23272 leader_election.cc:290] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
W20260709 13:21:27.311663 22741 leader_election.cc:343] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.317149 23048 raft_consensus.cc:359] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.318317 23046 tablet_bootstrap.cc:654] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.319032 23048 raft_consensus.cc:385] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.319521 23048 raft_consensus.cc:740] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.318343 22741 leader_election.cc:304] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:27.320360 23048 consensus_queue.cc:260] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.321084 23272 raft_consensus.cc:2804] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.324059 23048 ts_tablet_manager.cc:1434] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:21:27.324368 23047 tablet_bootstrap.cc:492] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:27.325064 23047 ts_tablet_manager.cc:1403] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.280s	user 0.020s	sys 0.016s
I20260709 13:21:27.322369 23272 raft_consensus.cc:493] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.326033 23272 raft_consensus.cc:3060] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.326184 23048 tablet_bootstrap.cc:492] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:27.327859 23047 raft_consensus.cc:359] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.328572 23047 raft_consensus.cc:385] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.328848 23047 raft_consensus.cc:740] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.329514 23047 consensus_queue.cc:260] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.332095 23047 ts_tablet_manager.cc:1434] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:27.333042 23047 tablet_bootstrap.cc:492] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:27.332525 22671 catalog_manager.cc:5697] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:27.333467 23048 tablet_bootstrap.cc:654] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.335145 22671 catalog_manager.cc:5697] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:27.337077 22671 catalog_manager.cc:5697] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:27.338732 23050 tablet_bootstrap.cc:492] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:27.339244 23050 ts_tablet_manager.cc:1403] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.306s	user 0.013s	sys 0.007s
I20260709 13:21:27.341878 23050 raft_consensus.cc:359] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.345757 23050 raft_consensus.cc:385] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.348377 23050 raft_consensus.cc:740] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.344213 23047 tablet_bootstrap.cc:654] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:27.342959 22816 leader_election.cc:343] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.350039 22816 leader_election.cc:304] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:27.351284 22816 leader_election.cc:304] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:27.351819 23046 tablet_bootstrap.cc:492] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:27.352162 23276 raft_consensus.cc:2749] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.353119 23276 raft_consensus.cc:2804] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.353562 23276 raft_consensus.cc:493] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.353947 23276 raft_consensus.cc:3060] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.354851 23050 consensus_queue.cc:260] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.358261 23048 tablet_bootstrap.cc:492] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:27.359453 23048 ts_tablet_manager.cc:1403] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.000s
I20260709 13:21:27.361616 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea82caef4f4f439c84611d5e6a9c10df" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:27.362828 23048 raft_consensus.cc:359] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.363587 23048 raft_consensus.cc:385] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.363888 23048 raft_consensus.cc:740] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.364606 23048 consensus_queue.cc:260] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.365212 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea82caef4f4f439c84611d5e6a9c10df" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:27.365862 23001 raft_consensus.cc:3060] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.367358 23048 ts_tablet_manager.cc:1434] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:27.333847 23272 raft_consensus.cc:515] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.368628 23048 tablet_bootstrap.cc:492] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:27.369417 23272 leader_election.cc:290] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:27.365065 23276 raft_consensus.cc:515] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.370476 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:27.371071 22850 raft_consensus.cc:3060] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.371380 23276 leader_election.cc:290] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:27.352337 23046 ts_tablet_manager.cc:1403] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.006s
I20260709 13:21:27.374430 23046 raft_consensus.cc:359] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.375066 23046 raft_consensus.cc:385] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.375340 23046 raft_consensus.cc:740] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.376209 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988592b5b572476ea8821180ae41bcda" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:27.376536 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:27.375960 23046 consensus_queue.cc:260] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
W20260709 13:21:27.378320 22741 leader_election.cc:343] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.379144 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988592b5b572476ea8821180ae41bcda" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
W20260709 13:21:27.379175 22816 leader_election.cc:343] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.379774 22999 raft_consensus.cc:3060] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.380703 23046 ts_tablet_manager.cc:1434] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:27.381366 23001 raft_consensus.cc:2468] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:27.381691 23046 tablet_bootstrap.cc:492] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:27.383656 23050 ts_tablet_manager.cc:1434] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:21:27.383893 22850 raft_consensus.cc:2468] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:27.384752 23050 tablet_bootstrap.cc:492] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:27.385115 22741 leader_election.cc:304] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:27.386286 23272 raft_consensus.cc:2804] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:21:27.380760 22816 leader_election.cc:343] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.386708 22999 raft_consensus.cc:2468] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:27.386897 23272 raft_consensus.cc:697] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:27.387872 23272 consensus_queue.cc:237] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.388471 22816 leader_election.cc:304] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:27.389817 22816 leader_election.cc:304] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:27.390547 23276 raft_consensus.cc:2804] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.391975 23122 raft_consensus.cc:2804] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.392366 23276 raft_consensus.cc:697] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:27.392508 23122 raft_consensus.cc:697] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:27.393402 23047 tablet_bootstrap.cc:492] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:27.393215 23276 consensus_queue.cc:237] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.393879 23047 ts_tablet_manager.cc:1403] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.000s
I20260709 13:21:27.393476 23122 consensus_queue.cc:237] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.396668 23047 raft_consensus.cc:359] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:27.397409 23047 raft_consensus.cc:385] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.397675 23047 raft_consensus.cc:740] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.397868 23048 tablet_bootstrap.cc:654] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.401842 22924 raft_consensus.cc:3060] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.409044 23048 tablet_bootstrap.cc:492] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:27.409545 23048 ts_tablet_manager.cc:1403] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.001s
I20260709 13:21:27.409049 23050 tablet_bootstrap.cc:654] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.411163 23084 consensus_queue.cc:1048] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:27.415596 23046 tablet_bootstrap.cc:654] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.412226 23047 consensus_queue.cc:260] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:27.412518 23048 raft_consensus.cc:359] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.417330 23048 raft_consensus.cc:385] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.417618 23048 raft_consensus.cc:740] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.418325 23048 consensus_queue.cc:260] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.418872 23047 ts_tablet_manager.cc:1434] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:21:27.419835 23047 tablet_bootstrap.cc:492] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:27.420439 23048 ts_tablet_manager.cc:1434] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:21:27.421324 23048 tablet_bootstrap.cc:492] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:27.425402 23047 tablet_bootstrap.cc:654] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.427624 23048 tablet_bootstrap.cc:654] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.436650 23050 tablet_bootstrap.cc:492] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:27.436857 23122 raft_consensus.cc:493] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.437245 23050 ts_tablet_manager.cc:1403] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.000s
I20260709 13:21:27.437503 23122 raft_consensus.cc:515] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.440455 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1fb76060d7483698646276d085257f" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:27.444602 23122 leader_election.cc:290] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:27.446884 22675 catalog_manager.cc:5697] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:27.469537 22816 leader_election.cc:343] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.469375 23050 raft_consensus.cc:359] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:27.470166 23050 raft_consensus.cc:385] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.470469 23050 raft_consensus.cc:740] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.470912 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1fb76060d7483698646276d085257f" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:27.471553 22999 raft_consensus.cc:2468] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:27.472568 23047 tablet_bootstrap.cc:492] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:27.473052 23047 ts_tablet_manager.cc:1403] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.000s
I20260709 13:21:27.473160 22816 leader_election.cc:304] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:27.474303 23122 raft_consensus.cc:2804] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.474653 23122 raft_consensus.cc:493] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.475010 23122 raft_consensus.cc:3060] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.477041 23046 tablet_bootstrap.cc:492] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:27.477521 23046 ts_tablet_manager.cc:1403] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.007s
I20260709 13:21:27.477770 23048 tablet_bootstrap.cc:492] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:27.478235 23048 ts_tablet_manager.cc:1403] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.005s
I20260709 13:21:27.480783 23048 raft_consensus.cc:359] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.481505 23048 raft_consensus.cc:385] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.481277 23050 consensus_queue.cc:260] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:27.481796 23048 raft_consensus.cc:740] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.482470 23048 consensus_queue.cc:260] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.483436 23050 ts_tablet_manager.cc:1434] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:21:27.485229 23050 tablet_bootstrap.cc:492] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:27.485103 23122 raft_consensus.cc:515] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.483930 23047 raft_consensus.cc:359] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.485883 23047 raft_consensus.cc:385] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.486196 23047 raft_consensus.cc:740] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.480278 23046 raft_consensus.cc:359] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.493902 23046 raft_consensus.cc:385] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.494227 23046 raft_consensus.cc:740] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.494861 23046 consensus_queue.cc:260] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.488793 23048 ts_tablet_manager.cc:1434] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:21:27.506145 23048 tablet_bootstrap.cc:492] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:27.506564 23272 raft_consensus.cc:493] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.507072 23272 raft_consensus.cc:515] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:27.491645 23047 consensus_queue.cc:260] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.509087 23272 leader_election.cc:290] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:27.509284 23047 ts_tablet_manager.cc:1434] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:21:27.510282 23047 tablet_bootstrap.cc:492] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:27.511471 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:27.512903 22741 leader_election.cc:343] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.514159 23048 tablet_bootstrap.cc:654] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.515558 23046 ts_tablet_manager.cc:1434] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:21:27.517341 23276 raft_consensus.cc:493] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.517616 23046 tablet_bootstrap.cc:492] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:27.517733 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1fb76060d7483698646276d085257f" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:27.517845 23276 raft_consensus.cc:515] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
W20260709 13:21:27.519107 22816 leader_election.cc:343] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.519974 23276 leader_election.cc:290] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:27.521414 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaa4be81c4a4ce6bc080164640cab8a" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:27.522734 22818 leader_election.cc:343] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.527725 23122 leader_election.cc:290] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:27.528285 23047 tablet_bootstrap.cc:654] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.533169 23048 tablet_bootstrap.cc:492] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:27.533604 23048 ts_tablet_manager.cc:1403] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.006s
I20260709 13:21:27.536242 23048 raft_consensus.cc:359] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.536897 23048 raft_consensus.cc:385] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.537155 23048 raft_consensus.cc:740] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.537753 23048 consensus_queue.cc:260] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.540050 23048 ts_tablet_manager.cc:1434] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:21:27.540082 23047 tablet_bootstrap.cc:492] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:27.540647 23047 ts_tablet_manager.cc:1403] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.001s
I20260709 13:21:27.541038 23048 tablet_bootstrap.cc:492] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:27.543063 23047 raft_consensus.cc:359] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.543711 23047 raft_consensus.cc:385] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.543982 23047 raft_consensus.cc:740] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.544772 23047 consensus_queue.cc:260] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.545917 23122 raft_consensus.cc:493] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.546409 23122 raft_consensus.cc:515] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.547201 23048 tablet_bootstrap.cc:654] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.547964 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:27.548521 23122 leader_election.cc:290] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:27.548667 22999 raft_consensus.cc:2468] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:27.547825 22675 catalog_manager.cc:5697] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:27.553138 23191 consensus_queue.cc:1048] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:27.493737 23050 tablet_bootstrap.cc:654] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.550220 22675 catalog_manager.cc:5697] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:27.560346 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33209c9cbc0949fb933224b7cb5dce53" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:27.561196 23048 tablet_bootstrap.cc:492] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:27.561658 23048 ts_tablet_manager.cc:1403] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.002s
W20260709 13:21:27.561759 22818 leader_election.cc:343] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.562901 22741 leader_election.cc:304] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:27.563655 23047 ts_tablet_manager.cc:1434] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:21:27.564030 23084 raft_consensus.cc:2804] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.564431 23084 raft_consensus.cc:493] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.564589 23047 tablet_bootstrap.cc:492] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:27.564879 23084 raft_consensus.cc:3060] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.564483 23048 raft_consensus.cc:359] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.566000 23048 raft_consensus.cc:385] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.566267 23048 raft_consensus.cc:740] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.567232 23048 consensus_queue.cc:260] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.569563 23048 ts_tablet_manager.cc:1434] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:27.570433 23048 tablet_bootstrap.cc:492] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:27.570662 23047 tablet_bootstrap.cc:654] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.573351 22926 raft_consensus.cc:3060] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.575942 23048 tablet_bootstrap.cc:654] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.592751 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaa4be81c4a4ce6bc080164640cab8a" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:27.593583 22999 raft_consensus.cc:2468] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:27.609339 23272 consensus_queue.cc:1048] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:27.610266 23122 raft_consensus.cc:493] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.610781 23122 raft_consensus.cc:515] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.612529 23272 raft_consensus.cc:493] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.612900 23122 leader_election.cc:290] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:27.613035 23272 raft_consensus.cc:515] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.614902 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:27.615180 23272 leader_election.cc:290] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:27.616794 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:27.618366 22816 leader_election.cc:343] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.620144 22923 raft_consensus.cc:3060] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:27.621946 22741 leader_election.cc:343] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.628669 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1fb76060d7483698646276d085257f" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:27.629249 22999 raft_consensus.cc:3060] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.632162 23047 tablet_bootstrap.cc:492] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:27.632743 23047 ts_tablet_manager.cc:1403] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.068s	user 0.028s	sys 0.039s
I20260709 13:21:27.636072 23047 raft_consensus.cc:359] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.636504 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33209c9cbc0949fb933224b7cb5dce53" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:27.636806 23047 raft_consensus.cc:385] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.637183 23001 raft_consensus.cc:2468] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:27.637205 23047 raft_consensus.cc:740] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.639159 23047 consensus_queue.cc:260] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.640905 23047 ts_tablet_manager.cc:1434] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:27.641728 23047 tablet_bootstrap.cc:492] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:27.641441 22996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:27.642308 22996 raft_consensus.cc:2468] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:27.643569 22816 leader_election.cc:304] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:27.644783 23122 raft_consensus.cc:2804] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.645138 23122 raft_consensus.cc:493] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.645466 23122 raft_consensus.cc:3060] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.654170 23202 consensus_queue.cc:1048] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:27.655099 23122 raft_consensus.cc:515] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.658511 23272 raft_consensus.cc:493] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.658993 23272 raft_consensus.cc:515] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.661497 23272 leader_election.cc:290] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:27.661974 23047 tablet_bootstrap.cc:654] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.663092 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e393b9cf9a849f4ad63eea1da23ea42" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:27.663771 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e393b9cf9a849f4ad63eea1da23ea42" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:27.666810 23046 tablet_bootstrap.cc:654] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.668949 23050 tablet_bootstrap.cc:492] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:27.673043 23050 ts_tablet_manager.cc:1403] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.188s	user 0.011s	sys 0.000s
I20260709 13:21:27.667524 23084 raft_consensus.cc:515] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:27.667368 22816 leader_election.cc:304] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:27.676311 23276 raft_consensus.cc:2804] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.676662 23276 raft_consensus.cc:493] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.676843 23122 leader_election.cc:290] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:27.677011 23276 raft_consensus.cc:3060] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.678612 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaa4be81c4a4ce6bc080164640cab8a" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:27.679265 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
W20260709 13:21:27.682104 22818 leader_election.cc:343] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.687661 23081 raft_consensus.cc:493] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:27.688251 23081 raft_consensus.cc:515] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:27.696708 23081 leader_election.cc:290] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:27.698359 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:27.668459 22741 leader_election.cc:343] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.701650 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:27.704597 22890 leader_election.cc:304] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:27.706578 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaa4be81c4a4ce6bc080164640cab8a" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:27.707368 23000 raft_consensus.cc:3060] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.704671 22816 leader_election.cc:304] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:27.708345 23123 raft_consensus.cc:2749] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:27.708344 23122 raft_consensus.cc:2804] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:27.716598 23122 raft_consensus.cc:493] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:27.717036 23122 raft_consensus.cc:3060] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:27.717561 22741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:34985, user_credentials={real_user=slave}} blocked reactor thread for 49170.9us
W20260709 13:21:27.718473 22741 leader_election.cc:343] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.719031 22741 leader_election.cc:304] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:27.726758 23202 raft_consensus.cc:2749] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.729818 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:27.750206 23050 raft_consensus.cc:359] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.754042 23050 raft_consensus.cc:385] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.746842 23276 raft_consensus.cc:515] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.755074 23050 raft_consensus.cc:740] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.759824 23050 consensus_queue.cc:260] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.766301 23047 tablet_bootstrap.cc:492] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:27.766830 23047 ts_tablet_manager.cc:1403] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.125s	user 0.007s	sys 0.009s
I20260709 13:21:27.767349 23000 raft_consensus.cc:2468] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:27.770535 23276 leader_election.cc:290] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:27.774441 23050 ts_tablet_manager.cc:1434] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.000s
I20260709 13:21:27.778712 23050 tablet_bootstrap.cc:492] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:27.775084 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33209c9cbc0949fb933224b7cb5dce53" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:27.775117 22816 leader_election.cc:304] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:27.773294 23084 leader_election.cc:290] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
W20260709 13:21:27.773430 22741 leader_election.cc:343] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.784737 23047 raft_consensus.cc:359] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.785429 23047 raft_consensus.cc:385] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.785720 23047 raft_consensus.cc:740] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.791415 23047 consensus_queue.cc:260] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.792081 23048 tablet_bootstrap.cc:492] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:27.783179 22999 raft_consensus.cc:2468] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:27.792565 23048 ts_tablet_manager.cc:1403] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.222s	user 0.035s	sys 0.065s
I20260709 13:21:27.793041 23046 tablet_bootstrap.cc:492] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:27.787058 22741 leader_election.cc:304] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:27.787403 23276 raft_consensus.cc:2804] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.795032 23046 ts_tablet_manager.cc:1403] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.279s	user 0.040s	sys 0.032s
I20260709 13:21:27.796087 23047 ts_tablet_manager.cc:1434] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
W20260709 13:21:27.786746 22818 leader_election.cc:343] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.802870 23047 tablet_bootstrap.cc:492] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:27.802742 23276 raft_consensus.cc:697] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:27.812100 22816 leader_election.cc:304] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:27.812343 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33209c9cbc0949fb933224b7cb5dce53" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:27.812951 23266 raft_consensus.cc:2804] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.813004 23001 raft_consensus.cc:3060] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.813539 23266 raft_consensus.cc:697] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:27.814589 23047 tablet_bootstrap.cc:654] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.814384 23266 consensus_queue.cc:237] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.818113 23122 raft_consensus.cc:515] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.820179 23122 leader_election.cc:290] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:27.806497 23272 raft_consensus.cc:2749] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:27.821220 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:27.837571 22997 raft_consensus.cc:3060] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:27.839311 22816 consensus_peers.cc:597] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:27.833971 23001 raft_consensus.cc:2468] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:27.836516 23048 raft_consensus.cc:359] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.842088 23048 raft_consensus.cc:385] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.842645 23048 raft_consensus.cc:740] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.824379 23276 consensus_queue.cc:237] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.844380 23277 raft_consensus.cc:493] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.830997 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:27.844887 23277 raft_consensus.cc:515] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:27.846668 22816 leader_election.cc:343] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:27.841272 23302 log.cc:927] Time spent T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:21:27.848402 23277 leader_election.cc:290] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:27.848677 22816 leader_election.cc:304] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:27.843310 23048 consensus_queue.cc:260] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
W20260709 13:21:27.857589 23305 log.cc:927] Time spent T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:21:27.852768 23277 raft_consensus.cc:2804] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.865813 22996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:27.866423 22996 raft_consensus.cc:3060] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:27.868629 23102 raft_consensus.cc:493] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.868714 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9928bc913a6d4447b83c59ac19cbcf25" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:27.869225 23102 raft_consensus.cc:515] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.869570 22777 raft_consensus.cc:2468] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:27.856458 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9928bc913a6d4447b83c59ac19cbcf25" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:27.872659 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:27.873379 23084 raft_consensus.cc:493] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.873909 23102 leader_election.cc:290] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
W20260709 13:21:27.874110 22964 leader_election.cc:343] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.873834 23084 raft_consensus.cc:515] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.874508 23046 raft_consensus.cc:359] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.875463 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:27.876271 23084 leader_election.cc:290] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
W20260709 13:21:27.876995 22966 leader_election.cc:343] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.877496 22966 leader_election.cc:304] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:27.877714 22996 raft_consensus.cc:2468] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:27.878660 23102 raft_consensus.cc:2749] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:27.881234 22741 leader_election.cc:343] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:27.886966 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaa4be81c4a4ce6bc080164640cab8a" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:27.886075 22997 raft_consensus.cc:2468] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:27.889572 23047 tablet_bootstrap.cc:492] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:27.890084 23047 ts_tablet_manager.cc:1403] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.023s
I20260709 13:21:27.890560 23048 ts_tablet_manager.cc:1434] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260709 13:21:27.891480 23048 tablet_bootstrap.cc:492] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:27.888599 22996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaa4be81c4a4ce6bc080164640cab8a" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:27.875180 23046 raft_consensus.cc:385] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.898552 23046 raft_consensus.cc:740] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.899626 23046 consensus_queue.cc:260] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.909636 22996 raft_consensus.cc:2393] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e9cee38bd2dd4b4e999490708cacd3a9 in current term 1: Already voted for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in this term.
I20260709 13:21:27.910892 23047 raft_consensus.cc:359] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.911633 23047 raft_consensus.cc:385] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:27.911943 23047 raft_consensus.cc:740] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:27.912177 23046 ts_tablet_manager.cc:1434] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.115s	user 0.007s	sys 0.001s
I20260709 13:21:27.912672 23047 consensus_queue.cc:260] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.913599 23277 raft_consensus.cc:697] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:27.918849 23047 ts_tablet_manager.cc:1434] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.007s
I20260709 13:21:27.920193 23202 consensus_queue.cc:1048] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:27.923348 22741 leader_election.cc:304] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:27.931440 23084 raft_consensus.cc:2804] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:27.932070 23084 raft_consensus.cc:697] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:27.933125 23084 consensus_queue.cc:237] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:27.936457 23047 tablet_bootstrap.cc:492] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:27.937274 23046 tablet_bootstrap.cc:492] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:27.938834 23050 tablet_bootstrap.cc:654] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.914862 23277 consensus_queue.cc:237] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.955255 22672 catalog_manager.cc:5697] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:27.956684 23202 raft_consensus.cc:493] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.957429 23202 raft_consensus.cc:515] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:27.959703 23202 leader_election.cc:290] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:27.963341 23191 consensus_queue.cc:1048] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:27.965682 22741 leader_election.cc:304] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:27.955856 23046 tablet_bootstrap.cc:654] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.959659 23047 tablet_bootstrap.cc:654] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.983883 23309 raft_consensus.cc:493] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.986343 23048 tablet_bootstrap.cc:654] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:27.984526 23309 raft_consensus.cc:515] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:27.985623 23191 raft_consensus.cc:3060] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:27.994093 22741 consensus_peers.cc:597] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:27.989161 23307 raft_consensus.cc:493] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:27.998565 22672 catalog_manager.cc:5697] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:27.999986 22672 catalog_manager.cc:5697] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:27.993536 22816 leader_election.cc:304] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:28.002063 23122 raft_consensus.cc:2804] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.003432 23122 raft_consensus.cc:697] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:28.004350 23122 consensus_queue.cc:237] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:28.005126 23307 raft_consensus.cc:515] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.006371 22674 catalog_manager.cc:5697] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:28.007937 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:28.010174 23001 raft_consensus.cc:2468] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:28.008219 23311 consensus_queue.cc:1048] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:28.008695 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:27.989341 22818 leader_election.cc:304] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:28.012661 23311 raft_consensus.cc:2804] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.013099 23311 raft_consensus.cc:493] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.013453 23311 raft_consensus.cc:3060] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.014765 22741 leader_election.cc:304] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:28.015121 23309 leader_election.cc:290] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
W20260709 13:21:28.015748 22816 leader_election.cc:343] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.016003 23202 raft_consensus.cc:2804] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.007556 23307 leader_election.cc:290] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:28.016516 23202 raft_consensus.cc:493] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.016948 23202 raft_consensus.cc:3060] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.016770 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:28.018380 22818 leader_election.cc:343] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:28.020426 22741 leader_election.cc:343] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.022087 23084 consensus_queue.cc:1048] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:28.032321 23202 raft_consensus.cc:515] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.035115 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:28.035724 23001 raft_consensus.cc:3060] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.041288 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:28.041585 23084 raft_consensus.cc:493] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.042057 23084 raft_consensus.cc:515] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.052448 23191 raft_consensus.cc:2749] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:28.077970 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8427d8842704b1e8a7d20c6a4baf90f" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:28.091034 23048 tablet_bootstrap.cc:492] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:28.091629 23048 ts_tablet_manager.cc:1403] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.200s	user 0.016s	sys 0.000s
I20260709 13:21:28.092535 23081 raft_consensus.cc:493] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.093042 23081 raft_consensus.cc:515] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:28.095008 23081 leader_election.cc:290] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:28.103016 23048 raft_consensus.cc:359] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.103410 23311 raft_consensus.cc:515] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.103852 23048 raft_consensus.cc:385] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.104189 23048 raft_consensus.cc:740] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.104918 23048 consensus_queue.cc:260] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.105266 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8427d8842704b1e8a7d20c6a4baf90f" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:28.105576 23311 leader_election.cc:290] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:28.104293 23047 tablet_bootstrap.cc:492] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:28.107506 23048 ts_tablet_manager.cc:1434] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:21:28.109385 23046 tablet_bootstrap.cc:492] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:28.109767 23048 tablet_bootstrap.cc:492] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:28.109927 23046 ts_tablet_manager.cc:1403] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.173s	user 0.006s	sys 0.015s
I20260709 13:21:28.110149 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9928bc913a6d4447b83c59ac19cbcf25" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:28.110750 22777 raft_consensus.cc:3060] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.111619 23047 ts_tablet_manager.cc:1403] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.175s	user 0.012s	sys 0.005s
I20260709 13:21:28.116474 22923 raft_consensus.cc:3060] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.117688 23050 tablet_bootstrap.cc:492] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:28.118170 23050 ts_tablet_manager.cc:1403] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.340s	user 0.009s	sys 0.009s
I20260709 13:21:28.121145 23050 raft_consensus.cc:359] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.121876 23050 raft_consensus.cc:385] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.122131 23050 raft_consensus.cc:740] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.122754 23050 consensus_queue.cc:260] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.124717 23050 ts_tablet_manager.cc:1434] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:21:28.125272 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9928bc913a6d4447b83c59ac19cbcf25" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:28.125597 23050 tablet_bootstrap.cc:492] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:28.134359 23047 raft_consensus.cc:359] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.135366 23047 raft_consensus.cc:385] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.135730 23047 raft_consensus.cc:740] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.136525 23047 consensus_queue.cc:260] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:28.138912 22816 leader_election.cc:343] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.141731 23050 tablet_bootstrap.cc:654] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.142566 23046 raft_consensus.cc:359] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.143498 23046 raft_consensus.cc:385] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.144104 23311 consensus_queue.cc:1048] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:28.107583 23001 raft_consensus.cc:2468] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:28.099025 23202 leader_election.cc:290] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:28.148051 23046 raft_consensus.cc:740] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.150214 23046 consensus_queue.cc:260] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:28.145164 22816 leader_election.cc:343] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.152110 22816 leader_election.cc:304] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:28.152469 23084 leader_election.cc:290] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:28.149011 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:28.153919 23311 raft_consensus.cc:2749] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:28.155333 22816 leader_election.cc:343] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.161504 22777 raft_consensus.cc:2468] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:28.165521 22816 leader_election.cc:304] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:28.166772 23311 raft_consensus.cc:2749] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:28.156347 23047 ts_tablet_manager.cc:1434] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:21:28.163792 23048 tablet_bootstrap.cc:654] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.167165 22818 leader_election.cc:304] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:28.157100 23046 ts_tablet_manager.cc:1434] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.000s
I20260709 13:21:28.168048 23311 raft_consensus.cc:2804] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.168488 23046 tablet_bootstrap.cc:492] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:28.168630 23311 raft_consensus.cc:697] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:28.169878 23311 consensus_queue.cc:237] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:28.176405 22816 leader_election.cc:343] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.176995 22673 catalog_manager.cc:5697] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:28.185505 23122 consensus_queue.cc:1048] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:28.186199 23047 tablet_bootstrap.cc:492] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:28.185436 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea82caef4f4f439c84611d5e6a9c10df" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:28.189239 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea82caef4f4f439c84611d5e6a9c10df" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:28.194298 23047 tablet_bootstrap.cc:654] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.195603 22890 leader_election.cc:304] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:28.197553 23081 raft_consensus.cc:2749] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:28.202553 22741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:43687, user_credentials={real_user=slave}} blocked reactor thread for 68191.1us
I20260709 13:21:28.204229 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c5e4b2a4d642ef918c312a6ab1b808" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:28.210131 23046 tablet_bootstrap.cc:654] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.211580 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c5e4b2a4d642ef918c312a6ab1b808" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:28.213201 22741 leader_election.cc:304] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:28.214076 23327 raft_consensus.cc:2804] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.214530 23327 raft_consensus.cc:697] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:28.215437 23327 consensus_queue.cc:237] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.217386 23050 tablet_bootstrap.cc:492] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:28.217852 23050 ts_tablet_manager.cc:1403] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.004s
I20260709 13:21:28.220480 23050 raft_consensus.cc:359] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:28.221119 23050 raft_consensus.cc:385] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.221391 23050 raft_consensus.cc:740] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
W20260709 13:21:28.221698 22741 leader_election.cc:343] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.222015 23050 consensus_queue.cc:260] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
W20260709 13:21:28.222858 22741 leader_election.cc:343] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:28.224339 22741 leader_election.cc:343] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.224742 22741 leader_election.cc:304] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:28.229343 23048 tablet_bootstrap.cc:492] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:28.229841 23048 ts_tablet_manager.cc:1403] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.120s	user 0.005s	sys 0.005s
I20260709 13:21:28.229924 23191 raft_consensus.cc:2749] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:28.232775 23048 raft_consensus.cc:359] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:28.233429 23048 raft_consensus.cc:385] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.233693 23048 raft_consensus.cc:740] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.234308 23048 consensus_queue.cc:260] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:28.236035 23050 ts_tablet_manager.cc:1434] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:21:28.237103 23050 tablet_bootstrap.cc:492] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:28.248452 23122 raft_consensus.cc:493] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.249250 23122 raft_consensus.cc:515] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.252348 23122 leader_election.cc:290] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:28.252943 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c48bfd3488f4ab8b00547a92e0eb843" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:28.254863 23047 tablet_bootstrap.cc:492] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:28.255352 23047 ts_tablet_manager.cc:1403] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.004s
I20260709 13:21:28.253002 23048 ts_tablet_manager.cc:1434] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:21:28.257129 23048 tablet_bootstrap.cc:492] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
W20260709 13:21:28.258026 22818 leader_election.cc:343] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.258852 23046 tablet_bootstrap.cc:492] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:28.259327 23046 ts_tablet_manager.cc:1403] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.005s
I20260709 13:21:28.258013 23047 raft_consensus.cc:359] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.259793 23047 raft_consensus.cc:385] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.260113 23047 raft_consensus.cc:740] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.261206 23047 consensus_queue.cc:260] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.263468 23047 ts_tablet_manager.cc:1434] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:21:28.266656 23048 tablet_bootstrap.cc:654] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.266726 23047 tablet_bootstrap.cc:492] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:28.274248 23047 tablet_bootstrap.cc:654] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.276841 23050 tablet_bootstrap.cc:654] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.280165 23001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c48bfd3488f4ab8b00547a92e0eb843" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:28.280849 23001 raft_consensus.cc:2468] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:28.283588 23046 raft_consensus.cc:359] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.288354 23046 raft_consensus.cc:385] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.288755 23046 raft_consensus.cc:740] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.289656 23046 consensus_queue.cc:260] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.297971 23326 raft_consensus.cc:493] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.298508 23326 raft_consensus.cc:515] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.301906 23046 ts_tablet_manager.cc:1434] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:21:28.305451 23046 tablet_bootstrap.cc:492] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:28.304973 23102 raft_consensus.cc:493] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.321226 23102 raft_consensus.cc:515] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.323335 23102 leader_election.cc:290] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:28.324442 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:28.324800 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:28.325695 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:28.325901 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:28.326350 22850 raft_consensus.cc:2468] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:28.327026 22924 raft_consensus.cc:3060] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:28.328023 22964 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.330094 22673 catalog_manager.cc:5697] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:28.331784 22816 leader_election.cc:304] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
W20260709 13:21:28.333441 22741 leader_election.cc:343] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.334017 23276 raft_consensus.cc:2804] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.334394 23276 raft_consensus.cc:493] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.334703 23276 raft_consensus.cc:3060] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.338605 22672 catalog_manager.cc:5697] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:28.340384 22723 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:28.341252 23311 raft_consensus.cc:493] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.341739 23311 raft_consensus.cc:515] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.341950 23307 consensus_queue.cc:1048] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:28.342471 23047 tablet_bootstrap.cc:492] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:28.343024 23047 ts_tablet_manager.cc:1403] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.017s
W20260709 13:21:28.344108 22966 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.324451 23326 leader_election.cc:290] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:28.344594 22966 leader_election.cc:304] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:28.345937 23053 raft_consensus.cc:2749] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:28.347829 22741 leader_election.cc:304] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:28.349090 22776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:28.349726 22776 raft_consensus.cc:2468] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:28.349846 23191 raft_consensus.cc:2804] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.350303 23191 raft_consensus.cc:493] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.350648 23191 raft_consensus.cc:3060] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.351200 23311 leader_election.cc:290] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:28.352752 23047 raft_consensus.cc:359] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.353806 23047 raft_consensus.cc:385] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.354074 23047 raft_consensus.cc:740] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.355974 23047 consensus_queue.cc:260] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.359361 23047 ts_tablet_manager.cc:1434] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.004s
I20260709 13:21:28.351619 22818 leader_election.cc:304] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:28.360265 23047 tablet_bootstrap.cc:492] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:28.360477 23307 raft_consensus.cc:2804] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.360868 23307 raft_consensus.cc:493] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.361004 23050 tablet_bootstrap.cc:492] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:28.361205 23307 raft_consensus.cc:3060] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.361552 23050 ts_tablet_manager.cc:1403] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.018s
I20260709 13:21:28.368358 23050 raft_consensus.cc:359] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.369264 23050 raft_consensus.cc:385] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.369616 23050 raft_consensus.cc:740] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.370440 23050 consensus_queue.cc:260] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.374852 23046 tablet_bootstrap.cc:654] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.377552 23047 tablet_bootstrap.cc:654] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.379817 23050 ts_tablet_manager.cc:1434] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:21:28.382794 23050 tablet_bootstrap.cc:492] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:28.432425 23122 consensus_queue.cc:1048] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:28.468062 23046 tablet_bootstrap.cc:492] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:28.469419 23046 ts_tablet_manager.cc:1403] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.001s
I20260709 13:21:28.473927 23053 raft_consensus.cc:493] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.475033 23053 raft_consensus.cc:515] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.476202 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:28.478792 23053 leader_election.cc:290] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:28.480772 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:28.482834 22964 leader_election.cc:343] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.484022 23324 raft_consensus.cc:493] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:28.485459 23334 log.cc:927] Time spent T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:21:28.484892 23324 raft_consensus.cc:515] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:28.487185 23050 tablet_bootstrap.cc:654] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.488000 23276 raft_consensus.cc:515] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
W20260709 13:21:28.493544 22816 leader_election.cc:343] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.471239 23048 tablet_bootstrap.cc:492] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:28.497210 23048 ts_tablet_manager.cc:1403] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.240s	user 0.019s	sys 0.004s
I20260709 13:21:28.497962 23324 leader_election.cc:290] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:28.504132 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f2c58a06ac445b85ec78b0e8531134" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:28.507757 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:28.512308 22741 consensus_peers.cc:597] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.525135 23276 leader_election.cc:290] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:28.532305 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f2c58a06ac445b85ec78b0e8531134" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
W20260709 13:21:28.534042 22816 consensus_peers.cc:597] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.540012 22816 consensus_peers.cc:597] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.543883 23324 raft_consensus.cc:493] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.544750 23324 raft_consensus.cc:515] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.543457 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c48bfd3488f4ab8b00547a92e0eb843" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:28.546764 22999 raft_consensus.cc:3060] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.547142 23324 leader_election.cc:290] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:28.548879 22924 raft_consensus.cc:3060] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.551471 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c48bfd3488f4ab8b00547a92e0eb843" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:28.556915 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6596aca14e4f31bea39731d8a95dfc" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:28.557762 22777 raft_consensus.cc:2468] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
W20260709 13:21:28.559405 22818 leader_election.cc:343] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.561978 22890 leader_election.cc:304] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:28.565987 22778 raft_consensus.cc:3060] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.569136 23191 raft_consensus.cc:515] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.573005 22892 leader_election.cc:304] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:28.574134 23123 raft_consensus.cc:2804] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.574565 23123 raft_consensus.cc:493] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:28.573984 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:28.575003 23123 raft_consensus.cc:3060] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.575387 22851 raft_consensus.cc:3060] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.583755 23191 leader_election.cc:290] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:28.596274 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:28.598122 23307 raft_consensus.cc:515] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.601104 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6596aca14e4f31bea39731d8a95dfc" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
W20260709 13:21:28.601584 22966 leader_election.cc:343] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.601929 22997 raft_consensus.cc:2468] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
I20260709 13:21:28.602136 22966 leader_election.cc:304] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:28.603245 23047 tablet_bootstrap.cc:492] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:28.604079 23047 ts_tablet_manager.cc:1403] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.244s	user 0.014s	sys 0.004s
I20260709 13:21:28.613646 23309 consensus_queue.cc:1048] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:28.607659 22741 leader_election.cc:343] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.614853 23326 consensus_queue.cc:1048] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 13:21:28.617594 23266 consensus_queue.cc:1048] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:28.604641 23307 leader_election.cc:290] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:28.628281 23050 tablet_bootstrap.cc:492] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:28.629144 23050 ts_tablet_manager.cc:1403] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.247s	user 0.020s	sys 0.017s
I20260709 13:21:28.634670 23050 raft_consensus.cc:359] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.635854 23050 raft_consensus.cc:385] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.636384 23050 raft_consensus.cc:740] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.622804 23048 raft_consensus.cc:359] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.639645 22999 raft_consensus.cc:2468] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:28.649902 23123 raft_consensus.cc:515] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.710959 23123 leader_election.cc:290] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:28.657882 23323 raft_consensus.cc:493] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.711943 23323 raft_consensus.cc:515] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.662822 23309 consensus_queue.cc:1048] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:21:28.717000 23122 consensus_queue.cc:1048] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:28.656106 23350 raft_consensus.cc:2749] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:28.664402 22816 consensus_peers.cc:597] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:28.718958 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6596aca14e4f31bea39731d8a95dfc" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
W20260709 13:21:28.719310 22816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:34985, user_credentials={real_user=slave}} blocked reactor thread for 55047.4us
I20260709 13:21:28.719873 22778 raft_consensus.cc:3060] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.665313 23046 raft_consensus.cc:359] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
W20260709 13:21:28.672848 22741 consensus_peers.cc:597] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:28.722630 22741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:43687, user_credentials={real_user=slave}} blocked reactor thread for 49890.8us
I20260709 13:21:28.681744 23266 raft_consensus.cc:493] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:28.681172 22964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:34985, user_credentials={real_user=slave}} blocked reactor thread for 79499.2us
I20260709 13:21:28.681160 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:28.640082 23050 consensus_queue.cc:260] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.665654 23048 raft_consensus.cc:385] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.643378 22776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:28.724962 23048 raft_consensus.cc:740] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.725208 22776 raft_consensus.cc:3060] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.726049 23046 raft_consensus.cc:385] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.726480 23046 raft_consensus.cc:740] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.727314 23046 consensus_queue.cc:260] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:28.728637 23048 consensus_queue.cc:260] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.681782 23047 raft_consensus.cc:359] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.724052 23266 raft_consensus.cc:515] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:28.733547 23266 leader_election.cc:290] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:28.734570 23047 raft_consensus.cc:385] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.734980 23050 ts_tablet_manager.cc:1434] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.105s	user 0.010s	sys 0.000s
I20260709 13:21:28.735008 23047 raft_consensus.cc:740] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.742005 23050 tablet_bootstrap.cc:492] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:28.745543 23046 ts_tablet_manager.cc:1434] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.276s	user 0.003s	sys 0.007s
I20260709 13:21:28.748236 23047 consensus_queue.cc:260] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.751371 23048 ts_tablet_manager.cc:1434] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.254s	user 0.010s	sys 0.002s
I20260709 13:21:28.751740 23123 raft_consensus.cc:493] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.753434 23123 raft_consensus.cc:515] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.756842 23048 tablet_bootstrap.cc:492] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:28.758143 23123 leader_election.cc:290] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:28.761227 23050 tablet_bootstrap.cc:654] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.761088 22776 raft_consensus.cc:2468] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:28.767079 23048 tablet_bootstrap.cc:654] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.768178 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9928bc913a6d4447b83c59ac19cbcf25" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:28.768627 22816 leader_election.cc:343] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.775543 22816 leader_election.cc:304] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:28.776594 23323 leader_election.cc:290] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:28.776830 22818 leader_election.cc:304] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:28.777714 23309 raft_consensus.cc:2804] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.779095 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33209c9cbc0949fb933224b7cb5dce53" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:28.778219 23309 raft_consensus.cc:697] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:28.780041 23046 tablet_bootstrap.cc:492] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:28.780872 23309 consensus_queue.cc:237] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.763427 22851 raft_consensus.cc:2468] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:28.794649 23047 ts_tablet_manager.cc:1434] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.190s	user 0.007s	sys 0.002s
I20260709 13:21:28.799954 22776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9928bc913a6d4447b83c59ac19cbcf25" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:28.794466 23350 raft_consensus.cc:493] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.801275 22778 raft_consensus.cc:2468] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:28.801395 23350 raft_consensus.cc:515] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:28.802131 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33209c9cbc0949fb933224b7cb5dce53" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:28.802718 22892 leader_election.cc:304] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:28.803646 23123 raft_consensus.cc:2804] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.803783 23266 raft_consensus.cc:2804] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.804237 23123 raft_consensus.cc:697] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:28.804411 23266 raft_consensus.cc:697] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:28.805403 23123 consensus_queue.cc:237] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.805603 23266 consensus_queue.cc:237] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:28.800956 22776 raft_consensus.cc:2393] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 1: Already voted for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in this term.
I20260709 13:21:28.818004 22892 leader_election.cc:304] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:28.819341 23354 raft_consensus.cc:3060] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.820130 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8427d8842704b1e8a7d20c6a4baf90f" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:28.820959 22853 raft_consensus.cc:2468] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:28.824215 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8427d8842704b1e8a7d20c6a4baf90f" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:28.820417 23047 tablet_bootstrap.cc:492] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
W20260709 13:21:28.827472 22964 leader_election.cc:343] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.827836 23354 raft_consensus.cc:2749] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:28.812204 23350 leader_election.cc:290] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:28.839509 23327 raft_consensus.cc:493] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:28.840111 23327 raft_consensus.cc:515] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:28.845880 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f868d307ca42e9bbdac5db09aa91d0" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:28.835810 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f868d307ca42e9bbdac5db09aa91d0" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:28.850512 22816 leader_election.cc:343] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.843544 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:28.862833 23047 tablet_bootstrap.cc:654] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.863101 23323 consensus_queue.cc:1048] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:28.853348 22966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:34811, user_credentials={real_user=slave}} blocked reactor thread for 251878us
I20260709 13:21:28.864724 23327 leader_election.cc:290] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:28.866465 22741 leader_election.cc:304] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:28.872943 23311 raft_consensus.cc:493] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:21:28.875190 22816 leader_election.cc:343] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.876022 22816 leader_election.cc:304] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:28.879107 22741 leader_election.cc:304] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:28.896734 23326 raft_consensus.cc:2804] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:28.897313 23326 raft_consensus.cc:697] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:28.898290 23326 consensus_queue.cc:237] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.900630 23046 tablet_bootstrap.cc:654] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:28.902119 22998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6596aca14e4f31bea39731d8a95dfc" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:28.902793 22998 raft_consensus.cc:3060] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:28.867879 22964 leader_election.cc:304] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:28.875787 23324 raft_consensus.cc:2749] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:28.909029 22741 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:28.885429 23276 raft_consensus.cc:2749] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:28.916481 22964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.2:43687, user_credentials={real_user=slave}} blocked reactor thread for 44748.8us
I20260709 13:21:28.885499 23311 raft_consensus.cc:515] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:28.934267 23048 tablet_bootstrap.cc:492] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:28.934633 23050 tablet_bootstrap.cc:492] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:28.934919 23048 ts_tablet_manager.cc:1403] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.178s	user 0.021s	sys 0.005s
I20260709 13:21:28.935110 23050 ts_tablet_manager.cc:1403] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.195s	user 0.012s	sys 0.012s
I20260709 13:21:28.922513 23327 raft_consensus.cc:2749] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:28.963506 23046 tablet_bootstrap.cc:492] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:28.959868 23000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:28.969085 23050 raft_consensus.cc:359] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:28.955641 22998 raft_consensus.cc:2468] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:28.972008 23311 leader_election.cc:290] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:28.955904 23102 raft_consensus.cc:2804] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:28.978219 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e393b9cf9a849f4ad63eea1da23ea42" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:28.980616 23365 log.cc:927] Time spent T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:21:28.980738 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e393b9cf9a849f4ad63eea1da23ea42" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:28.988044 23050 raft_consensus.cc:385] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:28.988327 23046 ts_tablet_manager.cc:1403] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.209s	user 0.012s	sys 0.005s
I20260709 13:21:28.942798 23309 consensus_queue.cc:1048] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.056s
I20260709 13:21:29.002682 23050 raft_consensus.cc:740] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:28.996059 23102 raft_consensus.cc:493] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.007571 23000 raft_consensus.cc:2468] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:29.007786 22774 raft_consensus.cc:2468] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:29.009660 23102 raft_consensus.cc:3060] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.009630 22818 leader_election.cc:304] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:29.010558 23276 raft_consensus.cc:2804] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.010908 23276 raft_consensus.cc:493] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.011207 23276 raft_consensus.cc:3060] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.012154 23050 consensus_queue.cc:260] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:29.012416 23046 raft_consensus.cc:359] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.013052 23046 raft_consensus.cc:385] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.013307 23046 raft_consensus.cc:740] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.013907 23046 consensus_queue.cc:260] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.014452 23050 ts_tablet_manager.cc:1434] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.001s
I20260709 13:21:29.017575 23048 raft_consensus.cc:359] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:29.018325 23048 raft_consensus.cc:385] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.018591 23048 raft_consensus.cc:740] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.025584 23047 tablet_bootstrap.cc:492] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:29.026087 23047 ts_tablet_manager.cc:1403] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.206s	user 0.014s	sys 0.004s
I20260709 13:21:29.025844 23102 raft_consensus.cc:515] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:29.019261 23048 consensus_queue.cc:260] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:29.029454 22741 leader_election.cc:304] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:29.035730 23191 raft_consensus.cc:2804] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.038111 23191 raft_consensus.cc:493] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.038304 23046 ts_tablet_manager.cc:1434] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:21:29.038483 23191 raft_consensus.cc:3060] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.039559 23046 tablet_bootstrap.cc:492] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:29.051347 23102 leader_election.cc:290] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:29.052410 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8427d8842704b1e8a7d20c6a4baf90f" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:29.052918 23050 tablet_bootstrap.cc:492] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
W20260709 13:21:29.055789 22964 leader_election.cc:343] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:29.056288 22816 leader_election.cc:343] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.058199 23046 tablet_bootstrap.cc:654] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.057978 23047 raft_consensus.cc:359] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.058686 23047 raft_consensus.cc:385] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.058985 23047 raft_consensus.cc:740] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.060685 23047 consensus_queue.cc:260] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.091874 23276 raft_consensus.cc:515] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.094127 22674 catalog_manager.cc:5697] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.094452 22675 catalog_manager.cc:5697] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.096014 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e393b9cf9a849f4ad63eea1da23ea42" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:29.100584 23048 ts_tablet_manager.cc:1434] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.165s	user 0.009s	sys 0.000s
I20260709 13:21:29.096658 22775 raft_consensus.cc:3060] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.107393 23276 leader_election.cc:290] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:29.110630 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8427d8842704b1e8a7d20c6a4baf90f" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:29.111285 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e393b9cf9a849f4ad63eea1da23ea42" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:29.111438 22852 raft_consensus.cc:3060] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:29.116887 22816 leader_election.cc:343] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.147450 23048 tablet_bootstrap.cc:492] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
W20260709 13:21:29.173853 22741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:44325, user_credentials={real_user=slave}} blocked reactor thread for 98029.4us
I20260709 13:21:29.200882 22672 catalog_manager.cc:5697] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.202773 22672 catalog_manager.cc:5697] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.157048 23191 raft_consensus.cc:515] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.207966 23191 leader_election.cc:290] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:29.209043 23050 tablet_bootstrap.cc:654] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.212661 23123 raft_consensus.cc:493] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.213151 23123 raft_consensus.cc:515] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:29.215137 23123 leader_election.cc:290] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:29.217674 23048 tablet_bootstrap.cc:654] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.219776 23326 raft_consensus.cc:493] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.220275 23326 raft_consensus.cc:515] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.222292 23326 leader_election.cc:290] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:29.225139 22995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1fb76060d7483698646276d085257f" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:29.230571 23047 ts_tablet_manager.cc:1434] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.204s	user 0.019s	sys 0.014s
I20260709 13:21:29.242812 23047 tablet_bootstrap.cc:492] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:29.243925 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1fb76060d7483698646276d085257f" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:29.247077 23046 tablet_bootstrap.cc:492] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:29.247711 23046 ts_tablet_manager.cc:1403] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.208s	user 0.008s	sys 0.032s
I20260709 13:21:29.249898 23047 tablet_bootstrap.cc:654] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.253269 22890 leader_election.cc:304] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:29.255069 22775 raft_consensus.cc:2468] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:29.255926 23081 raft_consensus.cc:2749] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.264849 22818 leader_election.cc:304] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
W20260709 13:21:29.265687 23379 log.cc:927] Time spent T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: Append to log took a long time: real 0.055s	user 0.004s	sys 0.000s
I20260709 13:21:29.266608 23374 consensus_queue.cc:1048] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:29.273284 22852 raft_consensus.cc:2468] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:29.276432 22964 leader_election.cc:304] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:29.265723 23276 raft_consensus.cc:2804] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.278486 23276 raft_consensus.cc:697] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:29.279851 23352 raft_consensus.cc:2804] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.279493 23276 consensus_queue.cc:237] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.280383 23352 raft_consensus.cc:697] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:29.281221 23352 consensus_queue.cc:237] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
W20260709 13:21:29.283377 22818 consensus_peers.cc:597] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:29.285076 23046 raft_consensus.cc:359] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:29.285980 23046 raft_consensus.cc:385] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.286262 23046 raft_consensus.cc:740] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.287039 23046 consensus_queue.cc:260] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:29.292411 23046 ts_tablet_manager.cc:1434] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:21:29.293730 23046 tablet_bootstrap.cc:492] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
W20260709 13:21:29.294099 22741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:43687, user_credentials={real_user=slave}} blocked reactor thread for 96200.7us
I20260709 13:21:29.311285 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:29.312131 22996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:29.312811 23046 tablet_bootstrap.cc:654] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.312878 22996 raft_consensus.cc:3060] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.313364 23048 tablet_bootstrap.cc:492] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:29.313887 23048 ts_tablet_manager.cc:1403] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.208s	user 0.011s	sys 0.000s
I20260709 13:21:29.319649 23048 raft_consensus.cc:359] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.320664 23048 raft_consensus.cc:385] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.320930 22850 raft_consensus.cc:3060] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.321105 23048 raft_consensus.cc:740] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.322193 23048 consensus_queue.cc:260] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.322841 23276 consensus_queue.cc:1048] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:29.329844 23048 ts_tablet_manager.cc:1434] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
W20260709 13:21:29.333485 22816 consensus_peers.cc:597] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Couldn't send request to peer f825e4bed376497e95838e1b82dc1a03. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:29.333541 23123 consensus_queue.cc:1048] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:29.337080 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:29.343794 23050 tablet_bootstrap.cc:492] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:29.344362 23050 ts_tablet_manager.cc:1403] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.292s	user 0.030s	sys 0.014s
I20260709 13:21:29.344496 22996 raft_consensus.cc:2468] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:29.348304 23354 consensus_queue.cc:1048] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:29.352643 23352 raft_consensus.cc:493] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.353108 23352 raft_consensus.cc:515] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.361171 23050 raft_consensus.cc:359] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.361963 23050 raft_consensus.cc:385] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.362840 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:29.364640 22964 leader_election.cc:343] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.365510 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:29.362210 23050 raft_consensus.cc:740] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
W20260709 13:21:29.366350 22741 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.362995 23352 leader_election.cc:290] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:29.366986 23050 consensus_queue.cc:260] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:29.366986 22741 leader_election.cc:343] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:29.367581 22966 leader_election.cc:343] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.368299 22966 leader_election.cc:304] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:29.374532 23050 ts_tablet_manager.cc:1434] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 13:21:29.376021 22741 leader_election.cc:304] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:29.369700 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:29.391878 22852 raft_consensus.cc:2468] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:29.392215 23384 raft_consensus.cc:2804] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.392879 23384 raft_consensus.cc:697] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:29.393810 23384 consensus_queue.cc:237] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:29.394336 22741 consensus_peers.cc:597] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:29.395000 22924 raft_consensus.cc:3060] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.377156 23352 raft_consensus.cc:2749] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.399086 23047 tablet_bootstrap.cc:492] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:29.399552 23047 ts_tablet_manager.cc:1403] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.157s	user 0.011s	sys 0.001s
I20260709 13:21:29.404343 23050 tablet_bootstrap.cc:492] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:29.407332 23047 raft_consensus.cc:359] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.408735 23047 raft_consensus.cc:385] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.409209 23047 raft_consensus.cc:740] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.417582 23048 tablet_bootstrap.cc:492] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:29.422789 22741 leader_election.cc:304] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:29.417999 23047 consensus_queue.cc:260] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.430968 23383 raft_consensus.cc:2804] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.431362 23383 raft_consensus.cc:493] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.445600 23047 ts_tablet_manager.cc:1434] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:21:29.436466 23383 raft_consensus.cc:3060] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.448750 23046 tablet_bootstrap.cc:492] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:29.449393 23046 ts_tablet_manager.cc:1403] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.156s	user 0.035s	sys 0.034s
I20260709 13:21:29.466728 23048 tablet_bootstrap.cc:654] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.475967 23050 tablet_bootstrap.cc:654] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.478212 23047 tablet_bootstrap.cc:492] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:29.490460 23046 raft_consensus.cc:359] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:29.495026 23046 raft_consensus.cc:385] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.495409 23046 raft_consensus.cc:740] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.494611 23383 raft_consensus.cc:515] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.514501 23383 leader_election.cc:290] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:29.517122 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:29.517735 22852 raft_consensus.cc:3060] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.521085 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
W20260709 13:21:29.523325 22741 leader_election.cc:343] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.526392 22852 raft_consensus.cc:2468] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:29.527657 22741 leader_election.cc:304] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:29.529937 23323 raft_consensus.cc:2804] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.530439 23323 raft_consensus.cc:697] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:29.531234 23323 consensus_queue.cc:237] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.532756 23047 tablet_bootstrap.cc:654] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.538581 23046 consensus_queue.cc:260] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:29.539104 23383 consensus_queue.cc:1048] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:21:29.545903 22924 raft_consensus.cc:3060] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.552045 23050 tablet_bootstrap.cc:492] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:29.552572 23050 ts_tablet_manager.cc:1403] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.148s	user 0.014s	sys 0.024s
I20260709 13:21:29.566176 23050 raft_consensus.cc:359] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.567190 23050 raft_consensus.cc:385] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.567456 23050 raft_consensus.cc:740] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.567981 23050 consensus_queue.cc:260] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.566238 23053 raft_consensus.cc:493] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.570801 23046 ts_tablet_manager.cc:1434] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.000s
I20260709 13:21:29.572152 23053 raft_consensus.cc:515] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:29.576725 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5b0b4e5dc64c67a2830174409b84d9" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:29.576877 23053 leader_election.cc:290] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:29.577855 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5b0b4e5dc64c67a2830174409b84d9" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:29.578451 22966 leader_election.cc:343] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.582000 23048 tablet_bootstrap.cc:492] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:29.583092 23048 ts_tablet_manager.cc:1403] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.183s	user 0.034s	sys 0.033s
W20260709 13:21:29.584020 22964 leader_election.cc:343] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.584726 23050 ts_tablet_manager.cc:1434] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:21:29.584668 22964 leader_election.cc:304] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:29.586061 23050 tablet_bootstrap.cc:492] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:29.587854 23046 tablet_bootstrap.cc:492] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:29.589075 23048 raft_consensus.cc:359] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.589821 23048 raft_consensus.cc:385] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.589927 23352 raft_consensus.cc:2749] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.590176 23048 raft_consensus.cc:740] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.591081 23048 consensus_queue.cc:260] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.595397 23046 tablet_bootstrap.cc:654] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.596851 23048 ts_tablet_manager.cc:1434] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:21:29.597990 23048 tablet_bootstrap.cc:492] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:29.606069 23048 tablet_bootstrap.cc:654] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.607750 23050 tablet_bootstrap.cc:654] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.628422 23046 tablet_bootstrap.cc:492] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:29.628986 23046 ts_tablet_manager.cc:1403] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.000s
I20260709 13:21:29.631696 23046 raft_consensus.cc:359] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:29.632412 23046 raft_consensus.cc:385] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.632669 23046 raft_consensus.cc:740] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.633136 22672 catalog_manager.cc:5697] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.633332 23046 consensus_queue.cc:260] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:29.652689 23047 tablet_bootstrap.cc:492] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:29.653214 23047 ts_tablet_manager.cc:1403] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.176s	user 0.014s	sys 0.002s
I20260709 13:21:29.664086 23047 raft_consensus.cc:359] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.664810 23047 raft_consensus.cc:385] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.665335 23047 raft_consensus.cc:740] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.666139 23047 consensus_queue.cc:260] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.669776 23047 ts_tablet_manager.cc:1434] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:21:29.670764 23047 tablet_bootstrap.cc:492] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:29.673120 23046 ts_tablet_manager.cc:1434] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:21:29.671582 23323 raft_consensus.cc:493] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.678789 23323 raft_consensus.cc:515] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.679466 23050 tablet_bootstrap.cc:492] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:29.679982 23050 ts_tablet_manager.cc:1403] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.094s	user 0.023s	sys 0.023s
I20260709 13:21:29.684868 22673 catalog_manager.cc:5697] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:29.694700 23046 tablet_bootstrap.cc:492] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:29.695756 23047 tablet_bootstrap.cc:654] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.695935 23048 tablet_bootstrap.cc:492] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:29.696441 23048 ts_tablet_manager.cc:1403] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.099s	user 0.007s	sys 0.009s
W20260709 13:21:29.694592 22723 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:29.689172 22673 catalog_manager.cc:5697] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.700691 23048 raft_consensus.cc:359] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.701700 23050 raft_consensus.cc:359] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.702574 23046 tablet_bootstrap.cc:654] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.703708 23048 raft_consensus.cc:385] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.703853 23050 raft_consensus.cc:385] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.704363 23050 raft_consensus.cc:740] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.704109 23048 raft_consensus.cc:740] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.706436 23048 consensus_queue.cc:260] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.707288 23050 consensus_queue.cc:260] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.709582 23323 leader_election.cc:290] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:29.711164 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:29.712237 23050 ts_tablet_manager.cc:1434] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.002s
W20260709 13:21:29.713645 22741 leader_election.cc:343] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.714083 23048 ts_tablet_manager.cc:1434] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:21:29.714644 23050 tablet_bootstrap.cc:492] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:29.718418 23047 tablet_bootstrap.cc:492] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:29.719514 23047 ts_tablet_manager.cc:1403] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.004s
I20260709 13:21:29.718385 23048 tablet_bootstrap.cc:492] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:29.715971 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:29.723227 22852 raft_consensus.cc:2468] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:29.723073 23047 raft_consensus.cc:359] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.723850 23047 raft_consensus.cc:385] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:29.724161 23047 raft_consensus.cc:740] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:29.724575 22741 leader_election.cc:304] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:29.724866 23047 consensus_queue.cc:260] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.725966 23326 raft_consensus.cc:2804] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.726349 23326 raft_consensus.cc:493] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.726699 23326 raft_consensus.cc:3060] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.727239 23047 ts_tablet_manager.cc:1434] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:29.728367 23047 tablet_bootstrap.cc:492] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:29.731590 23311 raft_consensus.cc:493] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.732107 23311 raft_consensus.cc:515] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.734511 23047 tablet_bootstrap.cc:654] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.734889 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c5e4b2a4d642ef918c312a6ab1b808" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:29.736685 22672 catalog_manager.cc:5697] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:29.738358 23352 raft_consensus.cc:493] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.738842 23352 raft_consensus.cc:515] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:29.741070 23081 raft_consensus.cc:493] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.741531 23081 raft_consensus.cc:515] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.742308 23326 raft_consensus.cc:515] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.747912 23050 tablet_bootstrap.cc:654] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.751400 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:29.752007 22852 raft_consensus.cc:3060] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.760547 23311 leader_election.cc:290] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:29.735586 22775 raft_consensus.cc:2468] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:29.749579 23352 leader_election.cc:290] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:29.766554 23048 tablet_bootstrap.cc:654] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:29.743589 23081 leader_election.cc:290] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:29.771998 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e393b9cf9a849f4ad63eea1da23ea42" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:29.774538 22777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e393b9cf9a849f4ad63eea1da23ea42" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:29.775393 22777 raft_consensus.cc:2393] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 1: Already voted for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in this term.
I20260709 13:21:29.778038 22995 raft_consensus.cc:3060] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.762097 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:29.784602 22892 leader_election.cc:304] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:29.785787 23081 raft_consensus.cc:3060] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.788651 23384 raft_consensus.cc:493] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:29.789160 23384 raft_consensus.cc:515] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.789219 22818 leader_election.cc:304] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:29.790925 23374 raft_consensus.cc:2804] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.791288 23384 leader_election.cc:290] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:29.764235 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:29.791301 23374 raft_consensus.cc:493] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.792122 23374 raft_consensus.cc:3060] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.793516 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:29.794523 22996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
W20260709 13:21:29.794790 22741 leader_election.cc:343] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.795275 22996 raft_consensus.cc:2468] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:29.797163 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c5e4b2a4d642ef918c312a6ab1b808" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:29.800005 22964 consensus_peers.cc:597] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:29.802906 22966 leader_election.cc:304] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
W20260709 13:21:29.806777 22816 leader_election.cc:343] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.805295 23326 leader_election.cc:290] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:29.810946 23374 raft_consensus.cc:515] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.816336 22852 raft_consensus.cc:2468] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:29.821805 22741 leader_election.cc:304] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:29.822672 23326 raft_consensus.cc:2804] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.822907 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:29.823453 23326 raft_consensus.cc:697] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
W20260709 13:21:29.824441 22741 leader_election.cc:343] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.824389 23326 consensus_queue.cc:237] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:29.832216 22741 leader_election.cc:304] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:29.833508 23323 raft_consensus.cc:2804] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:29.833904 23323 raft_consensus.cc:493] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:29.834221 23323 raft_consensus.cc:3060] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.841475 22776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c5e4b2a4d642ef918c312a6ab1b808" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:29.842131 22776 raft_consensus.cc:3060] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.833091 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c5e4b2a4d642ef918c312a6ab1b808" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
W20260709 13:21:29.847361 22816 leader_election.cc:343] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.847995 23323 raft_consensus.cc:515] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.851935 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:29.852227 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:29.852716 22997 raft_consensus.cc:3060] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:29.854748 23374 leader_election.cc:290] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:29.850044 23323 leader_election.cc:290] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
W20260709 13:21:29.856498 22741 leader_election.cc:343] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:29.859949 23323 consensus_queue.cc:1048] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:29.865101 23311 consensus_queue.cc:1048] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:29.865861 22997 raft_consensus.cc:2468] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:29.868896 22741 leader_election.cc:304] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:29.869939 23383 raft_consensus.cc:2804] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.870419 23383 raft_consensus.cc:697] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:29.871213 23383 consensus_queue.cc:237] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:29.941542 23081 raft_consensus.cc:2749] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:29.942154 22776 raft_consensus.cc:2468] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:29.947623 22818 leader_election.cc:304] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:29.949849 23122 raft_consensus.cc:2804] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:29.950390 23122 raft_consensus.cc:697] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:29.956187 23311 consensus_queue.cc:1048] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:29.951249 23122 consensus_queue.cc:237] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:29.984203 22964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:43687, user_credentials={real_user=slave}} blocked reactor thread for 137937us
I20260709 13:21:29.990190 23047 tablet_bootstrap.cc:492] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:29.990850 23047 ts_tablet_manager.cc:1403] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.263s	user 0.060s	sys 0.073s
I20260709 13:21:30.007247 23046 tablet_bootstrap.cc:492] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:30.007970 23046 ts_tablet_manager.cc:1403] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.328s	user 0.032s	sys 0.018s
I20260709 13:21:30.000319 23326 raft_consensus.cc:493] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.016510 23050 tablet_bootstrap.cc:492] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:30.019894 23050 ts_tablet_manager.cc:1403] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.307s	user 0.010s	sys 0.002s
I20260709 13:21:30.016501 22922 raft_consensus.cc:3060] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.037400 23048 tablet_bootstrap.cc:492] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:30.037878 23048 ts_tablet_manager.cc:1403] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.320s	user 0.010s	sys 0.028s
I20260709 13:21:30.047076 23050 raft_consensus.cc:359] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:30.047994 23050 raft_consensus.cc:385] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.049564 23046 raft_consensus.cc:359] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.056506 23046 raft_consensus.cc:385] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.056763 23046 raft_consensus.cc:740] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.057387 23046 consensus_queue.cc:260] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.048273 23050 raft_consensus.cc:740] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.061262 23416 raft_consensus.cc:493] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.061785 23416 raft_consensus.cc:515] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.062093 23050 consensus_queue.cc:260] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:30.064047 23416 leader_election.cc:290] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:30.064437 23050 ts_tablet_manager.cc:1434] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.003s
I20260709 13:21:30.065265 23050 tablet_bootstrap.cc:492] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:30.065157 23384 consensus_queue.cc:1048] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.068109 23048 raft_consensus.cc:359] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.068778 23048 raft_consensus.cc:385] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.069042 23048 raft_consensus.cc:740] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.069737 23384 consensus_queue.cc:1048] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.070919 23047 raft_consensus.cc:359] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.071575 23047 raft_consensus.cc:385] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.071861 23047 raft_consensus.cc:740] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.072786 23047 consensus_queue.cc:260] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.069676 23048 consensus_queue.cc:260] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.060182 23046 ts_tablet_manager.cc:1434] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.003s
I20260709 13:21:30.075242 23046 tablet_bootstrap.cc:492] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:30.075848 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f868d307ca42e9bbdac5db09aa91d0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:30.076481 22852 raft_consensus.cc:2468] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:30.077762 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f868d307ca42e9bbdac5db09aa91d0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:30.083698 23048 ts_tablet_manager.cc:1434] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.002s
I20260709 13:21:30.015136 23326 raft_consensus.cc:515] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.086902 23048 tablet_bootstrap.cc:492] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:30.090592 22672 catalog_manager.cc:5697] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.093693 22672 catalog_manager.cc:5697] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.097445 23047 ts_tablet_manager.cc:1434] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.106s	user 0.005s	sys 0.002s
I20260709 13:21:30.099738 23053 consensus_queue.cc:1048] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:21:30.110169 23050 tablet_bootstrap.cc:654] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.109901 22674 catalog_manager.cc:5697] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:30.105597 22964 leader_election.cc:304] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:30.124503 23053 raft_consensus.cc:2804] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.124917 23053 raft_consensus.cc:493] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.125234 23053 raft_consensus.cc:3060] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:30.125627 22964 leader_election.cc:343] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.130813 23352 raft_consensus.cc:2749] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:30.129455 23416 raft_consensus.cc:493] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.134394 23416 raft_consensus.cc:515] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.136596 23416 leader_election.cc:290] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:30.138309 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:30.139757 23047 tablet_bootstrap.cc:492] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
W20260709 13:21:30.140694 22966 leader_election.cc:343] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.142654 23046 tablet_bootstrap.cc:654] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.150173 23053 raft_consensus.cc:515] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
W20260709 13:21:30.151865 23424 log.cc:927] Time spent T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:21:30.152807 23423 log.cc:927] Time spent T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:21:30.178766 23053 leader_election.cc:290] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:30.182130 23048 tablet_bootstrap.cc:654] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.182327 23047 tablet_bootstrap.cc:654] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.194604 23326 leader_election.cc:290] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:30.196234 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:30.199729 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f868d307ca42e9bbdac5db09aa91d0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:30.205125 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:30.219453 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f868d307ca42e9bbdac5db09aa91d0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:30.225418 22850 raft_consensus.cc:3060] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.213148 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:30.233213 22999 raft_consensus.cc:2468] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
W20260709 13:21:30.237442 22741 leader_election.cc:343] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:30.238322 22741 consensus_peers.cc:597] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:30.243848 22741 leader_election.cc:304] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:30.244634 23420 raft_consensus.cc:2804] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.245052 23420 raft_consensus.cc:493] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.245414 23420 raft_consensus.cc:3060] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:30.253839 22964 leader_election.cc:343] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.263720 22850 raft_consensus.cc:2468] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:30.271164 22964 leader_election.cc:304] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
W20260709 13:21:30.273242 22964 leader_election.cc:343] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.274538 23352 raft_consensus.cc:2749] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:30.277311 23426 consensus_queue.cc:1048] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.276750 22964 leader_election.cc:304] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:30.284993 23046 tablet_bootstrap.cc:492] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:30.285804 23046 ts_tablet_manager.cc:1403] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.211s	user 0.021s	sys 0.017s
I20260709 13:21:30.289050 23050 tablet_bootstrap.cc:492] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:30.289587 23050 ts_tablet_manager.cc:1403] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.224s	user 0.026s	sys 0.014s
I20260709 13:21:30.292197 23050 raft_consensus.cc:359] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.292910 23050 raft_consensus.cc:385] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.293226 23050 raft_consensus.cc:740] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.290352 23420 raft_consensus.cc:515] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.295060 23046 raft_consensus.cc:359] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.295756 23046 raft_consensus.cc:385] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.296015 23046 raft_consensus.cc:740] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.296639 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:30.296635 23046 consensus_queue.cc:260] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.302845 22995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:30.303561 22995 raft_consensus.cc:3060] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:30.305497 22816 consensus_peers.cc:597] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:30.304637 23420 leader_election.cc:290] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:30.281482 23416 raft_consensus.cc:2804] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.310568 23416 raft_consensus.cc:697] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:30.311836 23416 consensus_queue.cc:237] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.293880 23050 consensus_queue.cc:260] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.323096 22923 raft_consensus.cc:3060] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.335443 23047 tablet_bootstrap.cc:492] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:30.336162 23047 ts_tablet_manager.cc:1403] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.208s	user 0.010s	sys 0.011s
I20260709 13:21:30.319574 23046 ts_tablet_manager.cc:1434] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.004s
I20260709 13:21:30.356029 23046 tablet_bootstrap.cc:492] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:30.356498 23048 tablet_bootstrap.cc:492] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:30.357029 23048 ts_tablet_manager.cc:1403] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.272s	user 0.004s	sys 0.025s
I20260709 13:21:30.362672 23050 ts_tablet_manager.cc:1434] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.012s
I20260709 13:21:30.362319 23046 tablet_bootstrap.cc:654] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.357085 22922 raft_consensus.cc:3060] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:30.414702 22816 consensus_peers.cc:597] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:30.415303 22741 consensus_peers.cc:597] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:30.358572 23047 raft_consensus.cc:359] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.416000 23047 raft_consensus.cc:385] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.416275 23047 raft_consensus.cc:740] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.417194 23047 consensus_queue.cc:260] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.425827 23050 tablet_bootstrap.cc:492] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:30.434034 23050 tablet_bootstrap.cc:654] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.446586 22923 raft_consensus.cc:2468] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:30.445613 22774 raft_consensus.cc:3060] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.439620 23048 raft_consensus.cc:359] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.450469 23048 raft_consensus.cc:385] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.450860 23048 raft_consensus.cc:740] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.456962 23047 ts_tablet_manager.cc:1434] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.007s
W20260709 13:21:30.463548 22741 consensus_peers.cc:597] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:30.438992 22673 catalog_manager.cc:5697] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.451707 23048 consensus_queue.cc:260] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.482209 23122 raft_consensus.cc:493] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.482676 23122 raft_consensus.cc:515] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.489331 23047 tablet_bootstrap.cc:492] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:30.492787 23048 ts_tablet_manager.cc:1434] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.001s
I20260709 13:21:30.493917 23122 leader_election.cc:290] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:30.498586 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5b0b4e5dc64c67a2830174409b84d9" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:30.503281 22818 leader_election.cc:343] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.505416 23050 tablet_bootstrap.cc:492] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:30.505921 23050 ts_tablet_manager.cc:1403] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.028s
I20260709 13:21:30.503547 22995 raft_consensus.cc:2468] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:30.510346 23050 raft_consensus.cc:359] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.511063 23050 raft_consensus.cc:385] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.511343 23050 raft_consensus.cc:740] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.516155 23053 raft_consensus.cc:493] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.516644 23053 raft_consensus.cc:515] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.518462 23053 leader_election.cc:290] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:30.518113 23050 consensus_queue.cc:260] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.519833 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5b0b4e5dc64c67a2830174409b84d9" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:30.520123 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089d12187b140b4bb379b9d3bc7816f" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:30.520520 22997 raft_consensus.cc:2468] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:30.520797 22851 raft_consensus.cc:2468] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:30.522151 22816 leader_election.cc:304] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:30.522914 23050 ts_tablet_manager.cc:1434] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:21:30.522063 22964 leader_election.cc:304] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:30.523810 23053 raft_consensus.cc:2804] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.524166 23053 raft_consensus.cc:493] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.524479 23053 raft_consensus.cc:3060] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.523156 23324 raft_consensus.cc:493] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:30.525998 23050 tablet_bootstrap.cc:492] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:30.525775 23324 raft_consensus.cc:515] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:30.526443 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089d12187b140b4bb379b9d3bc7816f" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:30.525187 23310 raft_consensus.cc:2804] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.528565 23310 raft_consensus.cc:493] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.528895 23310 raft_consensus.cc:3060] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.531183 23053 raft_consensus.cc:515] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
W20260709 13:21:30.531939 22964 leader_election.cc:343] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.532235 23050 tablet_bootstrap.cc:654] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.534792 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089d12187b140b4bb379b9d3bc7816f" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:30.535367 22851 raft_consensus.cc:3060] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.539959 23310 raft_consensus.cc:515] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.541627 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:30.541921 23310 leader_election.cc:290] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:30.542635 22851 raft_consensus.cc:2468] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:30.544235 22964 leader_election.cc:304] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:30.544528 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:30.545267 23416 raft_consensus.cc:2804] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.545619 23324 leader_election.cc:290] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:30.545918 23416 raft_consensus.cc:697] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:30.547119 23416 consensus_queue.cc:237] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.550523 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5b0b4e5dc64c67a2830174409b84d9" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:30.551090 22997 raft_consensus.cc:3060] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.551275 23050 tablet_bootstrap.cc:492] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:30.551895 22890 leader_election.cc:304] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:30.554361 23324 raft_consensus.cc:2749] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:30.554623 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5b0b4e5dc64c67a2830174409b84d9" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:30.551893 23050 ts_tablet_manager.cc:1403] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.007s
W20260709 13:21:30.558053 22818 leader_election.cc:343] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.558692 23311 consensus_queue.cc:1048] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.559975 23050 raft_consensus.cc:359] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.560648 23050 raft_consensus.cc:385] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.560918 23050 raft_consensus.cc:740] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.561643 23050 consensus_queue.cc:260] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.563802 23050 ts_tablet_manager.cc:1434] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:21:30.564790 23050 tablet_bootstrap.cc:492] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:30.565033 22997 raft_consensus.cc:2468] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:30.566180 22816 leader_election.cc:304] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:30.567018 23311 raft_consensus.cc:2804] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.567502 23311 raft_consensus.cc:697] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:30.568583 23311 consensus_queue.cc:237] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.573521 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6089d12187b140b4bb379b9d3bc7816f" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:30.574973 23050 tablet_bootstrap.cc:654] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:30.575140 22964 leader_election.cc:343] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.573745 23053 leader_election.cc:290] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:30.525395 22741 leader_election.cc:304] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
W20260709 13:21:30.584599 22741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.4:44325, user_credentials={real_user=slave}} blocked reactor thread for 60514.8us
I20260709 13:21:30.585393 23326 raft_consensus.cc:2804] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.585953 23326 raft_consensus.cc:697] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:30.586776 23326 consensus_queue.cc:237] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.592157 23381 raft_consensus.cc:493] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.592909 23381 raft_consensus.cc:515] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.596586 23381 leader_election.cc:290] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:30.605801 23048 tablet_bootstrap.cc:492] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:30.614081 23046 tablet_bootstrap.cc:492] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:30.614584 23046 ts_tablet_manager.cc:1403] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.259s	user 0.021s	sys 0.007s
I20260709 13:21:30.619246 23426 consensus_queue.cc:1048] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:30.622689 22922 raft_consensus.cc:3060] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.631987 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:30.654309 22672 catalog_manager.cc:5697] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.657059 22995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:30.658243 22995 raft_consensus.cc:2468] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:30.659094 23324 raft_consensus.cc:493] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.659583 23324 raft_consensus.cc:515] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.662984 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8427d8842704b1e8a7d20c6a4baf90f" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:30.664743 23324 leader_election.cc:290] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:30.665817 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8427d8842704b1e8a7d20c6a4baf90f" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:30.667995 22890 leader_election.cc:304] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:30.669073 23324 raft_consensus.cc:2749] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:30.686719 23047 tablet_bootstrap.cc:654] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.691108 23046 raft_consensus.cc:359] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.694360 23048 tablet_bootstrap.cc:654] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.696334 23046 raft_consensus.cc:385] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.702942 23046 raft_consensus.cc:740] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.703713 23046 consensus_queue.cc:260] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
W20260709 13:21:30.706650 22741 leader_election.cc:343] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.714953 22675 catalog_manager.cc:5697] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.721704 22741 leader_election.cc:304] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:30.727653 23426 raft_consensus.cc:2804] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:30.728946 23426 raft_consensus.cc:493] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:30.729264 23426 raft_consensus.cc:3060] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.737864 23426 raft_consensus.cc:515] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.739717 23426 leader_election.cc:290] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:30.723170 23046 ts_tablet_manager.cc:1434] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.001s
I20260709 13:21:30.741091 23046 tablet_bootstrap.cc:492] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:30.746568 22674 catalog_manager.cc:5697] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:30.759153 23050 tablet_bootstrap.cc:492] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:30.759795 23050 ts_tablet_manager.cc:1403] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.195s	user 0.061s	sys 0.060s
I20260709 13:21:30.760540 22922 raft_consensus.cc:3060] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.762917 23050 raft_consensus.cc:359] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.763751 23050 raft_consensus.cc:385] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.764093 23050 raft_consensus.cc:740] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.764930 23050 consensus_queue.cc:260] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.773252 23047 tablet_bootstrap.cc:492] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:30.773752 23047 ts_tablet_manager.cc:1403] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.289s	user 0.006s	sys 0.007s
I20260709 13:21:30.774616 23050 ts_tablet_manager.cc:1434] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:21:30.775823 23050 tablet_bootstrap.cc:492] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:30.782047 23050 tablet_bootstrap.cc:654] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:30.798002 22964 consensus_peers.cc:597] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:30.807137 22741 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:44325, user_credentials={real_user=slave}} blocked reactor thread for 78856us
W20260709 13:21:30.817250 22723 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:30.822461 23048 tablet_bootstrap.cc:492] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:30.822960 23048 ts_tablet_manager.cc:1403] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.218s	user 0.011s	sys 0.000s
I20260709 13:21:30.825558 23047 raft_consensus.cc:359] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.826354 23047 raft_consensus.cc:385] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.826646 23047 raft_consensus.cc:740] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.828897 23048 raft_consensus.cc:359] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.829598 23048 raft_consensus.cc:385] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.829864 23048 raft_consensus.cc:740] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.830751 23047 consensus_queue.cc:260] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.834865 23048 consensus_queue.cc:260] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.838084 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:30.840751 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:30.841576 22997 raft_consensus.cc:3060] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:30.843360 22741 leader_election.cc:343] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.843957 23046 tablet_bootstrap.cc:654] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.849146 23047 ts_tablet_manager.cc:1434] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.003s
I20260709 13:21:30.850160 23047 tablet_bootstrap.cc:492] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:30.856777 23050 tablet_bootstrap.cc:492] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:30.857295 23050 ts_tablet_manager.cc:1403] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.082s	user 0.021s	sys 0.031s
I20260709 13:21:30.859973 23050 raft_consensus.cc:359] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:30.860594 23050 raft_consensus.cc:385] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.860836 23050 raft_consensus.cc:740] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.861522 23048 ts_tablet_manager.cc:1434] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:21:30.862855 23048 tablet_bootstrap.cc:492] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:30.864396 23050 consensus_queue.cc:260] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:30.868165 22997 raft_consensus.cc:2468] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:30.868625 23050 ts_tablet_manager.cc:1434] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:21:30.873879 23050 tablet_bootstrap.cc:492] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:30.874158 23311 raft_consensus.cc:493] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.874665 23311 raft_consensus.cc:515] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.876554 23053 consensus_queue.cc:1048] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:30.877053 23311 leader_election.cc:290] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:30.878182 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2d13e9f7c4d7880772615ce0d811c" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:30.879698 22818 leader_election.cc:343] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.881341 22741 leader_election.cc:304] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:30.882293 23456 raft_consensus.cc:2804] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:30.882894 23456 raft_consensus.cc:697] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:30.885741 23416 raft_consensus.cc:493] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.886195 23050 tablet_bootstrap.cc:654] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.886234 23416 raft_consensus.cc:515] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.888563 23416 leader_election.cc:290] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:30.889109 23456 consensus_queue.cc:237] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:30.891162 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c363ea87274bec880ce1c6cdb1faef" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:30.893384 22964 leader_election.cc:343] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.893498 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2d13e9f7c4d7880772615ce0d811c" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:30.894282 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c363ea87274bec880ce1c6cdb1faef" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:30.895203 22816 leader_election.cc:343] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.896512 22816 leader_election.cc:304] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:30.898124 23122 raft_consensus.cc:2749] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:21:30.900154 22964 leader_election.cc:343] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:30.900648 22964 leader_election.cc:304] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:30.905303 23416 raft_consensus.cc:2749] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:30.911360 23046 tablet_bootstrap.cc:492] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:30.911935 23046 ts_tablet_manager.cc:1403] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.171s	user 0.019s	sys 0.013s
I20260709 13:21:30.913792 23081 raft_consensus.cc:493] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:30.914487 23081 raft_consensus.cc:515] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:30.920152 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:30.921566 23046 raft_consensus.cc:359] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.922470 23046 raft_consensus.cc:385] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:30.922719 23081 leader_election.cc:290] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:30.922822 23046 raft_consensus.cc:740] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:30.923310 22851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:30.933382 23046 consensus_queue.cc:260] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:30.935072 22890 leader_election.cc:304] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:30.937237 23046 ts_tablet_manager.cc:1434] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.008s
I20260709 13:21:30.938059 23081 raft_consensus.cc:2749] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:30.947829 23046 tablet_bootstrap.cc:492] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:30.947986 22922 raft_consensus.cc:3060] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:30.957088 23047 tablet_bootstrap.cc:654] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.965291 23046 tablet_bootstrap.cc:654] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:30.979846 23048 tablet_bootstrap.cc:654] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.001714 23426 consensus_queue.cc:1048] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:31.049623 23050 tablet_bootstrap.cc:492] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:31.050285 23050 ts_tablet_manager.cc:1403] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.177s	user 0.037s	sys 0.051s
I20260709 13:21:31.073094 22671 catalog_manager.cc:5697] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:31.077064 22925 raft_consensus.cc:3060] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.084129 23050 raft_consensus.cc:359] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.084831 23050 raft_consensus.cc:385] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.085103 23050 raft_consensus.cc:740] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.085697 23050 consensus_queue.cc:260] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.093931 23046 tablet_bootstrap.cc:492] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:31.094440 23046 ts_tablet_manager.cc:1403] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.022s
I20260709 13:21:31.103413 23047 tablet_bootstrap.cc:492] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:31.103955 23047 ts_tablet_manager.cc:1403] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.254s	user 0.017s	sys 0.010s
I20260709 13:21:31.110708 23381 consensus_queue.cc:1048] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:31.112093 23046 raft_consensus.cc:359] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.112818 23046 raft_consensus.cc:385] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.113080 23046 raft_consensus.cc:740] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.114506 23050 ts_tablet_manager.cc:1434] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:21:31.115147 23047 raft_consensus.cc:359] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.115631 23050 tablet_bootstrap.cc:492] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:31.115861 23047 raft_consensus.cc:385] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.116216 23047 raft_consensus.cc:740] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.120172 23466 consensus_queue.cc:1048] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:31.126237 23046 consensus_queue.cc:260] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.128306 23046 ts_tablet_manager.cc:1434] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:21:31.129300 23081 raft_consensus.cc:493] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f307730e7ab4bab9c70d9fa3e51dd49)
I20260709 13:21:31.129822 23081 raft_consensus.cc:515] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.132041 23050 tablet_bootstrap.cc:654] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.136788 23081 leader_election.cc:290] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:31.130527 23047 consensus_queue.cc:260] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.138700 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c5e4b2a4d642ef918c312a6ab1b808" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:31.142166 23047 ts_tablet_manager.cc:1434] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:21:31.143283 23047 tablet_bootstrap.cc:492] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
W20260709 13:21:31.148159 22964 consensus_peers.cc:597] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:31.155604 23046 tablet_bootstrap.cc:492] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:31.159966 23426 raft_consensus.cc:493] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.160499 23426 raft_consensus.cc:515] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.162335 23046 tablet_bootstrap.cc:654] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.164304 23426 leader_election.cc:290] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:31.165396 23047 tablet_bootstrap.cc:654] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.166704 22995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5b0b4e5dc64c67a2830174409b84d9" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:31.169727 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c5b0b4e5dc64c67a2830174409b84d9" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:31.172628 23430 consensus_queue.cc:1048] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:31.187208 23046 tablet_bootstrap.cc:492] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:31.188041 23046 ts_tablet_manager.cc:1403] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.007s
I20260709 13:21:31.187775 22741 leader_election.cc:304] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:31.189885 23383 raft_consensus.cc:2749] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.190981 23047 tablet_bootstrap.cc:492] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:31.191469 23047 ts_tablet_manager.cc:1403] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.001s
I20260709 13:21:31.191481 23430 raft_consensus.cc:493] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.192114 23430 raft_consensus.cc:515] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.194747 23047 raft_consensus.cc:359] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.195513 23047 raft_consensus.cc:385] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.195848 23047 raft_consensus.cc:740] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.197065 23053 raft_consensus.cc:493] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.197501 23053 raft_consensus.cc:515] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.197693 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2d13e9f7c4d7880772615ce0d811c" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:31.198267 22774 raft_consensus.cc:2468] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:31.198603 23047 consensus_queue.cc:260] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.199296 23053 leader_election.cc:290] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:31.199306 22966 leader_election.cc:304] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:31.200883 23352 raft_consensus.cc:2804] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.201228 23352 raft_consensus.cc:493] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.201552 23352 raft_consensus.cc:3060] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.201849 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c24379e8a84ab9890e18d3c00b9a48" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:31.203104 22966 leader_election.cc:343] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.205173 23430 leader_election.cc:290] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:31.205835 23046 raft_consensus.cc:359] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.206534 23046 raft_consensus.cc:385] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.206413 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c24379e8a84ab9890e18d3c00b9a48" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:31.206857 23046 raft_consensus.cc:740] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.207561 23046 consensus_queue.cc:260] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.209025 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2d13e9f7c4d7880772615ce0d811c" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
W20260709 13:21:31.209141 22964 leader_election.cc:343] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.209707 22964 leader_election.cc:304] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:31.209744 22853 raft_consensus.cc:2468] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
I20260709 13:21:31.209025 23352 raft_consensus.cc:515] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.214649 23053 raft_consensus.cc:2749] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.216007 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2d13e9f7c4d7880772615ce0d811c" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:31.216588 22774 raft_consensus.cc:3060] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.219372 23352 leader_election.cc:290] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:31.222339 23047 ts_tablet_manager.cc:1434] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:21:31.223423 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde2d13e9f7c4d7880772615ce0d811c" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:31.224377 22774 raft_consensus.cc:2468] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:31.224571 22853 raft_consensus.cc:3060] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.225713 22966 leader_election.cc:304] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:31.228188 23352 raft_consensus.cc:2804] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:31.229494 23352 raft_consensus.cc:697] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:31.230288 23352 consensus_queue.cc:237] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.235409 23047 tablet_bootstrap.cc:492] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:31.235610 22853 raft_consensus.cc:2468] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:31.237788 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c5e4b2a4d642ef918c312a6ab1b808" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:31.239506 23048 tablet_bootstrap.cc:492] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:31.263540 23048 ts_tablet_manager.cc:1403] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.401s	user 0.028s	sys 0.033s
I20260709 13:21:31.263577 23047 tablet_bootstrap.cc:654] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.266270 23048 raft_consensus.cc:359] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.266922 23048 raft_consensus.cc:385] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.267186 23048 raft_consensus.cc:740] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.249814 22774 raft_consensus.cc:3060] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.270046 23047 tablet_bootstrap.cc:492] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:31.271859 23047 ts_tablet_manager.cc:1403] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
I20260709 13:21:31.275192 23047 raft_consensus.cc:359] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.216557 23046 ts_tablet_manager.cc:1434] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:21:31.275993 23047 raft_consensus.cc:385] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.276342 23047 raft_consensus.cc:740] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.277215 23046 tablet_bootstrap.cc:492] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03: Bootstrap starting.
I20260709 13:21:31.277030 23047 consensus_queue.cc:260] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.279464 23047 ts_tablet_manager.cc:1434] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:31.280478 23047 tablet_bootstrap.cc:492] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:31.285740 22890 leader_election.cc:304] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:31.287070 23081 raft_consensus.cc:2749] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:31.287447 23047 tablet_bootstrap.cc:654] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.287009 23048 consensus_queue.cc:260] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.289050 23471 consensus_queue.cc:1048] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:31.294335 23048 ts_tablet_manager.cc:1434] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:21:31.295288 23048 tablet_bootstrap.cc:492] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:31.307861 23050 tablet_bootstrap.cc:492] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:31.308384 23050 ts_tablet_manager.cc:1403] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.193s	user 0.027s	sys 0.021s
I20260709 13:21:31.311053 23050 raft_consensus.cc:359] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.332461 23046 tablet_bootstrap.cc:654] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.334693 22671 catalog_manager.cc:5697] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.365859 23467 raft_consensus.cc:493] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.369105 23050 raft_consensus.cc:385] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.366425 23467 raft_consensus.cc:515] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.377805 23467 leader_election.cc:290] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:31.379980 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0436364a6d304d108b9d702cec8086c0" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:31.380586 23046 tablet_bootstrap.cc:492] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03: No bootstrap required, opened a new log
I20260709 13:21:31.381049 22775 raft_consensus.cc:2468] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 0.
I20260709 13:21:31.381258 23046 ts_tablet_manager.cc:1403] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03: Time spent bootstrapping tablet: real 0.105s	user 0.008s	sys 0.004s
I20260709 13:21:31.378719 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0436364a6d304d108b9d702cec8086c0" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:31.383535 22816 leader_election.cc:343] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.387225 23048 tablet_bootstrap.cc:654] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.388314 23047 tablet_bootstrap.cc:492] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:31.388792 23047 ts_tablet_manager.cc:1403] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.109s	user 0.042s	sys 0.053s
I20260709 13:21:31.391551 23047 raft_consensus.cc:359] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.392194 23047 raft_consensus.cc:385] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.392477 23047 raft_consensus.cc:740] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.392688 23046 raft_consensus.cc:359] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.393102 23047 consensus_queue.cc:260] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.393561 23046 raft_consensus.cc:385] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.393942 23046 raft_consensus.cc:740] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.394726 23047 ts_tablet_manager.cc:1434] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:31.395851 23047 tablet_bootstrap.cc:492] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:31.394749 23046 consensus_queue.cc:260] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.372476 23050 raft_consensus.cc:740] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.397018 23050 consensus_queue.cc:260] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.399070 23050 ts_tablet_manager.cc:1434] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.000s
I20260709 13:21:31.399557 22818 leader_election.cc:304] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:31.400405 23050 tablet_bootstrap.cc:492] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:31.401098 23046 ts_tablet_manager.cc:1434] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:21:31.402211 23047 tablet_bootstrap.cc:654] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.403344 23467 raft_consensus.cc:2804] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.403771 23467 raft_consensus.cc:493] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.404111 23467 raft_consensus.cc:3060] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.406309 23048 tablet_bootstrap.cc:492] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:31.406781 23048 ts_tablet_manager.cc:1403] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.112s	user 0.007s	sys 0.003s
I20260709 13:21:31.407785 23050 tablet_bootstrap.cc:654] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.409467 23048 raft_consensus.cc:359] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.410148 23048 raft_consensus.cc:385] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.410470 23048 raft_consensus.cc:740] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.411170 23048 consensus_queue.cc:260] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.415483 23048 ts_tablet_manager.cc:1434] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:21:31.416543 23048 tablet_bootstrap.cc:492] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:31.420960 22925 raft_consensus.cc:3060] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.425616 23416 raft_consensus.cc:493] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.440510 23416 raft_consensus.cc:515] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.442348 23426 raft_consensus.cc:493] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.442610 23416 leader_election.cc:290] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:31.443214 23352 raft_consensus.cc:493] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.442945 23426 raft_consensus.cc:515] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.443765 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:31.444602 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:31.445117 23426 leader_election.cc:290] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
W20260709 13:21:31.446841 22966 leader_election.cc:343] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.443645 23352 raft_consensus.cc:515] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.448570 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:31.448812 23352 leader_election.cc:290] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:31.449196 22852 raft_consensus.cc:2468] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:31.449643 23467 raft_consensus.cc:515] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.450186 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:31.451277 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3670fb6e5d3143289ff131f8df729e4a" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:31.453228 22778 raft_consensus.cc:2468] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 0.
W20260709 13:21:31.453980 22741 leader_election.cc:343] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.454646 22966 leader_election.cc:304] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
W20260709 13:21:31.452191 22964 leader_election.cc:343] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.455489 22964 leader_election.cc:304] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:31.456117 23416 raft_consensus.cc:2804] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.456501 23416 raft_consensus.cc:493] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.457175 23416 raft_consensus.cc:3060] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.458127 23430 raft_consensus.cc:2749] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.458634 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0436364a6d304d108b9d702cec8086c0" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
W20260709 13:21:31.460458 22816 leader_election.cc:343] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.461203 22741 leader_election.cc:304] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
W20260709 13:21:31.462322 22741 consensus_peers.cc:597] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:31.463198 23381 raft_consensus.cc:2804] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.463587 23381 raft_consensus.cc:493] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.463595 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0436364a6d304d108b9d702cec8086c0" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:31.463970 23381 raft_consensus.cc:3060] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.464308 22775 raft_consensus.cc:3060] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.464336 23467 leader_election.cc:290] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:31.455562 23048 tablet_bootstrap.cc:654] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.469739 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3670fb6e5d3143289ff131f8df729e4a" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:31.471065 23047 tablet_bootstrap.cc:492] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:31.471558 23047 ts_tablet_manager.cc:1403] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.008s
W20260709 13:21:31.473212 22964 leader_election.cc:343] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.474282 23047 raft_consensus.cc:359] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.474959 23047 raft_consensus.cc:385] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.475220 23047 raft_consensus.cc:740] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.482852 22775 raft_consensus.cc:2468] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:31.489563 23416 raft_consensus.cc:515] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.493335 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3670fb6e5d3143289ff131f8df729e4a" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:31.494479 22775 raft_consensus.cc:3060] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.494655 23381 raft_consensus.cc:515] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.497033 22818 leader_election.cc:304] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:31.496927 23047 consensus_queue.cc:260] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.499212 23047 ts_tablet_manager.cc:1434] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.000s
I20260709 13:21:31.501554 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:31.502137 22852 raft_consensus.cc:3060] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.501140 23471 raft_consensus.cc:2804] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:31.502977 23471 raft_consensus.cc:697] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:31.504110 23416 leader_election.cc:290] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:31.503985 23471 consensus_queue.cc:237] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.505631 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3670fb6e5d3143289ff131f8df729e4a" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:31.505892 23047 tablet_bootstrap.cc:492] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:31.506875 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
W20260709 13:21:31.507768 22964 leader_election.cc:343] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.511022 23426 consensus_queue.cc:1048] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:31.512822 23047 tablet_bootstrap.cc:654] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:21:31.513746 22741 leader_election.cc:343] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.514001 23050 tablet_bootstrap.cc:492] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:31.514474 23050 ts_tablet_manager.cc:1403] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.010s
I20260709 13:21:31.524981 23047 tablet_bootstrap.cc:492] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9: No bootstrap required, opened a new log
I20260709 13:21:31.525451 23047 ts_tablet_manager.cc:1403] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.008s
I20260709 13:21:31.526312 23050 raft_consensus.cc:359] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:31.527159 23050 raft_consensus.cc:385] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.527463 23050 raft_consensus.cc:740] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.528419 23081 raft_consensus.cc:493] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.528795 23081 raft_consensus.cc:515] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.529173 23047 raft_consensus.cc:359] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.530203 23047 raft_consensus.cc:385] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.530454 23047 raft_consensus.cc:740] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.531019 23081 leader_election.cc:290] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:31.531095 23047 consensus_queue.cc:260] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.531776 23050 consensus_queue.cc:260] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:31.533578 23047 ts_tablet_manager.cc:1434] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:21:31.534291 22853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:31.537246 22852 raft_consensus.cc:2468] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:31.537689 23381 leader_election.cc:290] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:31.539366 23048 tablet_bootstrap.cc:492] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:31.539773 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:31.539412 22741 leader_election.cc:304] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:31.539996 23048 ts_tablet_manager.cc:1403] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.001s
I20260709 13:21:31.540831 23050 ts_tablet_manager.cc:1434] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:21:31.541857 23050 tablet_bootstrap.cc:492] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:31.542484 22892 leader_election.cc:304] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:31.544194 23081 raft_consensus.cc:2749] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.546530 23381 raft_consensus.cc:2804] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:31.547092 23381 raft_consensus.cc:697] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:31.548014 23381 consensus_queue.cc:237] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.549345 23050 tablet_bootstrap.cc:654] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.544740 23048 raft_consensus.cc:359] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.554592 23048 raft_consensus.cc:385] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.554858 23048 raft_consensus.cc:740] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.553196 22775 raft_consensus.cc:2468] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:31.556573 23048 consensus_queue.cc:260] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.565336 23048 ts_tablet_manager.cc:1434] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:21:31.566753 23048 tablet_bootstrap.cc:492] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49: Bootstrap starting.
I20260709 13:21:31.578253 23048 tablet_bootstrap.cc:654] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.583969 22966 leader_election.cc:304] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:31.585234 23416 raft_consensus.cc:2804] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:31.582623 22674 catalog_manager.cc:5697] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.595034 22923 raft_consensus.cc:3060] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.585707 23416 raft_consensus.cc:697] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:31.596941 23416 consensus_queue.cc:237] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.612653 23050 tablet_bootstrap.cc:492] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:31.613155 23050 ts_tablet_manager.cc:1403] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.030s
I20260709 13:21:31.614758 23048 tablet_bootstrap.cc:492] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49: No bootstrap required, opened a new log
I20260709 13:21:31.615327 23048 ts_tablet_manager.cc:1403] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.003s
I20260709 13:21:31.615717 23050 raft_consensus.cc:359] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.616391 23050 raft_consensus.cc:385] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.616637 23050 raft_consensus.cc:740] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.617247 23050 consensus_queue.cc:260] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.618671 23050 ts_tablet_manager.cc:1434] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:31.619652 23050 tablet_bootstrap.cc:492] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:31.621098 23048 raft_consensus.cc:359] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:31.621649 22675 catalog_manager.cc:5697] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 0 to 1, leader changed from <none> to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 1 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.625998 23050 tablet_bootstrap.cc:654] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.621872 23048 raft_consensus.cc:385] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.626734 23048 raft_consensus.cc:740] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.627628 23048 consensus_queue.cc:260] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:31.632124 23048 ts_tablet_manager.cc:1434] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:21:31.636170 23383 raft_consensus.cc:493] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.636883 23383 raft_consensus.cc:515] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.638892 23383 leader_election.cc:290] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:31.636870 23050 tablet_bootstrap.cc:492] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:31.639918 23050 ts_tablet_manager.cc:1403] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.005s
I20260709 13:21:31.640777 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
W20260709 13:21:31.642747 22741 leader_election.cc:343] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.643484 23050 raft_consensus.cc:359] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.645040 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:31.645702 22999 raft_consensus.cc:2468] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 0.
I20260709 13:21:31.646934 22741 leader_election.cc:304] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:31.648604 23381 raft_consensus.cc:2804] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.649004 23381 raft_consensus.cc:493] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.645057 23050 raft_consensus.cc:385] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.652354 23050 raft_consensus.cc:740] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.652958 23050 consensus_queue.cc:260] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.665447 23050 ts_tablet_manager.cc:1434] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.006s
I20260709 13:21:31.668066 23050 tablet_bootstrap.cc:492] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:31.649395 23381 raft_consensus.cc:3060] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.672353 23311 raft_consensus.cc:493] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.672899 23311 raft_consensus.cc:515] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:31.674206 23050 tablet_bootstrap.cc:654] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.674899 23311 leader_election.cc:290] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:31.676532 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3670fb6e5d3143289ff131f8df729e4a" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:31.680708 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3670fb6e5d3143289ff131f8df729e4a" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:31.681449 22775 raft_consensus.cc:2393] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 1: Already voted for candidate f825e4bed376497e95838e1b82dc1a03 in this term.
I20260709 13:21:31.682948 22818 leader_election.cc:304] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:31.683696 23311 raft_consensus.cc:3060] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.684279 23352 consensus_queue.cc:1048] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:31.675359 23381 raft_consensus.cc:515] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.694651 23381 leader_election.cc:290] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:31.694728 23050 tablet_bootstrap.cc:492] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:31.696983 23050 ts_tablet_manager.cc:1403] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.002s
I20260709 13:21:31.699820 23050 raft_consensus.cc:359] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:31.700435 23050 raft_consensus.cc:385] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.703764 23050 raft_consensus.cc:740] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.704519 23050 consensus_queue.cc:260] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:31.706329 23050 ts_tablet_manager.cc:1434] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:31.709808 23050 tablet_bootstrap.cc:492] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:31.711791 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:31.711934 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:31.712579 22999 raft_consensus.cc:3060] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:21:31.719915 22741 leader_election.cc:343] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:31.726861 23050 tablet_bootstrap.cc:654] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.729375 22999 raft_consensus.cc:2468] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 1.
I20260709 13:21:31.738032 23311 raft_consensus.cc:2749] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.743968 22741 leader_election.cc:304] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:31.744712 23381 raft_consensus.cc:2804] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:31.745177 23381 raft_consensus.cc:697] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:31.745935 23381 consensus_queue.cc:237] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.748296 23050 tablet_bootstrap.cc:492] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:31.748955 23050 ts_tablet_manager.cc:1403] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.005s
I20260709 13:21:31.752524 23050 raft_consensus.cc:359] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.753397 23050 raft_consensus.cc:385] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.753732 23050 raft_consensus.cc:740] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.755087 23050 consensus_queue.cc:260] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.757124 23050 ts_tablet_manager.cc:1434] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:21:31.757280 23352 consensus_queue.cc:1048] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:31.758045 23050 tablet_bootstrap.cc:492] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:31.764446 23050 tablet_bootstrap.cc:654] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.775243 22671 catalog_manager.cc:5697] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:31.781525 23050 tablet_bootstrap.cc:492] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:31.782037 23050 ts_tablet_manager.cc:1403] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:21:31.784432 23050 raft_consensus.cc:359] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.784714 23081 raft_consensus.cc:493] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.785063 23050 raft_consensus.cc:385] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.785405 23050 raft_consensus.cc:740] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.785259 23081 raft_consensus.cc:515] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.786093 23050 consensus_queue.cc:260] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.788405 23050 ts_tablet_manager.cc:1434] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:21:31.789373 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0436364a6d304d108b9d702cec8086c0" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:31.789515 23081 leader_election.cc:290] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:31.790235 22774 raft_consensus.cc:2393] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 1: Already voted for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in this term.
I20260709 13:21:31.790156 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0436364a6d304d108b9d702cec8086c0" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:31.791826 22890 leader_election.cc:304] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:31.793520 23081 raft_consensus.cc:3060] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.789389 23050 tablet_bootstrap.cc:492] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:31.796819 23470 raft_consensus.cc:493] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.797355 23470 raft_consensus.cc:515] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.799422 23470 leader_election.cc:290] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:31.800132 23050 tablet_bootstrap.cc:654] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.802809 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:31.802914 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:31.806727 22892 leader_election.cc:304] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:31.807752 23470 raft_consensus.cc:2749] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.808868 23081 raft_consensus.cc:2749] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.809662 23050 tablet_bootstrap.cc:492] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:31.810142 23050 ts_tablet_manager.cc:1403] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 13:21:31.810240 22923 raft_consensus.cc:3060] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.813050 23050 raft_consensus.cc:359] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.813735 23050 raft_consensus.cc:385] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.814003 23050 raft_consensus.cc:740] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.814631 23050 consensus_queue.cc:260] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.816745 23050 ts_tablet_manager.cc:1434] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:21:31.817063 22672 catalog_manager.cc:5697] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:31.817864 23050 tablet_bootstrap.cc:492] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:31.824280 23050 tablet_bootstrap.cc:654] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.832302 23081 raft_consensus.cc:493] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.832803 23081 raft_consensus.cc:515] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:31.834682 23081 leader_election.cc:290] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:31.835880 22922 raft_consensus.cc:3060] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.837898 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:31.839013 22850 raft_consensus.cc:2393] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 1: Already voted for candidate e9cee38bd2dd4b4e999490708cacd3a9 in this term.
I20260709 13:21:31.841486 22775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:31.843016 22892 leader_election.cc:304] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:31.844260 23470 raft_consensus.cc:3060] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.869370 22925 raft_consensus.cc:3060] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.870395 23470 raft_consensus.cc:2749] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:31.876139 23081 raft_consensus.cc:493] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.876642 23081 raft_consensus.cc:515] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.878353 23081 leader_election.cc:290] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:31.880401 22774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c24379e8a84ab9890e18d3c00b9a48" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:31.881255 22774 raft_consensus.cc:2468] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
I20260709 13:21:31.886765 23050 tablet_bootstrap.cc:492] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:31.887305 23050 ts_tablet_manager.cc:1403] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.005s
I20260709 13:21:31.887181 22892 leader_election.cc:304] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:31.890118 23050 raft_consensus.cc:359] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:31.894583 23050 raft_consensus.cc:385] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:31.894891 23050 raft_consensus.cc:740] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
I20260709 13:21:31.895277 23081 raft_consensus.cc:2804] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.895713 23081 raft_consensus.cc:493] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.896035 23081 raft_consensus.cc:3060] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.895565 23050 consensus_queue.cc:260] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:31.902067 23374 consensus_queue.cc:1048] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:31.905576 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c24379e8a84ab9890e18d3c00b9a48" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:31.906458 22999 raft_consensus.cc:2468] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
I20260709 13:21:31.911566 23510 raft_consensus.cc:493] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:31.912236 23510 raft_consensus.cc:515] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:31.915539 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c363ea87274bec880ce1c6cdb1faef" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:31.916144 22852 raft_consensus.cc:2468] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
I20260709 13:21:31.917368 22890 leader_election.cc:304] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:31.918614 23511 raft_consensus.cc:2804] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:31.918988 23511 raft_consensus.cc:493] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:31.919312 23511 raft_consensus.cc:3060] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:31.919947 23050 ts_tablet_manager.cc:1434] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.032s	user 0.013s	sys 0.001s
I20260709 13:21:31.921078 23050 tablet_bootstrap.cc:492] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6: Bootstrap starting.
I20260709 13:21:31.922693 23510 leader_election.cc:290] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:31.922869 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c363ea87274bec880ce1c6cdb1faef" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:31.923906 22999 raft_consensus.cc:2468] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 0.
I20260709 13:21:31.931331 23050 tablet_bootstrap.cc:654] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:31.949705 23081 raft_consensus.cc:515] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:31.961704 23326 consensus_queue.cc:1048] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:31.967813 23511 raft_consensus.cc:515] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:31.977449 23374 consensus_queue.cc:1048] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:31.981140 23381 consensus_queue.cc:1048] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:31.991214 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c363ea87274bec880ce1c6cdb1faef" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:31.991941 22850 raft_consensus.cc:3060] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.002571 23081 leader_election.cc:290] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:32.003654 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c24379e8a84ab9890e18d3c00b9a48" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:32.004356 22997 raft_consensus.cc:3060] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.019011 22850 raft_consensus.cc:2468] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:32.018934 22997 raft_consensus.cc:2468] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:32.020172 22890 leader_election.cc:304] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:32.021543 23510 raft_consensus.cc:2804] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:32.022003 23510 raft_consensus.cc:697] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:32.022866 23510 consensus_queue.cc:237] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:32.024386 22890 leader_election.cc:304] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:32.027707 23470 raft_consensus.cc:2804] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:32.028353 23470 raft_consensus.cc:697] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:32.029124 23470 consensus_queue.cc:237] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:32.040982 23050 tablet_bootstrap.cc:492] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6: No bootstrap required, opened a new log
I20260709 13:21:32.041705 23050 ts_tablet_manager.cc:1403] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.017s
I20260709 13:21:32.053001 22925 raft_consensus.cc:3060] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.044191 23050 raft_consensus.cc:359] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:32.064028 23050 raft_consensus.cc:385] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:32.064319 23050 raft_consensus.cc:740] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Initialized, Role: FOLLOWER
W20260709 13:21:32.066128 22723 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:32.069469 23050 consensus_queue.cc:260] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:32.071589 23050 ts_tablet_manager.cc:1434] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:21:32.081740 22778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c24379e8a84ab9890e18d3c00b9a48" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:32.082355 22778 raft_consensus.cc:3060] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.094235 23416 consensus_queue.cc:1048] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:21:32.096431 22890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:44325, user_credentials={real_user=slave}} blocked reactor thread for 61065.3us
I20260709 13:21:32.127992 23511 leader_election.cc:290] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 1 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:32.128975 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c363ea87274bec880ce1c6cdb1faef" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:32.129643 22997 raft_consensus.cc:3060] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.127388 22778 raft_consensus.cc:2468] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:32.150590 22997 raft_consensus.cc:2468] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:32.161934 23352 consensus_queue.cc:1048] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.173674 22672 catalog_manager.cc:5697] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.175209 22672 catalog_manager.cc:5697] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:32.198819 23518 consensus_queue.cc:1048] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:32.222966 22925 raft_consensus.cc:3060] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:32.231827 23381 consensus_queue.cc:1048] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.423540 23470 consensus_queue.cc:1048] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.433884 23470 consensus_queue.cc:1048] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.512853 23470 consensus_queue.cc:1048] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.524880 23512 consensus_queue.cc:1048] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:32.989167 15720 tablet_server.cc:179] TabletServer@127.15.90.1:0 shutting down...
W20260709 13:21:33.004477 22818 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:21:33.009125 22818 consensus_peers.cc:597] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.022246 22892 consensus_peers.cc:597] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.022949 22892 consensus_peers.cc:597] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.030385 22966 consensus_peers.cc:597] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.048557 22818 consensus_peers.cc:597] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.054450 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:33.055371 15720 tablet_replica.cc:333] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.056080 15720 raft_consensus.cc:2243] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.056509 15720 raft_consensus.cc:2272] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.058622 15720 tablet_replica.cc:333] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.059226 15720 raft_consensus.cc:2243] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.060151 15720 raft_consensus.cc:2272] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.063090 15720 tablet_replica.cc:333] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.063920 15720 raft_consensus.cc:2243] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.064812 15720 raft_consensus.cc:2272] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.067860 15720 tablet_replica.cc:333] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.068689 15720 raft_consensus.cc:2243] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.069352 15720 raft_consensus.cc:2272] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.071539 15720 tablet_replica.cc:333] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.072409 15720 raft_consensus.cc:2243] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:21:33.072504 22818 consensus_peers.cc:597] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.073221 15720 raft_consensus.cc:2272] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.074944 15720 tablet_replica.cc:333] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.075631 15720 raft_consensus.cc:2243] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.076517 15720 raft_consensus.cc:2272] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.078807 15720 tablet_replica.cc:333] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
W20260709 13:21:33.079510 22966 consensus_peers.cc:597] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.079613 15720 raft_consensus.cc:2243] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.080682 15720 raft_consensus.cc:2272] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.082314 15720 tablet_replica.cc:333] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.082857 15720 raft_consensus.cc:2243] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.083524 15720 raft_consensus.cc:2272] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.085232 15720 tablet_replica.cc:333] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.085966 15720 raft_consensus.cc:2243] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.086365 15720 raft_consensus.cc:2272] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.088800 15720 tablet_replica.cc:333] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.089485 15720 raft_consensus.cc:2243] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.089867 15720 raft_consensus.cc:2272] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.092100 15720 tablet_replica.cc:333] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.092952 15720 raft_consensus.cc:2243] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.093379 15720 raft_consensus.cc:2272] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.095752 15720 tablet_replica.cc:333] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.096473 15720 raft_consensus.cc:2243] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.096915 15720 raft_consensus.cc:2272] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.099303 15720 tablet_replica.cc:333] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.100029 15720 raft_consensus.cc:2243] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.100903 15720 raft_consensus.cc:2272] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.103385 15720 tablet_replica.cc:333] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.104107 15720 raft_consensus.cc:2243] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.105095 15720 raft_consensus.cc:2272] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.107650 15720 tablet_replica.cc:333] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.108407 15720 raft_consensus.cc:2243] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.109251 15720 raft_consensus.cc:2272] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.111285 15720 tablet_replica.cc:333] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.112212 15720 raft_consensus.cc:2243] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.112813 15720 raft_consensus.cc:2272] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.115351 15720 tablet_replica.cc:333] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.116178 15720 raft_consensus.cc:2243] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.117043 15720 raft_consensus.cc:2272] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:33.118000 22818 consensus_peers.cc:597] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.119483 15720 tablet_replica.cc:333] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.120312 15720 raft_consensus.cc:2243] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.120873 15720 raft_consensus.cc:2272] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.122934 15720 tablet_replica.cc:333] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.123631 15720 raft_consensus.cc:2243] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.124541 15720 raft_consensus.cc:2272] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.127019 15720 tablet_replica.cc:333] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.127732 15720 raft_consensus.cc:2243] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.135464 15720 raft_consensus.cc:2272] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.138067 15720 tablet_replica.cc:333] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.138774 15720 raft_consensus.cc:2243] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.139750 15720 raft_consensus.cc:2272] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:33.141700 22818 consensus_peers.cc:597] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.142153 15720 tablet_replica.cc:333] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.142976 15720 raft_consensus.cc:2243] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.143973 15720 raft_consensus.cc:2272] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.146112 15720 tablet_replica.cc:333] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.146903 15720 raft_consensus.cc:2243] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.147945 15720 raft_consensus.cc:2272] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.150128 15720 tablet_replica.cc:333] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.150612 15720 raft_consensus.cc:2243] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.150972 15720 raft_consensus.cc:2272] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.152935 15720 tablet_replica.cc:333] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.153707 15720 raft_consensus.cc:2243] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.154193 15720 raft_consensus.cc:2272] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.156711 15720 tablet_replica.cc:333] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
W20260709 13:21:33.156900 22966 consensus_peers.cc:597] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.157343 15720 raft_consensus.cc:2243] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.158190 15720 raft_consensus.cc:2272] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.160041 15720 tablet_replica.cc:333] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.160557 15720 raft_consensus.cc:2243] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.161330 15720 raft_consensus.cc:2272] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.163880 15720 tablet_replica.cc:333] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.164631 15720 raft_consensus.cc:2243] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.165117 15720 raft_consensus.cc:2272] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:33.165387 22892 consensus_peers.cc:597] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.166937 15720 tablet_replica.cc:333] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.167563 15720 raft_consensus.cc:2243] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.168339 15720 raft_consensus.cc:2272] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.169996 15720 tablet_replica.cc:333] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.170648 15720 raft_consensus.cc:2243] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.171056 15720 raft_consensus.cc:2272] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.173342 15720 tablet_replica.cc:333] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.173918 15720 raft_consensus.cc:2243] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.174250 15720 raft_consensus.cc:2272] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.175989 15720 tablet_replica.cc:333] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.176667 15720 raft_consensus.cc:2243] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.177091 15720 raft_consensus.cc:2272] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.178781 15720 tablet_replica.cc:333] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.179327 15720 raft_consensus.cc:2243] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.179795 15720 raft_consensus.cc:2272] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.181874 15720 tablet_replica.cc:333] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.182557 15720 raft_consensus.cc:2243] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.183015 15720 raft_consensus.cc:2272] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.185231 15720 tablet_replica.cc:333] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.185681 15720 raft_consensus.cc:2243] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.186133 15720 raft_consensus.cc:2272] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.188444 15720 tablet_replica.cc:333] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.188896 15720 raft_consensus.cc:2243] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.189217 15720 raft_consensus.cc:2272] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.191071 15720 tablet_replica.cc:333] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.191781 15720 raft_consensus.cc:2243] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.192250 15720 raft_consensus.cc:2272] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.194635 15720 tablet_replica.cc:333] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.195097 15720 raft_consensus.cc:2243] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:33.195854 15720 raft_consensus.cc:2272] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.197680 15720 tablet_replica.cc:333] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.198186 15720 raft_consensus.cc:2243] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.198561 15720 raft_consensus.cc:2272] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.200354 15720 tablet_replica.cc:333] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.200863 15720 raft_consensus.cc:2243] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.201294 15720 raft_consensus.cc:2272] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.203016 15720 tablet_replica.cc:333] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.203529 15720 raft_consensus.cc:2243] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.203989 15720 raft_consensus.cc:2272] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.205781 15720 tablet_replica.cc:333] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.206346 15720 raft_consensus.cc:2243] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.206763 15720 raft_consensus.cc:2272] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.208678 15720 tablet_replica.cc:333] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.209141 15720 raft_consensus.cc:2243] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.209524 15720 raft_consensus.cc:2272] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.211135 15720 tablet_replica.cc:333] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.211575 15720 raft_consensus.cc:2243] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.212030 15720 raft_consensus.cc:2272] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:33.213855 15720 tablet_replica.cc:333] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9: stopping tablet replica
I20260709 13:21:33.214284 15720 raft_consensus.cc:2243] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:33.214675 15720 raft_consensus.cc:2272] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:33.216851 22818 consensus_peers.cc:597] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.223460 22966 consensus_peers.cc:597] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.229453 22966 consensus_peers.cc:597] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.230106 22966 consensus_peers.cc:597] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.257709 22966 consensus_peers.cc:597] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.284853 15720 tablet_server.cc:196] TabletServer@127.15.90.1:0 shutdown complete.
W20260709 13:21:33.335043 22818 consensus_peers.cc:597] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.335531 22818 consensus_peers.cc:597] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.350484 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:33.358448 23535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:33.358631 23536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:33.374830 23538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:33.376608 15720 server_base.cc:1061] running on GCE node
W20260709 13:21:33.377760 22892 consensus_peers.cc:597] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.380132 22892 consensus_peers.cc:597] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.380920 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:33.381238 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:33.381536 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603293381515 us; error 0 us; skew 500 ppm
I20260709 13:21:33.383128 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:33.385848 15720 webserver.cc:533] Webserver started at http://127.15.90.1:46377/ using document root <none> and password file <none>
I20260709 13:21:33.386272 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:33.386425 15720 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:21:33.390161 15720 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:21:33.399624 23544 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:33.400904 15720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:21:33.401252 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-0-root
uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
format_stamp: "Formatted at 2026-07-09 13:21:21 on dist-test-slave-fpp7"
I20260709 13:21:33.401765 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783603071664575-15720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:21:33.411504 22966 consensus_peers.cc:597] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.432093 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:33.433598 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:33.436316 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:33.443137 23554 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:21:33.455521 22818 consensus_peers.cc:597] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.526304 22818 consensus_peers.cc:597] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.526736 22818 consensus_peers.cc:597] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.549489 22818 consensus_peers.cc:597] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:33.554136 22966 consensus_peers.cc:597] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:33.690604 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:21:33.691001 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.249s	user 0.007s	sys 0.004s
I20260709 13:21:33.691346 15720 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:21:33.696066 23554 tablet_bootstrap.cc:492] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.715860 23554 tablet_bootstrap.cc:492] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.716801 23554 tablet_bootstrap.cc:492] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.717432 23554 ts_tablet_manager.cc:1403] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.008s
I20260709 13:21:33.719655 23554 raft_consensus.cc:359] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.720309 23554 raft_consensus.cc:740] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.720854 23554 consensus_queue.cc:260] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.723742 23554 ts_tablet_manager.cc:1434] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:21:33.724454 23554 tablet_bootstrap.cc:492] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.736769 23554 tablet_bootstrap.cc:492] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.737658 23554 tablet_bootstrap.cc:492] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.738245 23554 ts_tablet_manager.cc:1403] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.006s
I20260709 13:21:33.740384 23554 raft_consensus.cc:359] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:33.741022 23554 raft_consensus.cc:740] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.741609 23554 consensus_queue.cc:260] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:33.743331 23554 ts_tablet_manager.cc:1434] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:21:33.744091 23554 tablet_bootstrap.cc:492] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.762036 23554 tablet_bootstrap.cc:492] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.762923 23554 tablet_bootstrap.cc:492] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.763523 23554 ts_tablet_manager.cc:1403] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:21:33.765805 23554 raft_consensus.cc:359] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.766446 23554 raft_consensus.cc:740] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.767040 23554 consensus_queue.cc:260] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.768778 23554 ts_tablet_manager.cc:1434] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:33.769505 23554 tablet_bootstrap.cc:492] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.782944 23554 tablet_bootstrap.cc:492] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.783654 23554 tablet_bootstrap.cc:492] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.784186 23554 ts_tablet_manager.cc:1403] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:21:33.785799 23554 raft_consensus.cc:359] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:33.786286 23554 raft_consensus.cc:740] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.786844 23554 consensus_queue.cc:260] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:33.788370 23554 ts_tablet_manager.cc:1434] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:21:33.788957 23554 tablet_bootstrap.cc:492] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.809031 23554 tablet_bootstrap.cc:492] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.809803 23554 tablet_bootstrap.cc:492] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.810297 23554 ts_tablet_manager.cc:1403] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 13:21:33.812151 23554 raft_consensus.cc:359] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:33.812655 23554 raft_consensus.cc:740] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.813155 23554 consensus_queue.cc:260] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:33.814973 23554 ts_tablet_manager.cc:1434] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:33.815719 23554 tablet_bootstrap.cc:492] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.828039 23554 tablet_bootstrap.cc:492] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.829269 23554 tablet_bootstrap.cc:492] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.829873 23554 ts_tablet_manager.cc:1403] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:21:33.832012 23554 raft_consensus.cc:359] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.832665 23554 raft_consensus.cc:740] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.833657 23554 consensus_queue.cc:260] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.835495 23554 ts_tablet_manager.cc:1434] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:33.836229 23554 tablet_bootstrap.cc:492] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.848785 23554 tablet_bootstrap.cc:492] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.849581 23554 tablet_bootstrap.cc:492] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.850117 23554 ts_tablet_manager.cc:1403] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:21:33.852289 23554 raft_consensus.cc:359] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.852850 23554 raft_consensus.cc:740] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.853327 23554 consensus_queue.cc:260] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.854664 23554 ts_tablet_manager.cc:1434] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:33.855299 23554 tablet_bootstrap.cc:492] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.866006 23554 tablet_bootstrap.cc:492] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.866676 23554 tablet_bootstrap.cc:492] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.867167 23554 ts_tablet_manager.cc:1403] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:21:33.868968 23554 raft_consensus.cc:359] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.869503 23554 raft_consensus.cc:740] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.869993 23554 consensus_queue.cc:260] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.871495 23554 ts_tablet_manager.cc:1434] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.000s
I20260709 13:21:33.872152 23554 tablet_bootstrap.cc:492] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.889027 23554 tablet_bootstrap.cc:492] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.889920 23554 tablet_bootstrap.cc:492] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.890502 23554 ts_tablet_manager.cc:1403] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:21:33.892871 23554 raft_consensus.cc:359] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:33.893527 23554 raft_consensus.cc:740] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.894275 23554 consensus_queue.cc:260] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:33.896395 23554 ts_tablet_manager.cc:1434] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:33.897101 23554 tablet_bootstrap.cc:492] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.914462 15720 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:21:33.914904 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.224s	user 0.200s	sys 0.005s
I20260709 13:21:33.918659 23554 tablet_bootstrap.cc:492] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.919457 23554 tablet_bootstrap.cc:492] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.920022 23554 ts_tablet_manager.cc:1403] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.008s
I20260709 13:21:33.921921 23554 raft_consensus.cc:359] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:33.922389 23554 raft_consensus.cc:740] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.922971 23554 consensus_queue.cc:260] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:33.924755 23554 ts_tablet_manager.cc:1434] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:33.925549 23554 tablet_bootstrap.cc:492] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.939989 23554 tablet_bootstrap.cc:492] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.940915 23554 tablet_bootstrap.cc:492] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.941534 23554 ts_tablet_manager.cc:1403] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:21:33.943869 23554 raft_consensus.cc:359] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:33.944535 23554 raft_consensus.cc:740] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.945181 23554 consensus_queue.cc:260] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:33.947216 23554 ts_tablet_manager.cc:1434] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:33.948598 23554 tablet_bootstrap.cc:492] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.962605 23554 tablet_bootstrap.cc:492] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.963307 23554 tablet_bootstrap.cc:492] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.963886 23554 ts_tablet_manager.cc:1403] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:21:33.966300 23554 raft_consensus.cc:359] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:33.966913 23554 raft_consensus.cc:740] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.967655 23554 consensus_queue.cc:260] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:33.969450 23554 ts_tablet_manager.cc:1434] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:21:33.970201 23554 tablet_bootstrap.cc:492] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:33.982250 23554 tablet_bootstrap.cc:492] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:33.983080 23554 tablet_bootstrap.cc:492] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:33.983623 23554 ts_tablet_manager.cc:1403] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 13:21:33.985532 23554 raft_consensus.cc:359] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.986049 23554 raft_consensus.cc:740] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:33.986688 23554 consensus_queue.cc:260] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:33.988473 23554 ts_tablet_manager.cc:1434] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:33.989116 23554 tablet_bootstrap.cc:492] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:34.000736 23554 tablet_bootstrap.cc:492] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:34.001678 23554 tablet_bootstrap.cc:492] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:34.002292 23554 ts_tablet_manager.cc:1403] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:21:34.004623 23554 raft_consensus.cc:359] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:34.005431 23554 raft_consensus.cc:740] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.006129 23554 consensus_queue.cc:260] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:34.008273 23554 ts_tablet_manager.cc:1434] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:21:34.009007 23554 tablet_bootstrap.cc:492] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:34.013375 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.1:34811
I20260709 13:21:34.013527 23629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.1:34811 every 8 connection(s)
I20260709 13:21:34.034055 23554 tablet_bootstrap.cc:492] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:34.035187 23554 tablet_bootstrap.cc:492] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:34.035987 23554 ts_tablet_manager.cc:1403] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 13:21:34.038371 23554 raft_consensus.cc:359] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.039080 23554 raft_consensus.cc:740] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.039829 23554 consensus_queue.cc:260] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.042228 23554 ts_tablet_manager.cc:1434] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:21:34.042999 23554 tablet_bootstrap.cc:492] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:34.048868 23630 heartbeater.cc:344] Connected to a master server at 127.15.90.62:36463
I20260709 13:21:34.049358 23630 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:34.050258 23630 heartbeater.cc:507] Master 127.15.90.62:36463 requested a full tablet report, sending...
I20260709 13:21:34.057538 23554 tablet_bootstrap.cc:492] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:34.058337 23554 tablet_bootstrap.cc:492] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:34.058915 23554 ts_tablet_manager.cc:1403] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:21:34.061218 23554 raft_consensus.cc:359] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.062196 23554 raft_consensus.cc:740] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.062860 23554 consensus_queue.cc:260] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.065145 23554 ts_tablet_manager.cc:1434] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:21:34.065946 23554 tablet_bootstrap.cc:492] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:34.066793 22672 ts_manager.cc:194] Re-registered known tserver with Master: e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.084723 23554 tablet_bootstrap.cc:492] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:34.085726 23554 tablet_bootstrap.cc:492] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:34.086377 23554 ts_tablet_manager.cc:1403] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:21:34.088773 23554 raft_consensus.cc:359] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.089432 23554 raft_consensus.cc:740] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.090050 23554 consensus_queue.cc:260] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.092052 23554 ts_tablet_manager.cc:1434] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:21:34.092790 23554 tablet_bootstrap.cc:492] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:34.111833 23555 raft_consensus.cc:493] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.112895 23555 raft_consensus.cc:515] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.115795 23555 leader_election.cc:290] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.115940 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.117889 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:34.119050 22966 leader_election.cc:343] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.119398 22966 leader_election.cc:304] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.120133 23555 raft_consensus.cc:2749] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.121799 23554 tablet_bootstrap.cc:492] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:34.122154 22672 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58572
I20260709 13:21:34.122763 23554 tablet_bootstrap.cc:492] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:34.123445 23554 ts_tablet_manager.cc:1403] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.008s
I20260709 13:21:34.125540 23554 raft_consensus.cc:359] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.126057 23554 raft_consensus.cc:740] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.126629 23630 heartbeater.cc:499] Master 127.15.90.62:36463 was elected leader, sending a full tablet report...
I20260709 13:21:34.126605 23554 consensus_queue.cc:260] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.128221 23554 ts_tablet_manager.cc:1434] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:34.128834 23554 tablet_bootstrap.cc:492] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:34.129940 23558 raft_consensus.cc:493] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.130458 23558 raft_consensus.cc:515] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.132686 23558 leader_election.cc:290] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:34.134209 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.136849 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.137578 23603 raft_consensus.cc:2468] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:34.142004 22818 leader_election.cc:304] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:34.143147 23557 raft_consensus.cc:2804] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.143540 23557 raft_consensus.cc:493] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.143939 23557 raft_consensus.cc:3060] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.147002 23554 tablet_bootstrap.cc:492] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:34.148010 23554 tablet_bootstrap.cc:492] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:34.148677 23554 ts_tablet_manager.cc:1403] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.007s
I20260709 13:21:34.151129 23554 raft_consensus.cc:359] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:34.151801 23554 raft_consensus.cc:740] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.152470 23554 consensus_queue.cc:260] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:34.154543 23554 ts_tablet_manager.cc:1434] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:21:34.155254 23554 tablet_bootstrap.cc:492] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:34.161082 23557 raft_consensus.cc:515] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.163257 23557 leader_election.cc:290] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:34.164525 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:34.166662 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.167250 23604 raft_consensus.cc:3060] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.186826 23604 raft_consensus.cc:2468] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 2.
I20260709 13:21:34.187469 23512 raft_consensus.cc:493] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.187975 22818 leader_election.cc:304] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:34.188323 23512 raft_consensus.cc:515] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.189378 23558 raft_consensus.cc:2804] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.190311 23558 raft_consensus.cc:697] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:34.191195 23558 consensus_queue.cc:237] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.192065 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:34.197506 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.195724 23512 leader_election.cc:290] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
W20260709 13:21:34.198913 22892 leader_election.cc:343] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.200148 23053 raft_consensus.cc:493] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.200829 23053 raft_consensus.cc:515] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.200171 22892 leader_election.cc:304] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:34.202428 23512 raft_consensus.cc:2749] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.209599 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.209573 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.211640 22926 raft_consensus.cc:2468] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
W20260709 13:21:34.211905 22966 leader_election.cc:343] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.212998 23053 leader_election.cc:290] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.213184 22964 leader_election.cc:304] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.214398 23467 raft_consensus.cc:493] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.214967 23467 raft_consensus.cc:515] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.217840 23467 leader_election.cc:290] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:34.218974 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.219882 23053 raft_consensus.cc:2804] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.221808 23053 raft_consensus.cc:493] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.222205 23053 raft_consensus.cc:3060] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.225979 23512 raft_consensus.cc:493] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.226644 23512 raft_consensus.cc:515] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.231637 23081 raft_consensus.cc:493] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.231876 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.232164 23081 raft_consensus.cc:515] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:34.233551 22892 leader_election.cc:343] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.234068 23081 leader_election.cc:290] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.225592 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.235265 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.235517 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:34.236198 23602 raft_consensus.cc:2393] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 2: Already voted for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in this term.
W20260709 13:21:34.237181 22818 leader_election.cc:343] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.237555 22892 leader_election.cc:304] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.237593 22818 leader_election.cc:304] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.239491 23470 raft_consensus.cc:3060] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.239928 23557 raft_consensus.cc:2749] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.235301 23512 leader_election.cc:290] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.243904 23053 raft_consensus.cc:515] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.250622 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:34.231452 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:34.251224 22925 raft_consensus.cc:3060] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.252604 22890 leader_election.cc:304] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:34.253578 23081 raft_consensus.cc:2749] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.256484 23512 raft_consensus.cc:493] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.256670 23081 raft_consensus.cc:493] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.257064 23512 raft_consensus.cc:515] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.257129 23081 raft_consensus.cc:515] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.260360 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.261602 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
W20260709 13:21:34.261839 22892 leader_election.cc:343] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:34.262941 22892 leader_election.cc:343] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.263651 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:34.264544 23512 leader_election.cc:290] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.267231 23512 raft_consensus.cc:493] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.267743 23512 raft_consensus.cc:515] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.265427 22890 leader_election.cc:304] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.265717 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:34.266682 22925 raft_consensus.cc:2468] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 2.
I20260709 13:21:34.269718 22890 leader_election.cc:304] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.250701 23470 raft_consensus.cc:2749] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.271162 23352 raft_consensus.cc:493] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.271653 23352 raft_consensus.cc:515] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.273609 23352 leader_election.cc:290] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.272645 22674 catalog_manager.cc:5697] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.274556 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.272043 23470 raft_consensus.cc:2749] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.278985 23470 raft_consensus.cc:2749] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.281195 23470 raft_consensus.cc:493] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.283110 23470 raft_consensus.cc:515] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.283636 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.279906 23512 leader_election.cc:290] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.285108 23512 raft_consensus.cc:493] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.285609 23512 raft_consensus.cc:515] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.298319 23512 leader_election.cc:290] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
W20260709 13:21:34.286516 22966 leader_election.cc:343] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.303519 23554 tablet_bootstrap.cc:492] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:34.287079 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ba45a5de4dfdab02fd99a9ba3976" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.265112 23081 leader_election.cc:290] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.282356 23053 leader_election.cc:290] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.299031 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:34.300490 23352 raft_consensus.cc:493] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.302074 23643 raft_consensus.cc:493] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.302691 23555 raft_consensus.cc:493] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.303841 22964 leader_election.cc:304] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:34.304569 23467 raft_consensus.cc:493] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.304759 23470 leader_election.cc:290] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
W20260709 13:21:34.306308 22892 leader_election.cc:343] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.307621 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:34.312676 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:34.311275 23352 raft_consensus.cc:515] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:34.319634 23081 raft_consensus.cc:493] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.317323 23554 tablet_bootstrap.cc:492] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:34.320137 23081 raft_consensus.cc:515] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.320734 23554 ts_tablet_manager.cc:1403] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.166s	user 0.053s	sys 0.069s
I20260709 13:21:34.310124 23558 raft_consensus.cc:493] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.316416 23467 raft_consensus.cc:515] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.319119 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.322376 22925 raft_consensus.cc:2468] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:34.322507 22850 raft_consensus.cc:2468] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:34.324551 23053 raft_consensus.cc:2804] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.325173 23053 raft_consensus.cc:697] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:34.318125 23555 raft_consensus.cc:515] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:34.327536 22966 leader_election.cc:343] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.332211 23081 leader_election.cc:290] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.326114 23053 consensus_queue.cc:237] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.341687 22890 leader_election.cc:304] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.342643 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:34.343382 22850 raft_consensus.cc:2468] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:34.344237 23352 leader_election.cc:290] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.344796 23352 raft_consensus.cc:493] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.346206 23081 raft_consensus.cc:2804] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.346578 23081 raft_consensus.cc:493] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.346904 23081 raft_consensus.cc:3060] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.345198 23352 raft_consensus.cc:515] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:34.353276 22964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:34985, user_credentials={real_user=slave}} blocked reactor thread for 49513.5us
I20260709 13:21:34.355393 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.356055 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.356324 23601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.356410 23600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.332090 23558 raft_consensus.cc:515] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:34.332409 23643 raft_consensus.cc:515] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.358397 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.358676 23352 leader_election.cc:290] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.359817 23643 leader_election.cc:290] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.360425 23467 leader_election.cc:290] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:34.342680 23644 raft_consensus.cc:493] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.361002 23644 raft_consensus.cc:515] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.362015 22925 raft_consensus.cc:2468] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:34.357707 23554 raft_consensus.cc:359] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:34.361014 22966 leader_election.cc:343] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.363258 23554 raft_consensus.cc:740] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.365653 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:34.368647 23558 leader_election.cc:290] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.370380 23554 consensus_queue.cc:260] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:34.372669 22892 leader_election.cc:343] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.372895 23554 ts_tablet_manager.cc:1434] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:21:34.373301 22892 leader_election.cc:304] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:34.373967 23554 tablet_bootstrap.cc:492] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
W20260709 13:21:34.374720 22892 leader_election.cc:343] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.376088 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.376948 23604 raft_consensus.cc:2468] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:34.378571 23512 raft_consensus.cc:2749] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.378681 23555 leader_election.cc:290] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.379251 23081 raft_consensus.cc:515] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.378705 22890 leader_election.cc:304] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:34.380795 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:34.381548 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:34.381839 23643 raft_consensus.cc:2804] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.382134 22997 raft_consensus.cc:2468] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:34.382167 22964 leader_election.cc:304] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.383985 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.384559 22964 leader_election.cc:304] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:34.384604 23603 raft_consensus.cc:2468] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:34.385787 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.386372 23644 leader_election.cc:290] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.386451 23646 raft_consensus.cc:2804] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.387001 23646 raft_consensus.cc:493] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.387245 22966 leader_election.cc:304] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:34.387423 23646 raft_consensus.cc:3060] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.388360 23352 raft_consensus.cc:2804] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.383988 23555 raft_consensus.cc:2804] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.389138 23555 raft_consensus.cc:493] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.389557 23555 raft_consensus.cc:3060] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.388697 23352 raft_consensus.cc:493] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.391146 23352 raft_consensus.cc:3060] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.392220 22890 leader_election.cc:304] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:34.392866 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.393389 23644 raft_consensus.cc:2804] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.393918 23644 raft_consensus.cc:493] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.394363 23644 raft_consensus.cc:3060] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.398450 23646 raft_consensus.cc:515] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.400004 23600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.400564 23643 raft_consensus.cc:493] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.400775 23646 leader_election.cc:290] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.400983 23643 raft_consensus.cc:3060] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.402267 23081 leader_election.cc:290] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.405612 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.406314 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:34.375263 22892 leader_election.cc:304] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
W20260709 13:21:34.407934 22892 leader_election.cc:343] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.408003 23352 raft_consensus.cc:515] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.409013 22892 leader_election.cc:304] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:34.409763 23512 raft_consensus.cc:2749] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.409906 23352 leader_election.cc:290] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.410419 23512 raft_consensus.cc:2804] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.410802 23512 raft_consensus.cc:493] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.411180 23512 raft_consensus.cc:3060] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.412127 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
W20260709 13:21:34.405056 22818 leader_election.cc:343] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.413436 22818 leader_election.cc:304] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:34.415192 23648 raft_consensus.cc:2749] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.415285 23555 raft_consensus.cc:515] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:34.417511 22818 leader_election.cc:343] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.418815 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:34.419529 22926 raft_consensus.cc:3060] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:34.424212 22966 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.427968 23600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.428345 22926 raft_consensus.cc:2468] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 2.
I20260709 13:21:34.428659 23600 raft_consensus.cc:3060] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.428840 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.429697 23554 tablet_bootstrap.cc:492] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:34.430298 22964 leader_election.cc:304] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:34.430614 23554 tablet_bootstrap.cc:492] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:34.431041 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.431480 23554 ts_tablet_manager.cc:1403] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.003s
I20260709 13:21:34.431578 23555 leader_election.cc:290] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.431143 23646 raft_consensus.cc:2804] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.431939 22922 raft_consensus.cc:2393] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 2: Already voted for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in this term.
I20260709 13:21:34.432060 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffa363e792404ff6b11c80dfb5d5d33e" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.432353 23646 raft_consensus.cc:697] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:34.433187 23646 consensus_queue.cc:237] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.438941 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.440008 22816 leader_election.cc:304] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.441695 23650 raft_consensus.cc:3060] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.442600 23467 raft_consensus.cc:493] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.442967 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.443077 23467 raft_consensus.cc:515] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.443603 23643 raft_consensus.cc:515] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.445253 23467 leader_election.cc:290] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
W20260709 13:21:34.447726 22966 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.448120 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5b8344825d146b8b8c05ae651fb0d9a" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
W20260709 13:21:34.448644 22966 leader_election.cc:343] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.448803 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:34.449360 22852 raft_consensus.cc:3060] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.449589 23512 raft_consensus.cc:515] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.450031 23650 raft_consensus.cc:2749] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.452258 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:34.457652 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.457815 22852 raft_consensus.cc:2468] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:34.458324 22922 raft_consensus.cc:2468] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:34.459266 23555 raft_consensus.cc:493] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.459540 22890 leader_election.cc:304] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:34.460316 23555 raft_consensus.cc:515] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:34.460915 23642 raft_consensus.cc:2804] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.461583 23642 raft_consensus.cc:697] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:34.462276 23555 leader_election.cc:290] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.462551 23642 consensus_queue.cc:237] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.463195 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.468498 22850 raft_consensus.cc:2468] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:34.471850 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.472537 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a393acc19e45f49ed5e6b17ee64d81" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
W20260709 13:21:34.474252 22818 leader_election.cc:343] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.475313 23600 raft_consensus.cc:2468] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 2.
W20260709 13:21:34.476478 22966 leader_election.cc:343] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:34.462316 22892 leader_election.cc:343] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:34.478416 22892 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.479117 22966 leader_election.cc:304] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:34.479924 23555 raft_consensus.cc:2804] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.480425 23555 raft_consensus.cc:697] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:34.481593 22890 leader_election.cc:304] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.481273 23555 consensus_queue.cc:237] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.491981 23512 leader_election.cc:290] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.453806 23554 raft_consensus.cc:359] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:34.501246 23554 raft_consensus.cc:740] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.502184 23470 raft_consensus.cc:2804] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.502933 23470 raft_consensus.cc:697] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
W20260709 13:21:34.479282 22892 leader_election.cc:343] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.504112 23470 consensus_queue.cc:237] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.505318 22816 leader_election.cc:304] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.506321 23650 raft_consensus.cc:2804] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.506732 23650 raft_consensus.cc:493] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.507146 23650 raft_consensus.cc:3060] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.507781 23643 leader_election.cc:290] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.514430 22672 catalog_manager.cc:5697] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.518280 23467 raft_consensus.cc:493] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.518743 23467 raft_consensus.cc:515] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.520906 23081 raft_consensus.cc:493] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.525833 23081 raft_consensus.cc:515] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.520246 23554 consensus_queue.cc:260] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:34.529307 23352 raft_consensus.cc:493] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.529801 23352 raft_consensus.cc:515] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.532167 23467 leader_election.cc:290] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:34.532917 23554 ts_tablet_manager.cc:1434] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.000s
I20260709 13:21:34.531968 23600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.542127 23081 leader_election.cc:290] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.542670 23081 raft_consensus.cc:493] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.542721 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:34.543393 23081 raft_consensus.cc:515] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.547519 23352 leader_election.cc:290] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.531299 23644 raft_consensus.cc:515] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.564103 23081 leader_election.cc:290] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.564652 23081 raft_consensus.cc:493] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.546610 23600 raft_consensus.cc:3060] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.565053 23081 raft_consensus.cc:515] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.565482 23644 leader_election.cc:290] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.566154 23646 raft_consensus.cc:493] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.566839 23081 leader_election.cc:290] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.566630 23646 raft_consensus.cc:515] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.567201 22925 raft_consensus.cc:2393] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f825e4bed376497e95838e1b82dc1a03 in current term 2: Already voted for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in this term.
I20260709 13:21:34.568604 23646 leader_election.cc:290] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.570055 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf330fe4b59c472a9c3bcb18161ff906" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:34.570640 22850 raft_consensus.cc:2468] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:34.570724 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:34.571460 22999 raft_consensus.cc:2393] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 2: Already voted for candidate f825e4bed376497e95838e1b82dc1a03 in this term.
I20260709 13:21:34.571769 22890 leader_election.cc:304] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:34.572317 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:34.572877 23554 tablet_bootstrap.cc:492] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:34.573453 23081 raft_consensus.cc:2804] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.573817 23081 raft_consensus.cc:493] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.574133 23081 raft_consensus.cc:3060] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.572921 22997 raft_consensus.cc:2468] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:34.575392 22890 leader_election.cc:304] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:34.576135 23644 raft_consensus.cc:2804] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.576471 23644 raft_consensus.cc:493] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.576817 23644 raft_consensus.cc:3060] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.579190 23601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.582144 23557 raft_consensus.cc:493] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.548784 23643 raft_consensus.cc:493] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.582684 23557 raft_consensus.cc:515] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.582927 23643 raft_consensus.cc:515] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.544970 23467 raft_consensus.cc:493] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.586036 23467 raft_consensus.cc:515] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
W20260709 13:21:34.586527 22966 leader_election.cc:343] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.587369 23081 raft_consensus.cc:515] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.595877 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.596670 22925 raft_consensus.cc:2468] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:34.597038 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf330fe4b59c472a9c3bcb18161ff906" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:34.597808 22850 raft_consensus.cc:3060] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.601197 22816 leader_election.cc:304] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:34.607757 22850 raft_consensus.cc:2468] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:34.609191 22890 leader_election.cc:304] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:34.579257 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.593876 22964 leader_election.cc:304] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.546571 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.611753 23081 leader_election.cc:290] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.591187 23642 raft_consensus.cc:493] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.612380 23512 raft_consensus.cc:2804] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.615610 23467 leader_election.cc:290] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.621510 23467 raft_consensus.cc:2804] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.621992 23467 raft_consensus.cc:493] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.622287 23467 raft_consensus.cc:3060] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.623852 23053 raft_consensus.cc:493] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.624622 23053 raft_consensus.cc:515] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.617796 23646 raft_consensus.cc:2749] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.630448 23557 leader_election.cc:290] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:34.633620 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.646951 22925 raft_consensus.cc:2468] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:34.647064 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:34.634910 23650 raft_consensus.cc:515] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.636083 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.641742 23600 raft_consensus.cc:2468] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:34.643846 23643 leader_election.cc:290] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.647969 22850 raft_consensus.cc:2468] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
I20260709 13:21:34.648245 22926 raft_consensus.cc:2468] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:34.621255 23558 raft_consensus.cc:493] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.619665 23602 raft_consensus.cc:2468] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:34.655742 22890 leader_election.cc:304] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:34.629457 23512 raft_consensus.cc:697] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:34.620016 23642 raft_consensus.cc:515] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.662837 22966 leader_election.cc:304] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
W20260709 13:21:34.666332 22816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:34985, user_credentials={real_user=slave}} blocked reactor thread for 65246.8us
I20260709 13:21:34.668655 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
I20260709 13:21:34.659276 23643 raft_consensus.cc:2804] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.669339 22997 raft_consensus.cc:2468] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:34.669981 23467 raft_consensus.cc:515] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.671540 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.657938 23558 raft_consensus.cc:515] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.677002 23598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.677196 23596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.678228 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.698415 23470 raft_consensus.cc:493] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.699005 23470 raft_consensus.cc:515] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:34.700513 22818 leader_election.cc:343] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.701220 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03" is_pre_election: true
W20260709 13:21:34.701719 22818 leader_election.cc:343] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.701908 23600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.703011 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.703570 23470 leader_election.cc:290] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.678851 23642 leader_election.cc:290] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.667652 23555 raft_consensus.cc:2804] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.671090 23643 raft_consensus.cc:493] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.704926 23597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf330fe4b59c472a9c3bcb18161ff906" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.705238 23643 raft_consensus.cc:3060] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.705590 23597 raft_consensus.cc:3060] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.670364 23601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf330fe4b59c472a9c3bcb18161ff906" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.706609 23467 leader_election.cc:290] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:34.673707 22964 leader_election.cc:304] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.707782 23600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd6f22ac074dedac9f3eb3ccc1bb80" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.708580 23600 raft_consensus.cc:2393] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 2: Already voted for candidate f825e4bed376497e95838e1b82dc1a03 in this term.
I20260709 13:21:34.709065 23646 raft_consensus.cc:2804] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.709451 23646 raft_consensus.cc:493] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.707751 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:34.709843 23646 raft_consensus.cc:3060] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.710217 23596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.695647 23650 leader_election.cc:290] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:34.684516 23512 consensus_queue.cc:237] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.676853 23648 raft_consensus.cc:493] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.704161 23595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.717954 22892 leader_election.cc:304] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:34.711635 22671 catalog_manager.cc:5697] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:34.725102 22818 leader_election.cc:343] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.727238 22850 raft_consensus.cc:2468] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 1.
W20260709 13:21:34.720646 22892 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.728266 22892 leader_election.cc:304] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:34.727269 23642 raft_consensus.cc:2804] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.704939 23555 raft_consensus.cc:493] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.731408 22890 leader_election.cc:304] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
W20260709 13:21:34.732177 22818 leader_election.cc:343] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:34.731839 22892 leader_election.cc:343] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.733995 23081 raft_consensus.cc:2804] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.734562 23081 raft_consensus.cc:493] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.735034 23081 raft_consensus.cc:3060] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.734520 22892 leader_election.cc:304] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.735901 23053 leader_election.cc:290] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.718675 23648 raft_consensus.cc:515] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.737023 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.755524 23658 raft_consensus.cc:2749] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.756654 23648 leader_election.cc:290] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:34.757460 23600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.740933 22926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.732846 23470 raft_consensus.cc:2749] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.743623 23558 leader_election.cc:290] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:34.733429 23642 raft_consensus.cc:697] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:34.783056 23642 consensus_queue.cc:237] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.744308 23595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.729676 23644 raft_consensus.cc:515] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.786448 22671 catalog_manager.cc:5697] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.789709 23644 leader_election.cc:290] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.790561 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:34.791118 22999 raft_consensus.cc:3060] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.792507 22924 raft_consensus.cc:1275] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer f825e4bed376497e95838e1b82dc1a03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.794203 23053 consensus_queue.cc:1048] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:34.759765 22892 leader_election.cc:304] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6; no voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03
I20260709 13:21:34.758109 23600 raft_consensus.cc:2468] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:34.761073 23597 raft_consensus.cc:2468] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:34.797799 23597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.803099 23644 raft_consensus.cc:3060] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:34.765179 22818 leader_election.cc:343] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.758129 23646 raft_consensus.cc:515] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
W20260709 13:21:34.804813 22818 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:34811, user_credentials={real_user=slave}} blocked reactor thread for 44566.8us
I20260709 13:21:34.805275 22816 leader_election.cc:304] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.806262 23646 leader_election.cc:290] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.806597 23558 raft_consensus.cc:2804] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.806988 23558 raft_consensus.cc:493] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.769266 23596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f864d0fd88e94640a4e91ad8ebdb19d6" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:34.808089 23596 raft_consensus.cc:2393] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f825e4bed376497e95838e1b82dc1a03 in current term 2: Already voted for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in this term.
I20260709 13:21:34.808322 22818 leader_election.cc:304] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:34.807411 23558 raft_consensus.cc:3060] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.733907 23555 raft_consensus.cc:3060] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.809063 23650 raft_consensus.cc:2804] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.809445 23650 raft_consensus.cc:493] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.789055 22671 catalog_manager.cc:5697] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:34.809777 23650 raft_consensus.cc:3060] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.810133 23554 tablet_bootstrap.cc:492] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:34.811067 23554 tablet_bootstrap.cc:492] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:34.806843 22999 raft_consensus.cc:2468] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:34.812930 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:34.813481 22923 raft_consensus.cc:3060] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.813676 22890 leader_election.cc:304] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:34.815910 23470 raft_consensus.cc:2804] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.816365 23470 raft_consensus.cc:697] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:34.817152 23470 consensus_queue.cc:237] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.817452 23555 raft_consensus.cc:515] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.820315 23554 ts_tablet_manager.cc:1403] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.248s	user 0.020s	sys 0.015s
I20260709 13:21:34.820151 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:34.820919 22922 raft_consensus.cc:3060] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.821105 23558 raft_consensus.cc:515] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:34.823222 23558 leader_election.cc:290] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.823206 23554 raft_consensus.cc:359] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.824082 23554 raft_consensus.cc:740] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:34.824697 23554 consensus_queue.cc:260] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.828370 22996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:34.828960 22996 raft_consensus.cc:3060] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.832341 23555 leader_election.cc:290] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:34.843288 23554 ts_tablet_manager.cc:1434] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:21:34.844673 23554 tablet_bootstrap.cc:492] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:34.849681 23600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028d1f3901024609a35947274e016368" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
W20260709 13:21:34.854496 22966 leader_election.cc:343] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:34.803171 22892 leader_election.cc:343] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:34.871137 22892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.1:34811, user_credentials={real_user=slave}} blocked reactor thread for 67988.8us
I20260709 13:21:34.871439 22923 raft_consensus.cc:2468] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 2.
I20260709 13:21:34.874173 22964 leader_election.cc:304] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
W20260709 13:21:34.874441 22818 leader_election.cc:343] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.874940 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.875595 23603 raft_consensus.cc:3060] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.877964 23081 raft_consensus.cc:515] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.883203 22923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:34.885416 22923 raft_consensus.cc:3060] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.888689 22850 raft_consensus.cc:1275] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.892215 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:34.892830 22850 raft_consensus.cc:2468] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 1.
I20260709 13:21:34.900254 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:34.900949 22927 raft_consensus.cc:3060] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.901381 22996 raft_consensus.cc:2468] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 2.
I20260709 13:21:34.896306 22923 raft_consensus.cc:2468] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 2.
I20260709 13:21:34.902976 23081 leader_election.cc:290] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.903885 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" is_pre_election: true
I20260709 13:21:34.904686 22852 raft_consensus.cc:2393] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f825e4bed376497e95838e1b82dc1a03 in current term 2: Already voted for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in this term.
I20260709 13:21:34.884486 23555 raft_consensus.cc:2804] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.905388 23643 raft_consensus.cc:515] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:34.905905 23555 raft_consensus.cc:697] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:34.906781 23555 consensus_queue.cc:237] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.907950 22925 raft_consensus.cc:2393] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 2: Already voted for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in this term.
I20260709 13:21:34.910672 22816 leader_election.cc:304] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:34.914235 22964 leader_election.cc:304] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.915620 23647 raft_consensus.cc:2804] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:34.916008 23647 raft_consensus.cc:493] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:34.916361 23647 raft_consensus.cc:3060] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.916764 23596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c86d847eb114cb684092a456952e795" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.919829 23595 raft_consensus.cc:1275] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Refusing update from remote peer 8f307730e7ab4bab9c70d9fa3e51dd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:34.920006 23600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29fe64535814ccd8d9f4f20f00c6f1d" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.912096 22922 raft_consensus.cc:2468] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 2.
I20260709 13:21:34.923071 23664 raft_consensus.cc:2804] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.923847 23664 raft_consensus.cc:697] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:34.924027 22964 leader_election.cc:304] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:34.924934 23646 raft_consensus.cc:2804] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.925554 23646 raft_consensus.cc:697] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:34.924971 23664 consensus_queue.cc:237] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:34.926399 23646 consensus_queue.cc:237] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:34.907474 23643 leader_election.cc:290] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:34.932027 23467 consensus_queue.cc:1048] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:21:34.934012 22818 leader_election.cc:343] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.930570 23650 raft_consensus.cc:515] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:34.937942 22966 consensus_peers.cc:597] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:34.939121 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.939850 22925 raft_consensus.cc:2468] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 1.
I20260709 13:21:34.940621 22922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:34.941393 22922 raft_consensus.cc:2393] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 2: Already voted for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in this term.
W20260709 13:21:34.942361 22892 leader_election.cc:343] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:21:34.944536 22892 leader_election.cc:343] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.945715 22816 leader_election.cc:304] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.948462 22964 leader_election.cc:304] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.950943 23352 raft_consensus.cc:2749] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.905349 23603 raft_consensus.cc:2468] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 2.
I20260709 13:21:34.953167 23467 raft_consensus.cc:2804] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:34.953229 22816 leader_election.cc:304] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.957666 22816 leader_election.cc:304] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:34.970996 23660 raft_consensus.cc:3060] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.948467 23650 leader_election.cc:290] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:34.972494 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.973193 23602 raft_consensus.cc:3060] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:34.973412 23601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:34.973723 23644 raft_consensus.cc:2749] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:34.974037 22921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:34.980756 22921 raft_consensus.cc:2393] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 2: Already voted for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in this term.
I20260709 13:21:34.981144 23602 raft_consensus.cc:2468] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:34.978716 23660 raft_consensus.cc:2749] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:21:34.988441 22892 leader_election.cc:343] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:34.992524 22892 leader_election.cc:304] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
W20260709 13:21:35.002234 22890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:43687, user_credentials={real_user=slave}} blocked reactor thread for 116272us
I20260709 13:21:35.005029 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:35.005510 23467 raft_consensus.cc:697] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:35.006060 22852 raft_consensus.cc:2393] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 618c2d1f207e45ddbb25be76c9d4edf6 in current term 2: Already voted for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in this term.
I20260709 13:21:35.001482 23657 raft_consensus.cc:2804] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:35.060331 23467 consensus_queue.cc:237] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:35.082666 22816 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.15.90.3:34985, user_credentials={real_user=slave}} blocked reactor thread for 125087us
I20260709 13:21:35.059528 23650 raft_consensus.cc:2804] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:35.081741 22852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e393e8c4349b473abd5f35159d141168" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:34.996984 23647 raft_consensus.cc:515] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:35.062376 23657 raft_consensus.cc:697] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
W20260709 13:21:35.094746 22964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:43687, user_credentials={real_user=slave}} blocked reactor thread for 143680us
I20260709 13:21:35.092320 23650 raft_consensus.cc:493] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:35.097553 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:35.082217 23658 consensus_queue.cc:1048] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:21:35.107280 22921 raft_consensus.cc:1275] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer 8f307730e7ab4bab9c70d9fa3e51dd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.107502 22852 raft_consensus.cc:2468] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:35.114213 23602 raft_consensus.cc:2393] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in current term 2: Already voted for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in this term.
I20260709 13:21:35.114562 22927 raft_consensus.cc:2468] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 2.
I20260709 13:21:35.115326 22818 leader_election.cc:304] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:35.116547 23660 raft_consensus.cc:2749] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:35.111517 23554 tablet_bootstrap.cc:492] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:21:35.119382 22966 consensus_peers.cc:597] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.119786 23657 consensus_queue.cc:237] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:35.123065 22671 catalog_manager.cc:5697] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:35.124444 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:35.124716 22671 catalog_manager.cc:5697] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:35.103102 23650 raft_consensus.cc:3060] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:35.127372 22966 leader_election.cc:343] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:35.131632 23554 tablet_bootstrap.cc:492] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:35.132375 23554 ts_tablet_manager.cc:1403] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.288s	user 0.026s	sys 0.007s
I20260709 13:21:35.116540 23647 leader_election.cc:290] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:35.127074 22671 catalog_manager.cc:5697] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.146636 23677 consensus_queue.cc:1048] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:21:35.146425 22816 leader_election.cc:304] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:35.153882 23677 raft_consensus.cc:2804] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:35.154485 23677 raft_consensus.cc:697] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
W20260709 13:21:35.154928 22892 consensus_peers.cc:597] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.155615 22892 consensus_peers.cc:597] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.160881 22890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:44325, user_credentials={real_user=slave}} blocked reactor thread for 82084.3us
I20260709 13:21:35.165031 22890 leader_election.cc:304] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:35.169059 23081 raft_consensus.cc:2804] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:35.169641 23081 raft_consensus.cc:697] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:35.173249 23081 consensus_queue.cc:237] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:35.177224 23554 raft_consensus.cc:359] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:35.177950 23554 raft_consensus.cc:740] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.178974 23554 consensus_queue.cc:260] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:35.191237 22853 raft_consensus.cc:1275] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.227481 23554 ts_tablet_manager.cc:1434] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.095s	user 0.018s	sys 0.002s
I20260709 13:21:35.228632 23554 tablet_bootstrap.cc:492] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:35.168640 23650 raft_consensus.cc:515] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:35.235175 22671 catalog_manager.cc:5697] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.155478 23677 consensus_queue.cc:237] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:35.270776 22964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:43687, user_credentials={real_user=slave}} blocked reactor thread for 172998us
I20260709 13:21:35.275629 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e34545b8f644c28059e013cdd0590b" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:35.276373 22850 raft_consensus.cc:3060] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.285620 22850 raft_consensus.cc:2468] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 2.
I20260709 13:21:35.254186 23657 consensus_queue.cc:1048] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:21:35.290071 22996 raft_consensus.cc:3060] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.291074 23650 leader_election.cc:290] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Requested vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:35.295101 22927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:35.296016 22927 raft_consensus.cc:3060] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.312378 22996 raft_consensus.cc:1275] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.313488 23597 raft_consensus.cc:1275] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.312528 22921 raft_consensus.cc:1275] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer f825e4bed376497e95838e1b82dc1a03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.315495 22927 raft_consensus.cc:2468] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 2.
I20260709 13:21:35.316076 23658 consensus_queue.cc:1048] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.314656 22964 leader_election.cc:304] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:35.318058 23688 raft_consensus.cc:2749] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:35.322129 22816 leader_election.cc:304] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:35.344125 23467 raft_consensus.cc:2804] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:35.344597 23467 raft_consensus.cc:697] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:35.345346 23467 consensus_queue.cc:237] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:35.347342 22964 leader_election.cc:304] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:35.353008 23555 raft_consensus.cc:2804] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:35.366767 22926 raft_consensus.cc:1275] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer f825e4bed376497e95838e1b82dc1a03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.370973 23597 raft_consensus.cc:1275] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Refusing update from remote peer f825e4bed376497e95838e1b82dc1a03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.346313 23644 consensus_queue.cc:1048] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:21:35.377244 22892 consensus_peers.cc:597] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.395969 22818 consensus_peers.cc:597] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.398355 22850 raft_consensus.cc:1275] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.414996 23053 consensus_queue.cc:1048] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:35.420953 23602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:35.421610 23602 raft_consensus.cc:3060] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.405761 23555 raft_consensus.cc:697] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:35.422534 23555 consensus_queue.cc:237] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:35.412000 23685 consensus_queue.cc:1048] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:21:35.430035 23597 raft_consensus.cc:1275] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.442246 23688 consensus_queue.cc:1048] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:21:35.452198 22671 catalog_manager.cc:5697] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.459776 23602 raft_consensus.cc:2468] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 2.
I20260709 13:21:35.461175 23470 consensus_queue.cc:1048] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.470692 23646 consensus_queue.cc:1048] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.489257 22997 raft_consensus.cc:1275] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.497449 23642 consensus_queue.cc:1048] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:35.506295 22818 consensus_peers.cc:597] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:35.519013 22672 catalog_manager.cc:5697] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.520632 22672 catalog_manager.cc:5697] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:35.541292 22675 catalog_manager.cc:5697] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.549129 22921 raft_consensus.cc:1275] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer f825e4bed376497e95838e1b82dc1a03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.552775 22999 raft_consensus.cc:1275] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer 8f307730e7ab4bab9c70d9fa3e51dd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.552717 22675 catalog_manager.cc:5697] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:35.555321 22675 catalog_manager.cc:5697] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:35.574155 23554 tablet_bootstrap.cc:492] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:35.587173 23554 tablet_bootstrap.cc:492] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:35.590189 23554 ts_tablet_manager.cc:1403] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.362s	user 0.023s	sys 0.003s
I20260709 13:21:35.593981 23603 raft_consensus.cc:1275] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Refusing update from remote peer f825e4bed376497e95838e1b82dc1a03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.569489 23677 consensus_queue.cc:1048] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:21:35.571941 23688 consensus_queue.cc:1048] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:21:35.604672 22849 raft_consensus.cc:1275] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.606516 22925 raft_consensus.cc:1275] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer f825e4bed376497e95838e1b82dc1a03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.606710 23685 consensus_queue.cc:1048] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.611464 23688 consensus_queue.cc:1048] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:21:35.619724 23554 raft_consensus.cc:359] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:35.621590 23554 raft_consensus.cc:740] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.622277 23554 consensus_queue.cc:260] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:35.628073 23696 log.cc:927] Time spent T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49: Append to log took a long time: real 0.126s	user 0.005s	sys 0.000s
I20260709 13:21:35.668984 22921 raft_consensus.cc:1275] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer 8f307730e7ab4bab9c70d9fa3e51dd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.703310 23554 ts_tablet_manager.cc:1434] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.113s	user 0.002s	sys 0.003s
I20260709 13:21:35.706579 23554 tablet_bootstrap.cc:492] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:35.689584 23661 consensus_queue.cc:1048] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:21:35.746347 23604 raft_consensus.cc:1275] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:35.836458 22818 consensus_peers.cc:597] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.840282 22966 consensus_peers.cc:597] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:35.840917 22966 consensus_peers.cc:597] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:35.840927 22818 consensus_peers.cc:597] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:35.841830 23688 consensus_queue.cc:1048] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:21:35.850495 22818 consensus_peers.cc:597] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:35.856271 22892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:34811, user_credentials={real_user=slave}} blocked reactor thread for 86366.7us
W20260709 13:21:35.895282 22892 consensus_peers.cc:597] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.874042 23594 raft_consensus.cc:3060] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:35.898447 23512 consensus_queue.cc:1048] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:35.875789 22818 consensus_peers.cc:597] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:35.876008 22674 catalog_manager.cc:5697] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 2 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.912053 22924 raft_consensus.cc:1275] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer 8f307730e7ab4bab9c70d9fa3e51dd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:35.914075 22966 consensus_peers.cc:597] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:35.914239 22924 raft_consensus.cc:1275] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer 8f307730e7ab4bab9c70d9fa3e51dd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:21:35.888202 22890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.4:44325, user_credentials={real_user=slave}} blocked reactor thread for 137143us
I20260709 13:21:35.921597 23595 raft_consensus.cc:1275] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Refusing update from remote peer 8f307730e7ab4bab9c70d9fa3e51dd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.921350 22671 catalog_manager.cc:5697] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.923035 23661 consensus_queue.cc:1048] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.923211 23558 consensus_queue.cc:1048] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.923431 22671 catalog_manager.cc:5697] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 1 to 2, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:35.937439 23594 raft_consensus.cc:1275] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Refusing update from remote peer 8f307730e7ab4bab9c70d9fa3e51dd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.960279 23558 consensus_queue.cc:1048] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.964519 23664 consensus_queue.cc:1048] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.948800 22853 raft_consensus.cc:1275] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer f825e4bed376497e95838e1b82dc1a03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.955830 23554 tablet_bootstrap.cc:492] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:35.958180 22849 raft_consensus.cc:1275] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:35.981686 23674 consensus_queue.cc:1048] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:35.982246 23554 tablet_bootstrap.cc:492] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:35.983000 23554 ts_tablet_manager.cc:1403] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.277s	user 0.020s	sys 0.036s
I20260709 13:21:35.985489 23554 raft_consensus.cc:359] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:35.986137 23554 raft_consensus.cc:740] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:35.987373 23643 consensus_queue.cc:1048] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:35.992022 23554 consensus_queue.cc:260] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:35.996107 23554 ts_tablet_manager.cc:1434] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:21:36.000526 23554 tablet_bootstrap.cc:492] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
W20260709 13:21:36.032167 22892 consensus_peers.cc:597] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:36.041494 22966 consensus_peers.cc:597] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:36.044018 23724 log.cc:927] Time spent T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:21:36.044816 23554 tablet_bootstrap.cc:492] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.047062 23554 tablet_bootstrap.cc:492] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.047772 23554 ts_tablet_manager.cc:1403] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.000s
I20260709 13:21:36.050653 23554 raft_consensus.cc:359] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.051259 23554 raft_consensus.cc:740] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.052024 23554 consensus_queue.cc:260] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.054174 23554 ts_tablet_manager.cc:1434] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:21:36.054903 23554 tablet_bootstrap.cc:492] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.070477 23554 tablet_bootstrap.cc:492] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.071485 23554 tablet_bootstrap.cc:492] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.072249 23554 ts_tablet_manager.cc:1403] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:21:36.074587 23554 raft_consensus.cc:359] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.075081 23554 raft_consensus.cc:740] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.076009 23554 consensus_queue.cc:260] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.077988 23554 ts_tablet_manager.cc:1434] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:21:36.078629 23554 tablet_bootstrap.cc:492] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.108027 23554 tablet_bootstrap.cc:492] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.109017 23554 tablet_bootstrap.cc:492] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.109642 23554 ts_tablet_manager.cc:1403] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.004s
I20260709 13:21:36.112094 23554 raft_consensus.cc:359] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.112774 23554 raft_consensus.cc:740] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.113251 23554 consensus_queue.cc:260] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.114912 23554 ts_tablet_manager.cc:1434] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:21:36.116065 23554 tablet_bootstrap.cc:492] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.129932 23554 tablet_bootstrap.cc:492] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.130841 23554 tablet_bootstrap.cc:492] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.131470 23554 ts_tablet_manager.cc:1403] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:21:36.133683 23554 raft_consensus.cc:359] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.134153 23554 raft_consensus.cc:740] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.134657 23554 consensus_queue.cc:260] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.136646 23554 ts_tablet_manager.cc:1434] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:36.137645 23554 tablet_bootstrap.cc:492] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.151639 23554 tablet_bootstrap.cc:492] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.152552 23554 tablet_bootstrap.cc:492] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.153236 23554 ts_tablet_manager.cc:1403] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 13:21:36.155544 23554 raft_consensus.cc:359] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:36.156225 23554 raft_consensus.cc:740] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.156857 23554 consensus_queue.cc:260] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:36.158459 23554 ts_tablet_manager.cc:1434] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:21:36.159336 23554 tablet_bootstrap.cc:492] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.171834 23554 tablet_bootstrap.cc:492] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.172756 23554 tablet_bootstrap.cc:492] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.173393 23554 ts_tablet_manager.cc:1403] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:21:36.175504 23554 raft_consensus.cc:359] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
W20260709 13:21:36.175397 22818 consensus_peers.cc:597] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:21:36.176260 23554 raft_consensus.cc:740] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.176959 23554 consensus_queue.cc:260] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:36.179042 23554 ts_tablet_manager.cc:1434] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:36.179979 23554 tablet_bootstrap.cc:492] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.191824 23604 raft_consensus.cc:3060] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:36.193277 23554 tablet_bootstrap.cc:492] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.194222 23554 tablet_bootstrap.cc:492] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.194865 23554 ts_tablet_manager.cc:1403] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 13:21:36.197224 23554 raft_consensus.cc:359] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.197853 23554 raft_consensus.cc:740] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.198482 23554 consensus_queue.cc:260] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.203047 23594 raft_consensus.cc:3060] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:36.208369 23597 raft_consensus.cc:3060] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:36.234346 23053 raft_consensus.cc:493] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:36.235092 23554 ts_tablet_manager.cc:1434] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.027s
I20260709 13:21:36.234922 23053 raft_consensus.cc:515] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.236121 23554 tablet_bootstrap.cc:492] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.236972 23053 leader_election.cc:290] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:36.238673 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" is_pre_election: true
I20260709 13:21:36.239331 22925 raft_consensus.cc:2468] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 2.
I20260709 13:21:36.241020 22964 leader_election.cc:304] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:36.242316 23674 raft_consensus.cc:2804] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:36.242707 23674 raft_consensus.cc:493] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:36.243098 23674 raft_consensus.cc:3060] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:36.248766 23674 raft_consensus.cc:515] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.250375 23597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" is_pre_election: true
I20260709 13:21:36.251120 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:36.251443 23554 tablet_bootstrap.cc:492] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.251645 22925 raft_consensus.cc:3060] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:36.252442 23554 tablet_bootstrap.cc:492] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
W20260709 13:21:36.252385 22966 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:36.253242 23554 ts_tablet_manager.cc:1403] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:21:36.254519 23674 leader_election.cc:290] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:36.254927 23597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b1972dac5349e4b8f76620d14d5d10" candidate_uuid: "f825e4bed376497e95838e1b82dc1a03" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
I20260709 13:21:36.255508 23554 raft_consensus.cc:359] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:36.256340 23554 raft_consensus.cc:740] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
W20260709 13:21:36.256847 22966 leader_election.cc:343] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:36.256995 23554 consensus_queue.cc:260] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:36.260216 23554 ts_tablet_manager.cc:1434] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:21:36.261163 22925 raft_consensus.cc:2468] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f825e4bed376497e95838e1b82dc1a03 in term 3.
I20260709 13:21:36.261298 23554 tablet_bootstrap.cc:492] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.262125 22964 leader_election.cc:304] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:36.262862 23674 raft_consensus.cc:2804] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:36.263389 23674 raft_consensus.cc:697] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 3 LEADER]: Becoming Leader. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:36.264238 23674 consensus_queue.cc:237] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.276242 22671 catalog_manager.cc:5697] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 reported cstate change: term changed from 1 to 3, leader changed from e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1) to f825e4bed376497e95838e1b82dc1a03 (127.15.90.4). New cstate: current_term: 3 leader_uuid: "f825e4bed376497e95838e1b82dc1a03" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:36.277890 23554 tablet_bootstrap.cc:492] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.278798 23554 tablet_bootstrap.cc:492] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.279446 23554 ts_tablet_manager.cc:1403] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:21:36.281656 23554 raft_consensus.cc:359] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.282243 23554 raft_consensus.cc:740] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.282941 23554 consensus_queue.cc:260] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.284787 23554 ts_tablet_manager.cc:1434] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:36.285836 23554 tablet_bootstrap.cc:492] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.298415 23554 tablet_bootstrap.cc:492] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.299150 23554 tablet_bootstrap.cc:492] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.299623 23554 ts_tablet_manager.cc:1403] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:21:36.301275 23554 raft_consensus.cc:359] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.301805 23554 raft_consensus.cc:740] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.302452 23554 consensus_queue.cc:260] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.304651 23554 ts_tablet_manager.cc:1434] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:21:36.305537 23554 tablet_bootstrap.cc:492] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.321673 23554 tablet_bootstrap.cc:492] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.322439 23554 tablet_bootstrap.cc:492] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.322975 23554 ts_tablet_manager.cc:1403] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.007s
I20260709 13:21:36.324725 23554 raft_consensus.cc:359] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.325313 23554 raft_consensus.cc:740] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.325894 23554 consensus_queue.cc:260] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.327010 23597 raft_consensus.cc:3060] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:36.328004 23554 ts_tablet_manager.cc:1434] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:21:36.328830 23554 tablet_bootstrap.cc:492] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.343364 23554 tablet_bootstrap.cc:492] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.344103 23554 tablet_bootstrap.cc:492] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.344657 23554 ts_tablet_manager.cc:1403] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:21:36.346917 23554 raft_consensus.cc:359] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.347579 23554 raft_consensus.cc:740] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.348206 23554 consensus_queue.cc:260] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.350179 23554 ts_tablet_manager.cc:1434] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:21:36.350908 23554 tablet_bootstrap.cc:492] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.370643 23554 tablet_bootstrap.cc:492] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.371575 23554 tablet_bootstrap.cc:492] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.372223 23554 ts_tablet_manager.cc:1403] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.008s
I20260709 13:21:36.374673 23554 raft_consensus.cc:359] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.375331 23554 raft_consensus.cc:740] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.376147 23554 consensus_queue.cc:260] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:36.377980 23554 ts_tablet_manager.cc:1434] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:21:36.378906 23554 tablet_bootstrap.cc:492] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.397774 23554 tablet_bootstrap.cc:492] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.398563 23554 tablet_bootstrap.cc:492] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.399080 23554 ts_tablet_manager.cc:1403] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.007s
I20260709 13:21:36.400902 23554 raft_consensus.cc:359] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:36.401585 23554 raft_consensus.cc:740] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.402163 23554 consensus_queue.cc:260] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:36.403669 23554 ts_tablet_manager.cc:1434] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:21:36.405472 23554 tablet_bootstrap.cc:492] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.420004 23554 tablet_bootstrap.cc:492] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.420730 23554 tablet_bootstrap.cc:492] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.421268 23554 ts_tablet_manager.cc:1403] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:21:36.423097 23554 raft_consensus.cc:359] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:36.423801 23554 raft_consensus.cc:740] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.424443 23554 consensus_queue.cc:260] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:36.427652 23554 ts_tablet_manager.cc:1434] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:21:36.428439 23554 tablet_bootstrap.cc:492] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.438050 23597 raft_consensus.cc:3060] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:36.441349 23554 tablet_bootstrap.cc:492] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.442314 23554 tablet_bootstrap.cc:492] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.442965 23554 ts_tablet_manager.cc:1403] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 13:21:36.445529 23554 raft_consensus.cc:359] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.446224 23554 raft_consensus.cc:740] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.446933 23554 consensus_queue.cc:260] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.449049 23554 ts_tablet_manager.cc:1434] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:21:36.450269 23554 tablet_bootstrap.cc:492] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.464548 23597 raft_consensus.cc:3060] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:36.478097 23554 tablet_bootstrap.cc:492] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.479055 23554 tablet_bootstrap.cc:492] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.479749 23554 ts_tablet_manager.cc:1403] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.000s
I20260709 13:21:36.481884 23554 raft_consensus.cc:359] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.482445 23554 raft_consensus.cc:740] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.483090 23554 consensus_queue.cc:260] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.484934 23554 ts_tablet_manager.cc:1434] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:21:36.485744 23554 tablet_bootstrap.cc:492] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.497491 23554 tablet_bootstrap.cc:492] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.498215 23554 tablet_bootstrap.cc:492] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.498767 23554 ts_tablet_manager.cc:1403] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:21:36.500594 23554 raft_consensus.cc:359] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.501101 23554 raft_consensus.cc:740] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.501724 23554 consensus_queue.cc:260] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.503782 23554 ts_tablet_manager.cc:1434] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:21:36.504807 23554 tablet_bootstrap.cc:492] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.520116 23554 tablet_bootstrap.cc:492] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.524014 23554 tablet_bootstrap.cc:492] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.524735 23554 ts_tablet_manager.cc:1403] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:21:36.527834 23554 raft_consensus.cc:359] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:36.528473 23554 raft_consensus.cc:740] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.529290 23554 consensus_queue.cc:260] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:36.531185 23554 ts_tablet_manager.cc:1434] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:21:36.531848 23554 tablet_bootstrap.cc:492] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap starting.
I20260709 13:21:36.543249 23554 tablet_bootstrap.cc:492] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:21:36.544072 23554 tablet_bootstrap.cc:492] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9: Bootstrap complete.
I20260709 13:21:36.544700 23554 ts_tablet_manager.cc:1403] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.009s
I20260709 13:21:36.546720 23554 raft_consensus.cc:359] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.547159 23554 raft_consensus.cc:740] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Initialized, Role: FOLLOWER
I20260709 13:21:36.547616 23554 consensus_queue.cc:260] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:36.549090 23554 ts_tablet_manager.cc:1434] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:21:36.580129 23597 raft_consensus.cc:3060] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:36.809705 23597 raft_consensus.cc:3060] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:36.835076 22924 raft_consensus.cc:1275] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Refusing update from remote peer f825e4bed376497e95838e1b82dc1a03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:36.836232 23053 consensus_queue.cc:1048] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:36.839275 23597 raft_consensus.cc:3060] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:21:36.845635 23597 raft_consensus.cc:1275] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Refusing update from remote peer f825e4bed376497e95838e1b82dc1a03: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:36.847018 23053 consensus_queue.cc:1048] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:36.868507 23594 raft_consensus.cc:3060] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:36.941021 23594 raft_consensus.cc:3060] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:43.583122 22964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:43687, user_credentials={real_user=slave}} blocked reactor thread for 109649us
W20260709 13:21:43.661387 22964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:34985, user_credentials={real_user=slave}} blocked reactor thread for 58306.6us
W20260709 13:21:43.669225 22890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:43687, user_credentials={real_user=slave}} blocked reactor thread for 51802.9us
I20260709 13:21:44.077523 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:44.130432 22850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aaa4be81c4a4ce6bc080164640cab8a"
dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:21:44.131354 22850 raft_consensus.cc:606] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:44.150954 23793 raft_consensus.cc:993] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:44.151651 23780 raft_consensus.cc:1081] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:44.154062 23595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1aaa4be81c4a4ce6bc080164640cab8a"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50950
I20260709 13:21:44.154717 23595 raft_consensus.cc:493] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:44.159044 23595 raft_consensus.cc:3060] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.162865 22997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4740c47164894cbe8add259947545a4e"
dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
mode: GRACEFUL
new_leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
 from {username='slave'} at 127.0.0.1:33454
I20260709 13:21:44.163470 22997 raft_consensus.cc:606] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Received request to transfer leadership to TS 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:44.166790 22850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c48bfd3488f4ab8b00547a92e0eb843"
dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:21:44.167376 22850 raft_consensus.cc:606] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:44.171566 22850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9928bc913a6d4447b83c59ac19cbcf25"
dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:21:44.172168 22850 raft_consensus.cc:606] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:44.174800 23595 raft_consensus.cc:515] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:44.179025 23595 leader_election.cc:290] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:44.189810 22849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261"
dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:21:44.190362 22849 raft_consensus.cc:606] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:44.198449 22850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad"
dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
mode: GRACEFUL
new_leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:21:44.199234 22850 raft_consensus.cc:606] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Received request to transfer leadership to TS 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:44.200659 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:21:44.202466 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:44.215974 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaa4be81c4a4ce6bc080164640cab8a" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:44.216909 22997 raft_consensus.cc:3060] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.217736 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aaa4be81c4a4ce6bc080164640cab8a" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:44.218329 22850 raft_consensus.cc:3055] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:44.218724 22850 raft_consensus.cc:740] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:44.219529 22850 consensus_queue.cc:260] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:44.221089 22850 raft_consensus.cc:3060] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.228021 22850 raft_consensus.cc:2468] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:44.229141 23546 leader_election.cc:304] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:44.231794 22997 raft_consensus.cc:2468] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:44.233633 23802 raft_consensus.cc:2804] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:44.235013 23802 raft_consensus.cc:697] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:44.236058 23802 consensus_queue.cc:237] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:44.249574 22673 catalog_manager.cc:5697] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 1 to 2, leader changed from 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.268169 23788 raft_consensus.cc:993] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:44.268654 23788 raft_consensus.cc:1081] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:44.270169 23595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50950
I20260709 13:21:44.270649 23595 raft_consensus.cc:493] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:44.270961 23595 raft_consensus.cc:3060] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:44.276137 23595 raft_consensus.cc:515] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:44.278034 23595 leader_election.cc:290] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:44.278736 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:44.279333 22850 raft_consensus.cc:3055] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:44.279706 22850 raft_consensus.cc:740] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:44.280515 22850 consensus_queue.cc:260] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:44.281399 22850 raft_consensus.cc:3060] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:44.287108 22850 raft_consensus.cc:2468] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
I20260709 13:21:44.288162 23546 leader_election.cc:304] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:44.289019 23802 raft_consensus.cc:2804] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:44.289463 23802 raft_consensus.cc:697] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:44.290175 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06a32d57e66460a8d02d5a285d93261" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:44.290334 23802 consensus_queue.cc:237] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:44.290810 22925 raft_consensus.cc:3060] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:44.297652 22925 raft_consensus.cc:2468] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
I20260709 13:21:44.300998 22673 catalog_manager.cc:5697] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 2 to 3, leader changed from 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.341948 23788 raft_consensus.cc:993] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:44.342458 23783 raft_consensus.cc:1081] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:44.343807 23595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c48bfd3488f4ab8b00547a92e0eb843"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50950
I20260709 13:21:44.344269 23595 raft_consensus.cc:493] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:44.344576 23595 raft_consensus.cc:3060] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.349392 23595 raft_consensus.cc:515] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:44.351380 23595 leader_election.cc:290] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:44.352239 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c48bfd3488f4ab8b00547a92e0eb843" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:44.352919 22997 raft_consensus.cc:3060] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.352995 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c48bfd3488f4ab8b00547a92e0eb843" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:44.353609 22850 raft_consensus.cc:3055] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:44.353926 22850 raft_consensus.cc:740] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:44.354688 22850 consensus_queue.cc:260] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:44.355985 22850 raft_consensus.cc:3060] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.356211 23782 raft_consensus.cc:993] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03: : Instructing follower 618c2d1f207e45ddbb25be76c9d4edf6 to start an election
I20260709 13:21:44.356812 23800 raft_consensus.cc:1081] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Signalling peer 618c2d1f207e45ddbb25be76c9d4edf6 to start an election
I20260709 13:21:44.359841 22925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4740c47164894cbe8add259947545a4e"
dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
 from {username='slave'} at 127.0.0.1:38752
I20260709 13:21:44.360464 22997 raft_consensus.cc:2468] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:44.360700 22925 raft_consensus.cc:493] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:44.361225 22925 raft_consensus.cc:3060] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.363041 23546 leader_election.cc:304] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:44.363811 23802 raft_consensus.cc:2804] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:44.364284 23802 raft_consensus.cc:697] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:44.365176 23802 consensus_queue.cc:237] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:44.365322 22850 raft_consensus.cc:2468] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:44.368031 22925 raft_consensus.cc:515] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:44.371261 22925 leader_election.cc:290] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:44.372769 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4740c47164894cbe8add259947545a4e" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:44.373461 22850 raft_consensus.cc:3060] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.374855 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4740c47164894cbe8add259947545a4e" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:44.375452 22997 raft_consensus.cc:3055] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:44.375761 22997 raft_consensus.cc:740] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:44.376503 22997 consensus_queue.cc:260] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:44.377807 22997 raft_consensus.cc:3060] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.379643 22673 catalog_manager.cc:5697] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 1 to 2, leader changed from 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.381705 22850 raft_consensus.cc:2468] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:44.382872 22890 leader_election.cc:304] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:44.383769 23795 raft_consensus.cc:2804] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:44.383970 22997 raft_consensus.cc:2468] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:44.386157 23795 raft_consensus.cc:697] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:44.387144 23795 consensus_queue.cc:237] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:44.402966 22673 catalog_manager.cc:5697] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 1 to 2, leader changed from f825e4bed376497e95838e1b82dc1a03 (127.15.90.4) to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.551990 23788 raft_consensus.cc:993] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:44.552558 23783 raft_consensus.cc:1081] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:44.554253 23597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9928bc913a6d4447b83c59ac19cbcf25"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50950
I20260709 13:21:44.554723 23597 raft_consensus.cc:493] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:44.555107 23597 raft_consensus.cc:3060] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.561861 23597 raft_consensus.cc:515] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:44.563385 23597 leader_election.cc:290] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:44.564136 22849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9928bc913a6d4447b83c59ac19cbcf25" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:44.564675 22849 raft_consensus.cc:3055] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:44.564906 22849 raft_consensus.cc:740] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:44.565531 22849 consensus_queue.cc:260] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:44.566437 22849 raft_consensus.cc:3060] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.568181 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9928bc913a6d4447b83c59ac19cbcf25" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:44.568760 22925 raft_consensus.cc:3060] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.573216 22849 raft_consensus.cc:2468] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:44.574261 23546 leader_election.cc:304] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:44.575062 23802 raft_consensus.cc:2804] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:44.575254 23783 raft_consensus.cc:993] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49: : Instructing follower 618c2d1f207e45ddbb25be76c9d4edf6 to start an election
I20260709 13:21:44.575446 22925 raft_consensus.cc:2468] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:44.575575 23802 raft_consensus.cc:697] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:44.575820 23780 raft_consensus.cc:1081] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Signalling peer 618c2d1f207e45ddbb25be76c9d4edf6 to start an election
I20260709 13:21:44.576622 23802 consensus_queue.cc:237] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:44.577579 22925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad"
dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
 from {username='slave'} at 127.0.0.1:38748
I20260709 13:21:44.578106 22925 raft_consensus.cc:493] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:44.578912 22925 raft_consensus.cc:3060] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:44.586251 22948 debug-util.cc:398] Leaking SignalData structure 0x7b0800320ac0 after lost signal to thread 15723
I20260709 13:21:44.585983 22925 raft_consensus.cc:515] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
W20260709 13:21:44.587404 22948 debug-util.cc:398] Leaking SignalData structure 0x7b080033b5e0 after lost signal to thread 22710
I20260709 13:21:44.588580 22925 leader_election.cc:290] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
W20260709 13:21:44.590929 22948 debug-util.cc:398] Leaking SignalData structure 0x7b0800131ec0 after lost signal to thread 23629
I20260709 13:21:44.591470 22849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:44.592154 22849 raft_consensus.cc:3055] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:44.592573 22849 raft_consensus.cc:740] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:44.592649 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67ba2c2d8c24fe581aab7a2463846ad" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:44.593264 22997 raft_consensus.cc:3060] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.593559 22849 consensus_queue.cc:260] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:44.594854 22849 raft_consensus.cc:3060] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:44.597182 22673 catalog_manager.cc:5697] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 1 to 2, leader changed from 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.600024 22997 raft_consensus.cc:2468] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:44.601121 22890 leader_election.cc:304] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:44.602037 23812 raft_consensus.cc:2804] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:44.602368 22849 raft_consensus.cc:2468] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:44.602540 23812 raft_consensus.cc:697] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:44.603502 23812 consensus_queue.cc:237] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:44.619392 22673 catalog_manager.cc:5697] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 1 to 2, leader changed from 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2) to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:44.687165 22849 raft_consensus.cc:1275] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:44.688525 23802 consensus_queue.cc:1048] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:44.709576 22999 raft_consensus.cc:1275] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:44.711078 23802 consensus_queue.cc:1048] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:44.873299 22925 raft_consensus.cc:1275] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:44.874663 23802 consensus_queue.cc:1048] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:44.893869 22849 raft_consensus.cc:1275] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:44.895988 23803 consensus_queue.cc:1048] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:44.925400 22999 raft_consensus.cc:1275] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:44.926831 23803 consensus_queue.cc:1048] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:44.929145 22849 raft_consensus.cc:1275] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:44.944684 23803 consensus_queue.cc:1048] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:44.979616 22849 raft_consensus.cc:1275] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:44.981866 23802 consensus_queue.cc:1048] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:44.986258 22850 raft_consensus.cc:1275] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:44.988096 23787 consensus_queue.cc:1048] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:45.032778 22925 raft_consensus.cc:1275] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.035218 23802 consensus_queue.cc:1048] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:45.037380 22852 raft_consensus.cc:1275] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.046377 23787 consensus_queue.cc:1048] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:45.037458 22999 raft_consensus.cc:1275] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.076169 23787 consensus_queue.cc:1048] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:45.096446 22999 raft_consensus.cc:1275] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.104048 23832 consensus_queue.cc:1048] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:45.203513 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:45.269202 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:45.349596 22925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25"
dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:55316
I20260709 13:21:45.350227 22925 raft_consensus.cc:606] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:45.353278 22997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269"
dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:33454
I20260709 13:21:45.353824 22997 raft_consensus.cc:606] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:45.356994 22849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89"
dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:21:45.357422 22849 raft_consensus.cc:606] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:45.359743 22925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc14860c91ac4d97bc55ddecd79c6ac5"
dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:55316
I20260709 13:21:45.360181 22925 raft_consensus.cc:606] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:45.363030 22849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7"
dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:21:45.363575 22849 raft_consensus.cc:606] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:45.366636 22850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f"
dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
mode: GRACEFUL
new_leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:21:45.367167 22850 raft_consensus.cc:606] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Received request to transfer leadership to TS 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:45.368367 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:21:45.370034 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:45.426738 23783 raft_consensus.cc:993] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:45.427320 23788 raft_consensus.cc:1081] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:45.428942 23597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50950
I20260709 13:21:45.429493 23597 raft_consensus.cc:493] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.429853 23597 raft_consensus.cc:3060] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.437292 23597 raft_consensus.cc:515] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.439101 23597 leader_election.cc:290] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:45.440021 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:45.440130 22849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f1e1efb4c24fafb2972dda3ab17c89" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:45.440680 22925 raft_consensus.cc:3060] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.440789 22849 raft_consensus.cc:3055] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:45.441195 22849 raft_consensus.cc:740] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:45.441965 22849 consensus_queue.cc:260] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.443150 22849 raft_consensus.cc:3060] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.450105 22925 raft_consensus.cc:2468] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
I20260709 13:21:45.451617 23546 leader_election.cc:304] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:45.452407 23803 raft_consensus.cc:2804] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:45.452404 22849 raft_consensus.cc:2468] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
I20260709 13:21:45.453266 23803 raft_consensus.cc:697] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:45.454227 23803 consensus_queue.cc:237] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.455454 23800 raft_consensus.cc:993] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:45.456151 23823 raft_consensus.cc:1081] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:45.459874 23597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50962
I20260709 13:21:45.460338 23597 raft_consensus.cc:493] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.460640 23597 raft_consensus.cc:3060] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.470937 22671 catalog_manager.cc:5697] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 2 to 3, leader changed from 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.471921 23597 raft_consensus.cc:515] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:45.474870 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:45.475662 22925 raft_consensus.cc:3060] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.477651 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cac43f433204c9d8dc8d65558ae3269" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:45.478945 22997 raft_consensus.cc:3055] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.479257 22997 raft_consensus.cc:740] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:45.480104 22997 consensus_queue.cc:260] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:45.479305 23597 leader_election.cc:290] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:45.481168 22997 raft_consensus.cc:3060] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.487829 22997 raft_consensus.cc:2468] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:45.488967 23546 leader_election.cc:304] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:45.490931 22925 raft_consensus.cc:2468] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:45.493971 23803 raft_consensus.cc:2804] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.494880 23803 raft_consensus.cc:697] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:45.496151 23803 consensus_queue.cc:237] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:45.519851 23787 raft_consensus.cc:993] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:45.520345 23787 raft_consensus.cc:1081] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:45.523828 23597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50968
I20260709 13:21:45.524431 23597 raft_consensus.cc:493] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.524886 23597 raft_consensus.cc:3060] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.535223 23597 raft_consensus.cc:515] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.536924 23597 leader_election.cc:290] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:45.538120 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:45.538393 22849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e757b2ce6374ff88418cc08fe5cfd25" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:45.538730 22925 raft_consensus.cc:3055] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:45.539050 22925 raft_consensus.cc:740] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:45.539101 22849 raft_consensus.cc:3060] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.539894 22925 consensus_queue.cc:260] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.540184 22671 catalog_manager.cc:5697] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 1 to 2, leader changed from f825e4bed376497e95838e1b82dc1a03 (127.15.90.4) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:45.541095 22925 raft_consensus.cc:3060] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.549115 23788 raft_consensus.cc:993] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49: : Instructing follower 618c2d1f207e45ddbb25be76c9d4edf6 to start an election
I20260709 13:21:45.549652 23788 raft_consensus.cc:1081] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Signalling peer 618c2d1f207e45ddbb25be76c9d4edf6 to start an election
I20260709 13:21:45.551347 22923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f"
dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
 from {username='slave'} at 127.0.0.1:38748
I20260709 13:21:45.551860 22923 raft_consensus.cc:493] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.552187 22923 raft_consensus.cc:3060] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.559384 22923 raft_consensus.cc:515] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:45.561213 22923 leader_election.cc:290] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:45.562294 22925 raft_consensus.cc:2468] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
I20260709 13:21:45.564085 23546 leader_election.cc:304] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:45.564697 22999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:45.564966 23803 raft_consensus.cc:2804] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:45.565423 22999 raft_consensus.cc:3060] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.565564 23803 raft_consensus.cc:697] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:45.566321 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8f26f54e66f4e90be987ab9d14e554f" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:45.566890 22850 raft_consensus.cc:3055] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.575623 22850 raft_consensus.cc:740] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:45.576328 22849 raft_consensus.cc:2468] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
I20260709 13:21:45.576382 22850 consensus_queue.cc:260] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:45.577864 22850 raft_consensus.cc:3060] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.580120 22999 raft_consensus.cc:2468] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:45.582588 22890 leader_election.cc:304] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:45.566578 23803 consensus_queue.cc:237] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.606664 23812 raft_consensus.cc:2804] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.607200 23812 raft_consensus.cc:697] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:45.608084 23812 consensus_queue.cc:237] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:45.633589 22850 raft_consensus.cc:2468] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:45.672830 22671 catalog_manager.cc:5697] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 2 to 3, leader changed from 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.675643 22673 catalog_manager.cc:5697] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 1 to 2, leader changed from 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2) to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.714653 23783 raft_consensus.cc:993] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:45.720084 23788 raft_consensus.cc:1081] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:45.722760 23595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50950
I20260709 13:21:45.723618 23595 raft_consensus.cc:493] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.724176 23595 raft_consensus.cc:3060] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.735646 23595 raft_consensus.cc:515] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.739219 22849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:45.739770 22849 raft_consensus.cc:3055] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:45.740075 22849 raft_consensus.cc:740] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:45.740759 22849 consensus_queue.cc:260] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.741977 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f722c735b84bd3a526844bda3371c7" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:45.742586 22925 raft_consensus.cc:3060] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.742837 22849 raft_consensus.cc:3060] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:45.748806 22925 raft_consensus.cc:2468] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
I20260709 13:21:45.748806 22849 raft_consensus.cc:2468] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
W20260709 13:21:45.750914 22966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:34811, user_credentials={real_user=slave}} blocked reactor thread for 75157.1us
I20260709 13:21:45.751161 23546 leader_election.cc:304] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:45.754088 23803 raft_consensus.cc:2804] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:45.754544 23803 raft_consensus.cc:697] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:45.755400 23803 consensus_queue.cc:237] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.761296 23787 raft_consensus.cc:993] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:45.761822 23787 raft_consensus.cc:1081] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:45.763616 23597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc14860c91ac4d97bc55ddecd79c6ac5"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50968
I20260709 13:21:45.764256 23597 raft_consensus.cc:493] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:45.764631 23597 raft_consensus.cc:3060] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.765605 23595 leader_election.cc:290] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:45.771281 23597 raft_consensus.cc:515] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.775585 22925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc14860c91ac4d97bc55ddecd79c6ac5" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:45.776173 22925 raft_consensus.cc:3055] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:45.776489 22925 raft_consensus.cc:740] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:45.777321 22925 consensus_queue.cc:260] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.778218 22925 raft_consensus.cc:3060] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:45.785135 22849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc14860c91ac4d97bc55ddecd79c6ac5" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:45.785319 23597 leader_election.cc:290] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:45.788743 22925 raft_consensus.cc:2468] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:45.791522 23546 leader_election.cc:304] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:45.793365 23803 raft_consensus.cc:2804] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:45.793865 23803 raft_consensus.cc:697] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:45.794706 23803 consensus_queue.cc:237] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:45.796187 22671 catalog_manager.cc:5697] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 2 to 3, leader changed from 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.811719 22671 catalog_manager.cc:5697] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 1 to 2, leader changed from 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:45.944326 22850 raft_consensus.cc:1275] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:45.945456 23803 consensus_queue.cc:1048] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:45.961365 22924 raft_consensus.cc:1275] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:45.970933 23803 consensus_queue.cc:1048] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:45.978631 22997 raft_consensus.cc:1275] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:45.985991 23802 consensus_queue.cc:1048] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.017284 22925 raft_consensus.cc:1275] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.020017 23803 consensus_queue.cc:1048] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.066977 22849 raft_consensus.cc:1275] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.068619 23832 consensus_queue.cc:1048] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.087425 22997 raft_consensus.cc:1275] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.089710 23787 consensus_queue.cc:1048] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.132083 22923 raft_consensus.cc:1275] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:46.133580 23830 consensus_queue.cc:1048] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:46.137517 22849 raft_consensus.cc:1275] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:46.138644 23830 consensus_queue.cc:1048] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:46.171785 22849 raft_consensus.cc:1275] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:46.180253 23830 consensus_queue.cc:1048] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:46.219228 22923 raft_consensus.cc:1275] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:46.228909 23802 consensus_queue.cc:1048] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:46.300277 22923 raft_consensus.cc:1275] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.301999 23802 consensus_queue.cc:1048] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.315133 22850 raft_consensus.cc:3060] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.323721 22850 raft_consensus.cc:1275] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:46.325157 23828 consensus_queue.cc:1048] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:46.370932 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:46.412380 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:46.498101 22996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37f868d307ca42e9bbdac5db09aa91d0"
dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
mode: GRACEFUL
new_leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
 from {username='slave'} at 127.0.0.1:33454
I20260709 13:21:46.498737 22996 raft_consensus.cc:606] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Received request to transfer leadership to TS 618c2d1f207e45ddbb25be76c9d4edf6
I20260709 13:21:46.508909 22849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984"
dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:21:46.509603 22849 raft_consensus.cc:606] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:46.513598 22997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0"
dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:33454
I20260709 13:21:46.514120 22997 raft_consensus.cc:606] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:46.517019 22997 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d6efd72b4114248adef337292eaede0"
dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:33454
I20260709 13:21:46.517524 22997 raft_consensus.cc:606] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:46.520200 22924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e"
dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:55316
I20260709 13:21:46.520756 22924 raft_consensus.cc:606] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:46.521991 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:21:46.523506 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:46.629873 23800 raft_consensus.cc:993] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:46.630585 23800 raft_consensus.cc:1081] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:46.632179 23597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d6efd72b4114248adef337292eaede0"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50962
I20260709 13:21:46.632696 23597 raft_consensus.cc:493] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:46.632969 23597 raft_consensus.cc:3060] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.637355 23597 raft_consensus.cc:515] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:46.638744 23597 leader_election.cc:290] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:46.639401 22996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6efd72b4114248adef337292eaede0" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:46.639616 22849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6efd72b4114248adef337292eaede0" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:46.640094 22996 raft_consensus.cc:3055] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:46.640256 22849 raft_consensus.cc:3060] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.640518 22996 raft_consensus.cc:740] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:46.641376 22996 consensus_queue.cc:260] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:46.642752 22996 raft_consensus.cc:3060] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.646368 22849 raft_consensus.cc:2468] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:46.647982 23546 leader_election.cc:304] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:46.648633 23802 raft_consensus.cc:2804] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:46.649333 23802 raft_consensus.cc:697] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:46.650281 23802 consensus_queue.cc:237] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:46.654994 22996 raft_consensus.cc:2468] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:46.662606 22671 catalog_manager.cc:5697] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 1 to 2, leader changed from f825e4bed376497e95838e1b82dc1a03 (127.15.90.4) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:46.759649 23873 raft_consensus.cc:993] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:46.760218 23873 raft_consensus.cc:1081] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:46.762043 23597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50968
I20260709 13:21:46.762545 23597 raft_consensus.cc:493] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:46.762897 23597 raft_consensus.cc:3060] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.769876 23597 raft_consensus.cc:515] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:46.771790 23597 leader_election.cc:290] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:46.772675 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:46.773269 22924 raft_consensus.cc:3055] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:46.773551 22924 raft_consensus.cc:740] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:46.774205 22924 consensus_queue.cc:260] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:46.775214 22924 raft_consensus.cc:3060] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.778750 22996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2381149a5f40939b61970905b68e8e" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:46.779367 22996 raft_consensus.cc:3060] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.786614 22996 raft_consensus.cc:2468] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:46.788151 23546 leader_election.cc:304] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:46.788906 23802 raft_consensus.cc:2804] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:46.789688 23802 raft_consensus.cc:697] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:46.789754 22924 raft_consensus.cc:2468] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:46.790808 23802 consensus_queue.cc:237] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:46.803388 22671 catalog_manager.cc:5697] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 1 to 2, leader changed from 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:46.812719 23847 raft_consensus.cc:993] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:46.813225 23847 raft_consensus.cc:1081] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:46.816663 23597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50962
I20260709 13:21:46.817287 23597 raft_consensus.cc:493] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:46.817684 23597 raft_consensus.cc:3060] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:46.824218 23597 raft_consensus.cc:515] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:46.825812 23597 leader_election.cc:290] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:46.826445 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:46.826850 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8785be4ba2dd4539af50dfdc6562cde0" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:46.827054 22924 raft_consensus.cc:3060] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:46.827500 22997 raft_consensus.cc:3055] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:46.827879 22997 raft_consensus.cc:740] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:46.828636 22997 consensus_queue.cc:260] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:46.829931 22997 raft_consensus.cc:3060] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:46.832448 22924 raft_consensus.cc:2468] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
I20260709 13:21:46.833493 23546 leader_election.cc:304] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:46.835487 23802 raft_consensus.cc:2804] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:46.835963 23802 raft_consensus.cc:697] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:46.836833 23802 consensus_queue.cc:237] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:46.839685 22997 raft_consensus.cc:2468] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
I20260709 13:21:46.847061 22671 catalog_manager.cc:5697] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 2 to 3, leader changed from f825e4bed376497e95838e1b82dc1a03 (127.15.90.4) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:46.891230 23800 raft_consensus.cc:993] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03: : Instructing follower 618c2d1f207e45ddbb25be76c9d4edf6 to start an election
I20260709 13:21:46.891786 23800 raft_consensus.cc:1081] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Signalling peer 618c2d1f207e45ddbb25be76c9d4edf6 to start an election
I20260709 13:21:46.894148 22924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37f868d307ca42e9bbdac5db09aa91d0"
dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
 from {username='slave'} at 127.0.0.1:38752
I20260709 13:21:46.896019 22924 raft_consensus.cc:493] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:46.896452 22924 raft_consensus.cc:3060] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.903194 22924 raft_consensus.cc:515] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:46.904860 22924 leader_election.cc:290] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:46.905475 22849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f868d307ca42e9bbdac5db09aa91d0" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:46.905829 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37f868d307ca42e9bbdac5db09aa91d0" candidate_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:46.906121 22849 raft_consensus.cc:3060] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.906590 22997 raft_consensus.cc:3055] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:46.906968 22997 raft_consensus.cc:740] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f825e4bed376497e95838e1b82dc1a03, State: Running, Role: LEADER
I20260709 13:21:46.908113 22997 consensus_queue.cc:260] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:46.910473 22997 raft_consensus.cc:3060] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:46.916049 22997 raft_consensus.cc:2468] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:46.916929 22890 leader_election.cc:304] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:46.917591 23873 raft_consensus.cc:2804] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:46.917727 22849 raft_consensus.cc:2468] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 618c2d1f207e45ddbb25be76c9d4edf6 in term 2.
I20260709 13:21:46.918110 23873 raft_consensus.cc:697] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Becoming Leader. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:46.919047 23873 consensus_queue.cc:237] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:46.930677 22671 catalog_manager.cc:5697] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 reported cstate change: term changed from 1 to 2, leader changed from f825e4bed376497e95838e1b82dc1a03 (127.15.90.4) to 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:47.056800 23783 raft_consensus.cc:993] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:47.057319 23783 raft_consensus.cc:1081] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:47.058772 23595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50950
I20260709 13:21:47.059326 23595 raft_consensus.cc:493] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:47.059710 23595 raft_consensus.cc:3060] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:47.066114 23595 raft_consensus.cc:515] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:47.067723 23595 leader_election.cc:290] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Requested vote from peers f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:47.068362 22997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:47.068674 22849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "748bcf9f05f946f89a17dd918d410984" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:47.069041 22997 raft_consensus.cc:3060] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:47.069363 22849 raft_consensus.cc:3055] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:47.069677 22849 raft_consensus.cc:740] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:47.070362 22849 consensus_queue.cc:260] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:47.072182 22849 raft_consensus.cc:3060] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:47.076164 22997 raft_consensus.cc:2468] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:47.077280 23546 leader_election.cc:304] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e9cee38bd2dd4b4e999490708cacd3a9, f825e4bed376497e95838e1b82dc1a03; no voters: 
I20260709 13:21:47.078367 23802 raft_consensus.cc:2804] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:47.080554 22849 raft_consensus.cc:2468] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 2.
I20260709 13:21:47.082393 23802 raft_consensus.cc:697] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:47.083391 23802 consensus_queue.cc:237] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:47.100741 22671 catalog_manager.cc:5697] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 1 to 2, leader changed from 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:47.143250 22996 raft_consensus.cc:1275] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.144644 23802 consensus_queue.cc:1048] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:47.158097 22849 raft_consensus.cc:1275] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.159766 23802 consensus_queue.cc:1048] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:47.180112 22924 raft_consensus.cc:1275] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.181756 23802 consensus_queue.cc:1048] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:47.198258 22996 raft_consensus.cc:1275] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.202668 23828 consensus_queue.cc:1048] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:47.285409 22996 raft_consensus.cc:1275] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:47.286824 23828 consensus_queue.cc:1048] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:47.308353 22924 raft_consensus.cc:1275] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:47.312857 23830 consensus_queue.cc:1048] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:47.344648 22997 raft_consensus.cc:1275] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.346897 23812 consensus_queue.cc:1048] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:47.374974 22849 raft_consensus.cc:1275] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer 618c2d1f207e45ddbb25be76c9d4edf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.377866 23812 consensus_queue.cc:1048] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:47.478837 22996 raft_consensus.cc:1275] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.480175 23830 consensus_queue.cc:1048] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:47.499723 22849 raft_consensus.cc:1275] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:47.501430 23830 consensus_queue.cc:1048] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:47.524627 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:47.595564 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:47.640543 22924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c363ea87274bec880ce1c6cdb1faef"
dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
mode: GRACEFUL
new_leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
 from {username='slave'} at 127.0.0.1:55316
I20260709 13:21:47.641201 22924 raft_consensus.cc:606] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Received request to transfer leadership to TS 8f307730e7ab4bab9c70d9fa3e51dd49
I20260709 13:21:47.643810 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:21:47.645762 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:47.779645 23873 raft_consensus.cc:993] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6: : Instructing follower 8f307730e7ab4bab9c70d9fa3e51dd49 to start an election
I20260709 13:21:47.780252 23812 raft_consensus.cc:1081] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Signalling peer 8f307730e7ab4bab9c70d9fa3e51dd49 to start an election
I20260709 13:21:47.781893 22849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c363ea87274bec880ce1c6cdb1faef"
dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
 from {username='slave'} at 127.0.0.1:37122
I20260709 13:21:47.782656 22849 raft_consensus.cc:493] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:47.782997 22849 raft_consensus.cc:3060] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:47.788295 22849 raft_consensus.cc:515] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:47.790161 22849 leader_election.cc:290] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Requested vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), f825e4bed376497e95838e1b82dc1a03 (127.15.90.4:44325)
I20260709 13:21:47.790787 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c363ea87274bec880ce1c6cdb1faef" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:47.791134 22996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c363ea87274bec880ce1c6cdb1faef" candidate_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f825e4bed376497e95838e1b82dc1a03"
I20260709 13:21:47.791451 22924 raft_consensus.cc:3055] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:47.791666 22996 raft_consensus.cc:3060] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:47.791788 22924 raft_consensus.cc:740] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 618c2d1f207e45ddbb25be76c9d4edf6, State: Running, Role: LEADER
I20260709 13:21:47.792593 22924 consensus_queue.cc:260] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:47.793618 22924 raft_consensus.cc:3060] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:47.803401 22924 raft_consensus.cc:2468] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 2.
I20260709 13:21:47.805586 22816 leader_election.cc:304] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, 8f307730e7ab4bab9c70d9fa3e51dd49; no voters: 
I20260709 13:21:47.807096 23849 raft_consensus.cc:2804] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:47.807578 23849 raft_consensus.cc:697] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Becoming Leader. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:47.808435 23849 consensus_queue.cc:237] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } }
I20260709 13:21:47.811923 22996 raft_consensus.cc:2468] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f307730e7ab4bab9c70d9fa3e51dd49 in term 2.
I20260709 13:21:47.826614 22673 catalog_manager.cc:5697] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 reported cstate change: term changed from 1 to 2, leader changed from 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3) to 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2). New cstate: current_term: 2 leader_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:48.289851 22923 raft_consensus.cc:1275] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Refusing update from remote peer 8f307730e7ab4bab9c70d9fa3e51dd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:48.291172 23896 consensus_queue.cc:1048] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:48.302064 22996 raft_consensus.cc:1275] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Refusing update from remote peer 8f307730e7ab4bab9c70d9fa3e51dd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:48.305824 23898 consensus_queue.cc:1048] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:48.648042 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:21:48.732146 22890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:43687, user_credentials={real_user=slave}} blocked reactor thread for 66631.9us
I20260709 13:21:48.820520 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:48.882567 22850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086"
dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
mode: GRACEFUL
new_leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:53422
I20260709 13:21:48.883531 22850 raft_consensus.cc:606] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Received request to transfer leadership to TS e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:48.885263 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:21:48.887066 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:21:49.022465 23783 raft_consensus.cc:993] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49: : Instructing follower e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:49.023209 23898 raft_consensus.cc:1081] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Signalling peer e9cee38bd2dd4b4e999490708cacd3a9 to start an election
I20260709 13:21:49.028919 23595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086"
dest_uuid: "e9cee38bd2dd4b4e999490708cacd3a9"
 from {username='slave'} at 127.0.0.1:50950
I20260709 13:21:49.031352 23595 raft_consensus.cc:493] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:21:49.032003 23595 raft_consensus.cc:3060] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:49.047215 23595 raft_consensus.cc:515] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:49.049988 23595 leader_election.cc:290] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Requested vote from peers 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687), 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985)
I20260709 13:21:49.052973 22850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49"
I20260709 13:21:49.053725 22850 raft_consensus.cc:3055] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:49.054050 22850 raft_consensus.cc:740] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f307730e7ab4bab9c70d9fa3e51dd49, State: Running, Role: LEADER
I20260709 13:21:49.054980 22850 consensus_queue.cc:260] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:49.056456 22924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16cd39cc57d84d3db47221d4164f3086" candidate_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "618c2d1f207e45ddbb25be76c9d4edf6"
I20260709 13:21:49.057248 22924 raft_consensus.cc:3060] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:49.060367 22818 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:21:49.062723 22850 raft_consensus.cc:3060] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:49.066103 22924 raft_consensus.cc:2468] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
I20260709 13:21:49.067546 23546 leader_election.cc:304] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9; no voters: 
I20260709 13:21:49.068490 23802 raft_consensus.cc:2804] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:49.070109 23802 raft_consensus.cc:697] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Becoming Leader. State: Replica: e9cee38bd2dd4b4e999490708cacd3a9, State: Running, Role: LEADER
I20260709 13:21:49.071010 23802 consensus_queue.cc:237] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } }
I20260709 13:21:49.073335 22850 raft_consensus.cc:2468] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9cee38bd2dd4b4e999490708cacd3a9 in term 3.
I20260709 13:21:49.085022 22673 catalog_manager.cc:5697] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 reported cstate change: term changed from 2 to 3, leader changed from 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2) to e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1). New cstate: current_term: 3 leader_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:49.501049 22925 raft_consensus.cc:1275] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.509542 23802 consensus_queue.cc:1048] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:49.553496 22853 raft_consensus.cc:1275] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Refusing update from remote peer e9cee38bd2dd4b4e999490708cacd3a9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:49.556034 23921 consensus_queue.cc:1048] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:49.928241 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:21:49.969427 15720 tablet_server.cc:179] TabletServer@127.15.90.1:34811 shutting down...
W20260709 13:21:49.980914 22892 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 51 similar messages]
W20260709 13:21:49.984398 22892 consensus_peers.cc:597] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.005544 22966 consensus_peers.cc:597] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.008276 22966 consensus_peers.cc:597] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.022812 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:50.023629 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.024379 15720 raft_consensus.cc:2243] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.024930 15720 raft_consensus.cc:2272] T 14c24379e8a84ab9890e18d3c00b9a48 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.027796 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.028674 15720 raft_consensus.cc:2243] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.029158 15720 raft_consensus.cc:2272] T 2e393b9cf9a849f4ad63eea1da23ea42 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.032224 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.033038 15720 raft_consensus.cc:2243] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.033548 15720 raft_consensus.cc:2272] T aac6ba45a5de4dfdab02fd99a9ba3976 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.035842 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.036427 15720 raft_consensus.cc:2243] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.036861 15720 raft_consensus.cc:2272] T ffa363e792404ff6b11c80dfb5d5d33e P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.039295 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.040213 15720 raft_consensus.cc:2243] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.041385 15720 raft_consensus.cc:2272] T 3cac43f433204c9d8dc8d65558ae3269 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.044304 15720 tablet_replica.cc:333] stopping tablet replica
W20260709 13:21:50.045140 22818 consensus_peers.cc:597] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.045306 15720 raft_consensus.cc:2243] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.046089 15720 raft_consensus.cc:2272] T d5b8344825d146b8b8c05ae651fb0d9a P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.048872 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.049853 15720 raft_consensus.cc:2243] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.050451 15720 raft_consensus.cc:2272] T e3b1972dac5349e4b8f76620d14d5d10 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.053009 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.053946 15720 raft_consensus.cc:2243] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.055634 15720 raft_consensus.cc:2272] T 9d6efd72b4114248adef337292eaede0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.057219 22818 consensus_peers.cc:597] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.058843 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.059791 15720 raft_consensus.cc:2243] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.060715 15720 raft_consensus.cc:2272] T 5c86d847eb114cb684092a456952e795 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.063874 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.064692 15720 raft_consensus.cc:2243] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.065655 15720 raft_consensus.cc:2272] T 16cd39cc57d84d3db47221d4164f3086 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.068269 22892 consensus_peers.cc:597] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.068737 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.069531 15720 raft_consensus.cc:2243] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.070036 15720 raft_consensus.cc:2272] T 7915d0ecd98c4c04b76169d6a45314e3 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.074339 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.075050 15720 raft_consensus.cc:2243] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.075532 15720 raft_consensus.cc:2272] T d5a393acc19e45f49ed5e6b17ee64d81 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.078270 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.078833 15720 raft_consensus.cc:2243] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.079232 15720 raft_consensus.cc:2272] T 33209c9cbc0949fb933224b7cb5dce53 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.081424 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.082123 15720 raft_consensus.cc:2243] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.083112 15720 raft_consensus.cc:2272] T d06a32d57e66460a8d02d5a285d93261 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.086400 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.087062 15720 raft_consensus.cc:2243] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.087656 15720 raft_consensus.cc:2272] T e393e8c4349b473abd5f35159d141168 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.088382 22966 consensus_peers.cc:597] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.089959 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.090583 15720 raft_consensus.cc:2243] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.091318 15720 raft_consensus.cc:2272] T d4f722c735b84bd3a526844bda3371c7 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.093320 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.093871 15720 raft_consensus.cc:2243] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.094261 15720 raft_consensus.cc:2272] T 4d21ac823716443b908d3e64bd1270a8 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.096484 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.097023 15720 raft_consensus.cc:2243] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.097412 15720 raft_consensus.cc:2272] T 0436364a6d304d108b9d702cec8086c0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.100021 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.100653 15720 raft_consensus.cc:2243] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.101146 15720 raft_consensus.cc:2272] T fde2d13e9f7c4d7880772615ce0d811c P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.103657 22818 consensus_peers.cc:597] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.103956 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.104861 15720 raft_consensus.cc:2243] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.105788 15720 raft_consensus.cc:2272] T 748bcf9f05f946f89a17dd918d410984 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.108393 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.109256 15720 raft_consensus.cc:2243] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.109666 15720 raft_consensus.cc:2272] T 1c7056b89dcd402082c0a745eb8e9b79 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.111755 22966 consensus_peers.cc:597] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.112294 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.113075 15720 raft_consensus.cc:2243] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.113541 15720 raft_consensus.cc:2272] T 3670fb6e5d3143289ff131f8df729e4a P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.116436 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.116957 15720 raft_consensus.cc:2243] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.117373 15720 raft_consensus.cc:2272] T f864d0fd88e94640a4e91ad8ebdb19d6 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.119417 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.120074 15720 raft_consensus.cc:2243] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.120491 15720 raft_consensus.cc:2272] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.123427 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.124243 15720 raft_consensus.cc:2243] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.125329 15720 raft_consensus.cc:2272] T 1aaa4be81c4a4ce6bc080164640cab8a P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.128113 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.128635 15720 raft_consensus.cc:2243] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.129490 15720 raft_consensus.cc:2272] T 0e757b2ce6374ff88418cc08fe5cfd25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.131922 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.132495 15720 raft_consensus.cc:2243] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.132941 15720 raft_consensus.cc:2272] T 5e4bbf8e1a12402f8ecefd83160f4672 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.135946 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.136710 15720 raft_consensus.cc:2243] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.137352 15720 raft_consensus.cc:2272] T 89d50aaee99348959ee8e1d85e3c18bb P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.137976 22818 consensus_peers.cc:597] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.139513 22818 consensus_peers.cc:597] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.140342 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.141074 15720 raft_consensus.cc:2243] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.141484 15720 raft_consensus.cc:2272] T 4f88630e7ac244caa791ca47a1ef8031 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.144068 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.144631 15720 raft_consensus.cc:2243] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.145048 15720 raft_consensus.cc:2272] T 62e34545b8f644c28059e013cdd0590b P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.146971 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.147547 15720 raft_consensus.cc:2243] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.148027 15720 raft_consensus.cc:2272] T b29fe64535814ccd8d9f4f20f00c6f1d P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.150041 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.150574 15720 raft_consensus.cc:2243] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.151021 15720 raft_consensus.cc:2272] T ea7e2a19f1474c1fb8f98ee12a3be096 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.153322 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.153923 15720 raft_consensus.cc:2243] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.154922 15720 raft_consensus.cc:2272] T b5f1e1efb4c24fafb2972dda3ab17c89 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.157368 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.157971 15720 raft_consensus.cc:2243] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.158504 15720 raft_consensus.cc:2272] T 670cb5d0cf514ec78871a6a32e316c13 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.160593 22966 consensus_peers.cc:597] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.161686 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.162597 15720 raft_consensus.cc:2243] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.163134 15720 raft_consensus.cc:2272] T 9c5b0b4e5dc64c67a2830174409b84d9 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.166041 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.166793 15720 raft_consensus.cc:2243] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.167328 15720 raft_consensus.cc:2272] T c42f0026e60841c6b5a416128dc2f590 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.169600 22966 consensus_peers.cc:597] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.169660 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.170503 15720 raft_consensus.cc:2243] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.170957 15720 raft_consensus.cc:2272] T 9d6596aca14e4f31bea39731d8a95dfc P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.173055 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.173601 15720 raft_consensus.cc:2243] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.174350 15720 raft_consensus.cc:2272] T bc14860c91ac4d97bc55ddecd79c6ac5 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.177136 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.177799 15720 raft_consensus.cc:2243] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:21:50.178488 22892 consensus_peers.cc:597] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.178874 15720 raft_consensus.cc:2272] T 9928bc913a6d4447b83c59ac19cbcf25 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.181659 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.182201 15720 raft_consensus.cc:2243] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.182968 15720 raft_consensus.cc:2272] T 8785be4ba2dd4539af50dfdc6562cde0 P e9cee38bd2dd4b4e999490708cacd3a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.184976 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.185488 15720 raft_consensus.cc:2243] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.185878 15720 raft_consensus.cc:2272] T b1c5e4b2a4d642ef918c312a6ab1b808 P e9cee38bd2dd4b4e999490708cacd3a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.187988 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.188477 15720 raft_consensus.cc:2243] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.188934 15720 raft_consensus.cc:2272] T 028d1f3901024609a35947274e016368 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.190860 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.191412 15720 raft_consensus.cc:2243] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.192346 15720 raft_consensus.cc:2272] T ac2381149a5f40939b61970905b68e8e P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.194221 22892 consensus_peers.cc:597] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.194952 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.195752 15720 raft_consensus.cc:2243] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.196795 15720 raft_consensus.cc:2272] T 4c48bfd3488f4ab8b00547a92e0eb843 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.199647 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:21:50.200181 15720 raft_consensus.cc:2243] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.200717 15720 raft_consensus.cc:2272] T cf330fe4b59c472a9c3bcb18161ff906 P e9cee38bd2dd4b4e999490708cacd3a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.202076 22818 consensus_peers.cc:597] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.245054 22892 consensus_peers.cc:597] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.263427 22966 consensus_peers.cc:597] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.277216 22966 consensus_peers.cc:597] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.278554 15720 tablet_server.cc:196] TabletServer@127.15.90.1:34811 shutdown complete.
W20260709 13:21:50.299664 22818 consensus_peers.cc:597] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.332950 22892 consensus_peers.cc:597] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.350248 22892 consensus_peers.cc:597] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.360481 22966 consensus_peers.cc:597] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.362612 15720 tablet_server.cc:179] TabletServer@127.15.90.2:0 shutting down...
W20260709 13:21:50.367260 22890 consensus_peers.cc:597] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.380874 22818 consensus_peers.cc:597] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.381060 22892 consensus_peers.cc:597] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.389750 23022 debug-util.cc:398] Leaking SignalData structure 0x7b08004016c0 after lost signal to thread 15723
W20260709 13:21:50.390806 23022 debug-util.cc:398] Leaking SignalData structure 0x7b08003703c0 after lost signal to thread 22710
W20260709 13:21:50.392119 23022 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce5e0 after lost signal to thread 22877
W20260709 13:21:50.393639 23022 debug-util.cc:398] Leaking SignalData structure 0x7b08003539e0 after lost signal to thread 22951
W20260709 13:21:50.396059 23022 debug-util.cc:398] Leaking SignalData structure 0x7b08003fffa0 after lost signal to thread 23025
W20260709 13:21:50.397322 23022 debug-util.cc:398] Leaking SignalData structure 0x7b0800269f20 after lost signal to thread 23629
W20260709 13:21:50.397713 22966 consensus_peers.cc:597] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.400897 22890 consensus_peers.cc:597] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.409214 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:50.410287 15720 tablet_replica.cc:333] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.411615 15720 raft_consensus.cc:2243] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.412233 15720 raft_consensus.cc:2272] T 6089d12187b140b4bb379b9d3bc7816f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.414645 15720 tablet_replica.cc:333] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.415257 15720 raft_consensus.cc:2243] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.416147 15720 raft_consensus.cc:2272] T b1c5e4b2a4d642ef918c312a6ab1b808 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.418329 15720 tablet_replica.cc:333] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.418941 15720 raft_consensus.cc:2243] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.419431 15720 raft_consensus.cc:2272] T d5a393acc19e45f49ed5e6b17ee64d81 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.421773 15720 tablet_replica.cc:333] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.422366 15720 raft_consensus.cc:2243] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.422785 15720 raft_consensus.cc:2272] T d06a32d57e66460a8d02d5a285d93261 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.424906 15720 tablet_replica.cc:333] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.425488 15720 raft_consensus.cc:2243] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.425938 15720 raft_consensus.cc:2272] T 37f868d307ca42e9bbdac5db09aa91d0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.428344 15720 tablet_replica.cc:333] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.429172 15720 raft_consensus.cc:2243] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.429736 15720 raft_consensus.cc:2272] T f8427d8842704b1e8a7d20c6a4baf90f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.432582 15720 tablet_replica.cc:333] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.433329 15720 raft_consensus.cc:2243] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.433917 15720 raft_consensus.cc:2272] T 9928bc913a6d4447b83c59ac19cbcf25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.435738 22964 consensus_peers.cc:597] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.436808 15720 tablet_replica.cc:333] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.437718 15720 raft_consensus.cc:2243] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.438731 15720 raft_consensus.cc:2272] T 2e393b9cf9a849f4ad63eea1da23ea42 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.441694 15720 tablet_replica.cc:333] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.442523 15720 raft_consensus.cc:2243] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.443526 15720 raft_consensus.cc:2272] T 5d1fb76060d7483698646276d085257f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.446599 15720 tablet_replica.cc:333] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.447544 15720 raft_consensus.cc:2243] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.448757 15720 raft_consensus.cc:2272] T 33209c9cbc0949fb933224b7cb5dce53 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.451484 22890 consensus_peers.cc:597] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.452011 15720 tablet_replica.cc:333] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
W20260709 13:21:50.452862 22890 consensus_peers.cc:597] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.452896 15720 raft_consensus.cc:2243] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.453840 15720 raft_consensus.cc:2272] T 62e34545b8f644c28059e013cdd0590b P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.456672 22892 consensus_peers.cc:597] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.458739 15720 tablet_replica.cc:333] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.459699 15720 raft_consensus.cc:2243] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.460418 15720 raft_consensus.cc:2272] T f67ba2c2d8c24fe581aab7a2463846ad P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.464028 15720 tablet_replica.cc:333] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.464983 15720 raft_consensus.cc:2243] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.466228 15720 raft_consensus.cc:2272] T b29fe64535814ccd8d9f4f20f00c6f1d P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.469137 15720 tablet_replica.cc:333] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.469949 15720 raft_consensus.cc:2243] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.470916 15720 raft_consensus.cc:2272] T ea82caef4f4f439c84611d5e6a9c10df P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.473781 15720 tablet_replica.cc:333] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.474443 15720 raft_consensus.cc:2243] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.475452 15720 raft_consensus.cc:2272] T d0f2c58a06ac445b85ec78b0e8531134 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.477825 15720 tablet_replica.cc:333] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.478309 15720 raft_consensus.cc:2243] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.478829 15720 raft_consensus.cc:2272] T cf330fe4b59c472a9c3bcb18161ff906 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.481050 22966 consensus_peers.cc:597] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.481547 15720 tablet_replica.cc:333] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.482347 15720 raft_consensus.cc:2243] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.482894 15720 raft_consensus.cc:2272] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.485703 15720 tablet_replica.cc:333] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.486527 15720 raft_consensus.cc:2243] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.487047 15720 raft_consensus.cc:2272] T be0ee46f570945638b5a510259726a6c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.489778 15720 tablet_replica.cc:333] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
W20260709 13:21:50.490569 22890 consensus_peers.cc:597] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.490551 15720 raft_consensus.cc:2243] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.491600 15720 raft_consensus.cc:2272] T e8f26f54e66f4e90be987ab9d14e554f P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.495294 15720 tablet_replica.cc:333] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.496102 15720 raft_consensus.cc:2243] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.497115 15720 raft_consensus.cc:2272] T 0436364a6d304d108b9d702cec8086c0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.497195 22890 consensus_peers.cc:597] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.500126 15720 tablet_replica.cc:333] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.500752 15720 raft_consensus.cc:2243] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.501210 15720 raft_consensus.cc:2272] T fde2d13e9f7c4d7880772615ce0d811c P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.503662 15720 tablet_replica.cc:333] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.504632 15720 raft_consensus.cc:2243] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.505259 15720 raft_consensus.cc:2272] T 4d21ac823716443b908d3e64bd1270a8 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.508205 15720 tablet_replica.cc:333] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.508980 15720 raft_consensus.cc:2243] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.509511 15720 raft_consensus.cc:2272] T bc14860c91ac4d97bc55ddecd79c6ac5 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.509814 22964 consensus_peers.cc:597] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.512435 15720 tablet_replica.cc:333] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.513290 15720 raft_consensus.cc:2243] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.513815 15720 raft_consensus.cc:2272] T 670cb5d0cf514ec78871a6a32e316c13 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.516789 15720 tablet_replica.cc:333] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.517568 15720 raft_consensus.cc:2243] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.518083 15720 raft_consensus.cc:2272] T 9d6efd72b4114248adef337292eaede0 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.520670 15720 tablet_replica.cc:333] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.521416 15720 raft_consensus.cc:2243] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.522341 15720 raft_consensus.cc:2272] T 03c363ea87274bec880ce1c6cdb1faef P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.525125 15720 tablet_replica.cc:333] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.526175 15720 raft_consensus.cc:2243] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.526757 15720 raft_consensus.cc:2272] T 4c48bfd3488f4ab8b00547a92e0eb843 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.529577 15720 tablet_replica.cc:333] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.530364 15720 raft_consensus.cc:2243] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.530948 15720 raft_consensus.cc:2272] T 4740c47164894cbe8add259947545a4e P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.532322 22964 consensus_peers.cc:597] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.534535 15720 tablet_replica.cc:333] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.535435 15720 raft_consensus.cc:2243] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.536584 15720 raft_consensus.cc:2272] T 48d3f266650349d2a9181aebd298df50 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.539175 15720 tablet_replica.cc:333] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.539810 15720 raft_consensus.cc:2243] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.540647 15720 raft_consensus.cc:2272] T 9c5b0b4e5dc64c67a2830174409b84d9 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.543040 15720 tablet_replica.cc:333] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.543797 15720 raft_consensus.cc:2243] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.544902 15720 raft_consensus.cc:2272] T c42f0026e60841c6b5a416128dc2f590 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.547638 15720 tablet_replica.cc:333] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.548244 15720 raft_consensus.cc:2243] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:21:50.548405 22966 consensus_peers.cc:597] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.548930 15720 raft_consensus.cc:2272] T 89d50aaee99348959ee8e1d85e3c18bb P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.551020 15720 tablet_replica.cc:333] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.551909 15720 raft_consensus.cc:2243] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.552542 15720 raft_consensus.cc:2272] T b5f1e1efb4c24fafb2972dda3ab17c89 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.555178 15720 tablet_replica.cc:333] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.555860 15720 raft_consensus.cc:2243] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.556384 15720 raft_consensus.cc:2272] T d5b8344825d146b8b8c05ae651fb0d9a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.558976 15720 tablet_replica.cc:333] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.559630 15720 raft_consensus.cc:2243] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.560062 15720 raft_consensus.cc:2272] T 16cd39cc57d84d3db47221d4164f3086 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.562629 15720 tablet_replica.cc:333] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.563174 15720 raft_consensus.cc:2243] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.563676 15720 raft_consensus.cc:2272] T d4f722c735b84bd3a526844bda3371c7 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.565981 15720 tablet_replica.cc:333] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.566593 15720 raft_consensus.cc:2243] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.567118 15720 raft_consensus.cc:2272] T e393e8c4349b473abd5f35159d141168 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.569190 15720 tablet_replica.cc:333] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.569777 15720 raft_consensus.cc:2243] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.570685 15720 raft_consensus.cc:2272] T 988592b5b572476ea8821180ae41bcda P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.573496 15720 tablet_replica.cc:333] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.574158 15720 raft_consensus.cc:2243] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.574769 15720 raft_consensus.cc:2272] T 0e757b2ce6374ff88418cc08fe5cfd25 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.577687 15720 tablet_replica.cc:333] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.578390 15720 raft_consensus.cc:2243] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.578927 15720 raft_consensus.cc:2272] T 1aaa4be81c4a4ce6bc080164640cab8a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.581578 15720 tablet_replica.cc:333] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.582224 15720 raft_consensus.cc:2243] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.583214 15720 raft_consensus.cc:2272] T 5e4bbf8e1a12402f8ecefd83160f4672 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.585863 15720 tablet_replica.cc:333] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.586624 15720 raft_consensus.cc:2243] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.587133 15720 raft_consensus.cc:2272] T 3670fb6e5d3143289ff131f8df729e4a P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.589182 22890 consensus_peers.cc:597] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.584523 22966 consensus_peers.cc:597] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 -> Peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Couldn't send request to peer e9cee38bd2dd4b4e999490708cacd3a9. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.589998 15720 tablet_replica.cc:333] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.590591 15720 raft_consensus.cc:2243] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.591032 15720 raft_consensus.cc:2272] T 748bcf9f05f946f89a17dd918d410984 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.594036 15720 tablet_replica.cc:333] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49: stopping tablet replica
I20260709 13:21:50.594698 15720 raft_consensus.cc:2243] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.596022 15720 raft_consensus.cc:2272] T 1c7056b89dcd402082c0a745eb8e9b79 P 8f307730e7ab4bab9c70d9fa3e51dd49 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.602588 22964 consensus_peers.cc:597] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.611821 22890 consensus_peers.cc:597] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.672464 22890 consensus_peers.cc:597] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:43687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.686380 15720 tablet_server.cc:196] TabletServer@127.15.90.2:0 shutdown complete.
W20260709 13:21:50.730376 22964 consensus_peers.cc:597] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:43687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.745154 22964 consensus_peers.cc:597] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:43687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.766714 22890 consensus_peers.cc:597] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:43687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:50.786584 22890 consensus_peers.cc:597] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:43687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.801153 15720 tablet_server.cc:179] TabletServer@127.15.90.3:0 shutting down...
W20260709 13:21:50.853524 22964 consensus_peers.cc:597] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.872551 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:50.873507 15720 tablet_replica.cc:333] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.874841 15720 raft_consensus.cc:2243] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.875422 15720 raft_consensus.cc:2272] T ffa363e792404ff6b11c80dfb5d5d33e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.877635 15720 tablet_replica.cc:333] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.878334 15720 raft_consensus.cc:2243] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.879132 15720 raft_consensus.cc:2272] T 14c24379e8a84ab9890e18d3c00b9a48 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.881350 15720 tablet_replica.cc:333] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.881891 15720 raft_consensus.cc:2243] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.882673 15720 raft_consensus.cc:2272] T 37f868d307ca42e9bbdac5db09aa91d0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.884681 15720 tablet_replica.cc:333] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.885238 15720 raft_consensus.cc:2243] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.885679 15720 raft_consensus.cc:2272] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.887532 15720 tablet_replica.cc:333] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.888139 15720 raft_consensus.cc:2243] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.888571 15720 raft_consensus.cc:2272] T 6089d12187b140b4bb379b9d3bc7816f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.890472 15720 tablet_replica.cc:333] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.891003 15720 raft_consensus.cc:2243] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.891803 15720 raft_consensus.cc:2272] T d5a393acc19e45f49ed5e6b17ee64d81 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.893702 15720 tablet_replica.cc:333] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.894224 15720 raft_consensus.cc:2243] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.894685 15720 raft_consensus.cc:2272] T d06a32d57e66460a8d02d5a285d93261 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.896991 15720 tablet_replica.cc:333] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.897687 15720 raft_consensus.cc:2243] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.898232 15720 raft_consensus.cc:2272] T b1c5e4b2a4d642ef918c312a6ab1b808 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.900753 15720 tablet_replica.cc:333] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.901607 15720 raft_consensus.cc:2243] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.902091 15720 raft_consensus.cc:2272] T f8427d8842704b1e8a7d20c6a4baf90f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.904198 15720 tablet_replica.cc:333] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.905738 15720 raft_consensus.cc:2243] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.906706 15720 raft_consensus.cc:2272] T 5c86d847eb114cb684092a456952e795 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.909380 15720 tablet_replica.cc:333] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
W20260709 13:21:50.909986 22964 consensus_peers.cc:597] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 -> Peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Couldn't send request to peer 8f307730e7ab4bab9c70d9fa3e51dd49. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:43687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.910141 15720 raft_consensus.cc:2243] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.910689 15720 raft_consensus.cc:2272] T 0e757b2ce6374ff88418cc08fe5cfd25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.912834 15720 tablet_replica.cc:333] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.913373 15720 raft_consensus.cc:2243] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.913789 15720 raft_consensus.cc:2272] T e3b1972dac5349e4b8f76620d14d5d10 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.915732 15720 tablet_replica.cc:333] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.916263 15720 raft_consensus.cc:2243] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.916694 15720 raft_consensus.cc:2272] T 2e393b9cf9a849f4ad63eea1da23ea42 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.918628 15720 tablet_replica.cc:333] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.919168 15720 raft_consensus.cc:2243] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.919613 15720 raft_consensus.cc:2272] T 5d1fb76060d7483698646276d085257f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.922108 15720 tablet_replica.cc:333] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.922801 15720 raft_consensus.cc:2243] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.923270 15720 raft_consensus.cc:2272] T 8785be4ba2dd4539af50dfdc6562cde0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.925273 15720 tablet_replica.cc:333] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.925829 15720 raft_consensus.cc:2243] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.926270 15720 raft_consensus.cc:2272] T 9928bc913a6d4447b83c59ac19cbcf25 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.928309 15720 tablet_replica.cc:333] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.928965 15720 raft_consensus.cc:2243] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.929976 15720 raft_consensus.cc:2272] T 9d6596aca14e4f31bea39731d8a95dfc P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.932107 15720 tablet_replica.cc:333] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.932677 15720 raft_consensus.cc:2243] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.933094 15720 raft_consensus.cc:2272] T d0f2c58a06ac445b85ec78b0e8531134 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.935286 15720 tablet_replica.cc:333] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.936007 15720 raft_consensus.cc:2243] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.936434 15720 raft_consensus.cc:2272] T ea82caef4f4f439c84611d5e6a9c10df P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.938935 15720 tablet_replica.cc:333] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.939515 15720 raft_consensus.cc:2243] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.940013 15720 raft_consensus.cc:2272] T 7915d0ecd98c4c04b76169d6a45314e3 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.941905 15720 tablet_replica.cc:333] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.942435 15720 raft_consensus.cc:2243] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.943225 15720 raft_consensus.cc:2272] T e8f26f54e66f4e90be987ab9d14e554f P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.945416 15720 tablet_replica.cc:333] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.946175 15720 raft_consensus.cc:2243] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.947242 15720 raft_consensus.cc:2272] T be0ee46f570945638b5a510259726a6c P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.949714 15720 tablet_replica.cc:333] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.950380 15720 raft_consensus.cc:2243] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.950917 15720 raft_consensus.cc:2272] T aac6ba45a5de4dfdab02fd99a9ba3976 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.953637 15720 tablet_replica.cc:333] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.954366 15720 raft_consensus.cc:2243] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.955282 15720 raft_consensus.cc:2272] T cf330fe4b59c472a9c3bcb18161ff906 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.957719 15720 tablet_replica.cc:333] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.958238 15720 raft_consensus.cc:2243] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.958979 15720 raft_consensus.cc:2272] T 3c8ad0acb5ce4ffc9edaa00062e64060 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.961128 15720 tablet_replica.cc:333] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.961665 15720 raft_consensus.cc:2243] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.962584 15720 raft_consensus.cc:2272] T f864d0fd88e94640a4e91ad8ebdb19d6 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.965242 15720 tablet_replica.cc:333] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.965965 15720 raft_consensus.cc:2243] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.966511 15720 raft_consensus.cc:2272] T 03c363ea87274bec880ce1c6cdb1faef P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.969144 15720 tablet_replica.cc:333] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.969771 15720 raft_consensus.cc:2243] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.970530 15720 raft_consensus.cc:2272] T 4740c47164894cbe8add259947545a4e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.972589 15720 tablet_replica.cc:333] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.973270 15720 raft_consensus.cc:2243] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.973779 15720 raft_consensus.cc:2272] T b5f1e1efb4c24fafb2972dda3ab17c89 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.976236 15720 tablet_replica.cc:333] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.976895 15720 raft_consensus.cc:2243] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.977808 15720 raft_consensus.cc:2272] T d5b8344825d146b8b8c05ae651fb0d9a P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.980156 15720 tablet_replica.cc:333] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.980856 15720 raft_consensus.cc:2243] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.981396 15720 raft_consensus.cc:2272] T 16cd39cc57d84d3db47221d4164f3086 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.983944 15720 tablet_replica.cc:333] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.984653 15720 raft_consensus.cc:2243] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.985157 15720 raft_consensus.cc:2272] T 4f88630e7ac244caa791ca47a1ef8031 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:50.985582 22964 consensus_peers.cc:597] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:50.987717 15720 tablet_replica.cc:333] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.988564 15720 raft_consensus.cc:2243] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:50.989585 15720 raft_consensus.cc:2272] T f67ba2c2d8c24fe581aab7a2463846ad P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.992187 15720 tablet_replica.cc:333] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.992765 15720 raft_consensus.cc:2243] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.993180 15720 raft_consensus.cc:2272] T ea7e2a19f1474c1fb8f98ee12a3be096 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.995081 15720 tablet_replica.cc:333] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.995759 15720 raft_consensus.cc:2243] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.996155 15720 raft_consensus.cc:2272] T d4f722c735b84bd3a526844bda3371c7 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:50.998180 15720 tablet_replica.cc:333] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:50.998692 15720 raft_consensus.cc:2243] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:50.999089 15720 raft_consensus.cc:2272] T 988592b5b572476ea8821180ae41bcda P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.000941 15720 tablet_replica.cc:333] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:51.001452 15720 raft_consensus.cc:2243] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.002279 15720 raft_consensus.cc:2272] T e393e8c4349b473abd5f35159d141168 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.002385 23937 raft_consensus.cc:493] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:51.002997 23937 raft_consensus.cc:515] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:51.004593 15720 tablet_replica.cc:333] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:51.005337 23937 leader_election.cc:290] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:51.005390 15720 raft_consensus.cc:2243] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.006232 15720 raft_consensus.cc:2272] T 3cac43f433204c9d8dc8d65558ae3269 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.009109 15720 tablet_replica.cc:333] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
W20260709 13:21:51.009402 22964 leader_election.cc:336] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:21:51.009845 15720 raft_consensus.cc:2243] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.010458 15720 raft_consensus.cc:2272] T 028d1f3901024609a35947274e016368 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.011443 22966 leader_election.cc:336] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111)
I20260709 13:21:51.011951 22966 leader_election.cc:304] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:51.012707 23937 raft_consensus.cc:2749] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:51.013047 15720 tablet_replica.cc:333] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:51.013728 15720 raft_consensus.cc:2243] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.014250 15720 raft_consensus.cc:2272] T ac2381149a5f40939b61970905b68e8e P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.016846 15720 tablet_replica.cc:333] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
W20260709 13:21:51.017417 22964 consensus_peers.cc:597] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.017570 15720 raft_consensus.cc:2243] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.018126 15720 raft_consensus.cc:2272] T 48d3f266650349d2a9181aebd298df50 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.020743 15720 tablet_replica.cc:333] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:51.021374 15720 raft_consensus.cc:2243] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.021919 15720 raft_consensus.cc:2272] T bc14860c91ac4d97bc55ddecd79c6ac5 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.024411 15720 tablet_replica.cc:333] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:51.025044 15720 raft_consensus.cc:2243] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.025548 15720 raft_consensus.cc:2272] T 0436364a6d304d108b9d702cec8086c0 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.028156 15720 tablet_replica.cc:333] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6: stopping tablet replica
I20260709 13:21:51.028723 15720 raft_consensus.cc:2243] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.029736 15720 raft_consensus.cc:2272] T 4d21ac823716443b908d3e64bd1270a8 P 618c2d1f207e45ddbb25be76c9d4edf6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.047454 22964 consensus_peers.cc:597] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:51.081557 22964 consensus_peers.cc:597] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.127378 15720 tablet_server.cc:196] TabletServer@127.15.90.3:0 shutdown complete.
W20260709 13:21:51.131052 22964 consensus_peers.cc:597] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:34985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.135957 23918 raft_consensus.cc:493] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:51.136549 23918 raft_consensus.cc:515] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:51.138653 23918 leader_election.cc:290] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
W20260709 13:21:51.148874 22964 leader_election.cc:336] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Network error: Client connection negotiation failed: client connection to 127.15.90.2:43687: connect: Connection refused (error 111)
W20260709 13:21:51.150386 22966 leader_election.cc:336] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111)
I20260709 13:21:51.150815 22966 leader_election.cc:304] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
W20260709 13:21:51.151340 22964 consensus_peers.cc:597] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:34985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.152061 23937 raft_consensus.cc:2749] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:51.158404 22964 consensus_peers.cc:597] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:34985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.237874 23918 raft_consensus.cc:493] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:51.238029 15720 tablet_server.cc:179] TabletServer@127.15.90.4:0 shutting down...
I20260709 13:21:51.238382 23918 raft_consensus.cc:515] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
W20260709 13:21:51.240072 22964 consensus_peers.cc:597] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:34985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.241760 23918 leader_election.cc:290] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
W20260709 13:21:51.245134 22966 leader_election.cc:336] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111)
W20260709 13:21:51.247515 22964 leader_election.cc:336] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Network error: Client connection negotiation failed: client connection to 127.15.90.2:43687: connect: Connection refused (error 111)
I20260709 13:21:51.247929 22964 leader_election.cc:304] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:51.248534 23918 raft_consensus.cc:2749] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:21:51.286011 22964 consensus_peers.cc:597] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 -> Peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Couldn't send request to peer 618c2d1f207e45ddbb25be76c9d4edf6. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.3:34985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:51.291466 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:51.292449 15720 tablet_replica.cc:333] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.293498 15720 raft_consensus.cc:2243] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.294420 15720 raft_consensus.cc:2272] T ffa363e792404ff6b11c80dfb5d5d33e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.296691 15720 tablet_replica.cc:333] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.297263 15720 raft_consensus.cc:2243] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.297683 15720 raft_consensus.cc:2272] T 14c24379e8a84ab9890e18d3c00b9a48 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.299806 15720 tablet_replica.cc:333] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.300377 15720 raft_consensus.cc:2243] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.301127 15720 raft_consensus.cc:2272] T fde2d13e9f7c4d7880772615ce0d811c P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.304636 15720 tablet_replica.cc:333] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.305230 15720 raft_consensus.cc:2243] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.306020 15720 raft_consensus.cc:2272] T 6089d12187b140b4bb379b9d3bc7816f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.307435 23918 raft_consensus.cc:493] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:51.308344 15720 tablet_replica.cc:333] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.308028 23918 raft_consensus.cc:515] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:51.309080 15720 raft_consensus.cc:2243] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.309849 15720 raft_consensus.cc:2272] T d4cd6f22ac074dedac9f3eb3ccc1bb80 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.310434 23918 leader_election.cc:290] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:51.312670 15720 tablet_replica.cc:333] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.313566 15720 raft_consensus.cc:2243] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.314116 15720 raft_consensus.cc:2272] T 37f868d307ca42e9bbdac5db09aa91d0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.314512 23918 raft_consensus.cc:493] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:51.315096 23918 raft_consensus.cc:515] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } } peers { permanent_uuid: "8f307730e7ab4bab9c70d9fa3e51dd49" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 43687 } }
I20260709 13:21:51.317054 15720 tablet_replica.cc:333] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.317286 23918 leader_election.cc:290] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811), 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687)
I20260709 13:21:51.317965 15720 raft_consensus.cc:2243] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.318624 15720 raft_consensus.cc:2272] T 5c86d847eb114cb684092a456952e795 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.317998 22964 leader_election.cc:336] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Network error: Client connection negotiation failed: client connection to 127.15.90.3:34985: connect: Connection refused (error 111)
W20260709 13:21:51.319191 22966 leader_election.cc:336] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111)
I20260709 13:21:51.321215 15720 tablet_replica.cc:333] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.321635 22966 leader_election.cc:304] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:51.322153 15720 raft_consensus.cc:2243] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.322535 23918 raft_consensus.cc:2749] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:21:51.323210 15720 raft_consensus.cc:2272] T f8427d8842704b1e8a7d20c6a4baf90f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.325889 22966 leader_election.cc:336] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111)
I20260709 13:21:51.326028 15720 tablet_replica.cc:333] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
W20260709 13:21:51.326941 22964 leader_election.cc:336] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8f307730e7ab4bab9c70d9fa3e51dd49 (127.15.90.2:43687): Network error: Client connection negotiation failed: client connection to 127.15.90.2:43687: connect: Connection refused (error 111)
I20260709 13:21:51.327075 15720 raft_consensus.cc:2243] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.327335 22964 leader_election.cc:304] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 8f307730e7ab4bab9c70d9fa3e51dd49, e9cee38bd2dd4b4e999490708cacd3a9
I20260709 13:21:51.327652 15720 raft_consensus.cc:2272] T 9d6596aca14e4f31bea39731d8a95dfc P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.328034 23918 raft_consensus.cc:2749] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:21:51.332345 15720 tablet_replica.cc:333] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.333500 15720 raft_consensus.cc:2243] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.334112 15720 raft_consensus.cc:2272] T 988592b5b572476ea8821180ae41bcda P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.337138 15720 tablet_replica.cc:333] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.338054 15720 raft_consensus.cc:2243] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.338697 15720 raft_consensus.cc:2272] T 8785be4ba2dd4539af50dfdc6562cde0 P f825e4bed376497e95838e1b82dc1a03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.344384 15720 tablet_replica.cc:333] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.345184 15720 raft_consensus.cc:2243] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.345683 15720 raft_consensus.cc:2272] T 5d1fb76060d7483698646276d085257f P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.348318 15720 tablet_replica.cc:333] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.349054 15720 raft_consensus.cc:2243] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.349574 15720 raft_consensus.cc:2272] T 33209c9cbc0949fb933224b7cb5dce53 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.352257 15720 tablet_replica.cc:333] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.353137 15720 raft_consensus.cc:2243] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.353658 15720 raft_consensus.cc:2272] T d0f2c58a06ac445b85ec78b0e8531134 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.356647 15720 tablet_replica.cc:333] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.357509 15720 raft_consensus.cc:2243] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.358064 15720 raft_consensus.cc:2272] T ea82caef4f4f439c84611d5e6a9c10df P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.360783 15720 tablet_replica.cc:333] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.361503 15720 raft_consensus.cc:2243] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.362538 15720 raft_consensus.cc:2272] T 7915d0ecd98c4c04b76169d6a45314e3 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.365455 15720 tablet_replica.cc:333] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.366204 15720 raft_consensus.cc:2243] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.366685 15720 raft_consensus.cc:2272] T e8f26f54e66f4e90be987ab9d14e554f P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.369640 15720 tablet_replica.cc:333] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.370442 15720 raft_consensus.cc:2243] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.371065 15720 raft_consensus.cc:2272] T be0ee46f570945638b5a510259726a6c P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.374315 15720 tablet_replica.cc:333] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.375238 15720 raft_consensus.cc:2243] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.376340 15720 raft_consensus.cc:2272] T aac6ba45a5de4dfdab02fd99a9ba3976 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.379417 15720 tablet_replica.cc:333] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.380199 15720 raft_consensus.cc:2243] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.380687 15720 raft_consensus.cc:2272] T f864d0fd88e94640a4e91ad8ebdb19d6 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.383733 15720 tablet_replica.cc:333] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.384595 15720 raft_consensus.cc:2243] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.385269 15720 raft_consensus.cc:2272] T 3c8ad0acb5ce4ffc9edaa00062e64060 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.388295 15720 tablet_replica.cc:333] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.388965 15720 raft_consensus.cc:2243] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.389606 15720 raft_consensus.cc:2272] T e3b1972dac5349e4b8f76620d14d5d10 P f825e4bed376497e95838e1b82dc1a03 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.391398 15720 tablet_replica.cc:333] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.391997 15720 raft_consensus.cc:2243] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.392417 15720 raft_consensus.cc:2272] T 03c363ea87274bec880ce1c6cdb1faef P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.394323 15720 tablet_replica.cc:333] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.394842 15720 raft_consensus.cc:2243] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.395334 15720 raft_consensus.cc:2272] T 4c48bfd3488f4ab8b00547a92e0eb843 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.397317 15720 tablet_replica.cc:333] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.397822 15720 raft_consensus.cc:2243] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.398240 15720 raft_consensus.cc:2272] T 4740c47164894cbe8add259947545a4e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.400274 15720 tablet_replica.cc:333] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.400789 15720 raft_consensus.cc:2243] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.401484 15720 raft_consensus.cc:2272] T 89d50aaee99348959ee8e1d85e3c18bb P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.403414 15720 tablet_replica.cc:333] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.403982 15720 raft_consensus.cc:2243] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.404762 15720 raft_consensus.cc:2272] T 4f88630e7ac244caa791ca47a1ef8031 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.406701 15720 tablet_replica.cc:333] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.407279 15720 raft_consensus.cc:2243] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.408046 15720 raft_consensus.cc:2272] T 62e34545b8f644c28059e013cdd0590b P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.409869 15720 tablet_replica.cc:333] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.410398 15720 raft_consensus.cc:2243] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.410830 15720 raft_consensus.cc:2272] T f67ba2c2d8c24fe581aab7a2463846ad P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.412734 15720 tablet_replica.cc:333] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.413246 15720 raft_consensus.cc:2243] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.413651 15720 raft_consensus.cc:2272] T b29fe64535814ccd8d9f4f20f00c6f1d P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.415483 15720 tablet_replica.cc:333] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.416009 15720 raft_consensus.cc:2243] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.416766 15720 raft_consensus.cc:2272] T ea7e2a19f1474c1fb8f98ee12a3be096 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.418658 15720 tablet_replica.cc:333] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.419169 15720 raft_consensus.cc:2243] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.419596 15720 raft_consensus.cc:2272] T 1aaa4be81c4a4ce6bc080164640cab8a P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.421450 15720 tablet_replica.cc:333] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.421960 15720 raft_consensus.cc:2243] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.422364 15720 raft_consensus.cc:2272] T 5e4bbf8e1a12402f8ecefd83160f4672 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.424348 15720 tablet_replica.cc:333] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.424840 15720 raft_consensus.cc:2243] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.425596 15720 raft_consensus.cc:2272] T 3670fb6e5d3143289ff131f8df729e4a P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.427480 15720 tablet_replica.cc:333] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.428017 15720 raft_consensus.cc:2243] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.428407 15720 raft_consensus.cc:2272] T 748bcf9f05f946f89a17dd918d410984 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.430224 15720 tablet_replica.cc:333] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.430717 15720 raft_consensus.cc:2243] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.431118 15720 raft_consensus.cc:2272] T 1c7056b89dcd402082c0a745eb8e9b79 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.433828 15720 tablet_replica.cc:333] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.434502 15720 raft_consensus.cc:2243] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.434367 23918 raft_consensus.cc:493] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e9cee38bd2dd4b4e999490708cacd3a9)
I20260709 13:21:51.435139 23918 raft_consensus.cc:515] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "618c2d1f207e45ddbb25be76c9d4edf6" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 34985 } } peers { permanent_uuid: "f825e4bed376497e95838e1b82dc1a03" member_type: VOTER last_known_addr { host: "127.15.90.4" port: 44325 } } peers { permanent_uuid: "e9cee38bd2dd4b4e999490708cacd3a9" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 34811 } }
I20260709 13:21:51.435763 15720 raft_consensus.cc:2272] T 028d1f3901024609a35947274e016368 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.437354 23918 leader_election.cc:290] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985), e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811)
I20260709 13:21:51.438511 15720 tablet_replica.cc:333] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.439333 15720 raft_consensus.cc:2243] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.439893 15720 raft_consensus.cc:2272] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.442399 22966 leader_election.cc:336] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e9cee38bd2dd4b4e999490708cacd3a9 (127.15.90.1:34811): Network error: Client connection negotiation failed: client connection to 127.15.90.1:34811: connect: Connection refused (error 111)
I20260709 13:21:51.442570 15720 tablet_replica.cc:333] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.443523 15720 raft_consensus.cc:2243] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.444099 15720 raft_consensus.cc:2272] T 3cac43f433204c9d8dc8d65558ae3269 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:51.444433 22964 leader_election.cc:336] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 618c2d1f207e45ddbb25be76c9d4edf6 (127.15.90.3:34985): Network error: Client connection negotiation failed: client connection to 127.15.90.3:34985: connect: Connection refused (error 111)
I20260709 13:21:51.444859 22964 leader_election.cc:304] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f825e4bed376497e95838e1b82dc1a03; no voters: 618c2d1f207e45ddbb25be76c9d4edf6, e9cee38bd2dd4b4e999490708cacd3a9
W20260709 13:21:51.445441 22964 raft_consensus.cc:2686] T ac2381149a5f40939b61970905b68e8e P f825e4bed376497e95838e1b82dc1a03: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:21:51.446550 15720 tablet_replica.cc:333] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.447125 15720 raft_consensus.cc:2243] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.447585 15720 raft_consensus.cc:2272] T 48d3f266650349d2a9181aebd298df50 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.449671 15720 tablet_replica.cc:333] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.450172 15720 raft_consensus.cc:2243] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:51.450912 15720 raft_consensus.cc:2272] T 670cb5d0cf514ec78871a6a32e316c13 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.452864 15720 tablet_replica.cc:333] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.453532 15720 raft_consensus.cc:2243] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.454056 15720 raft_consensus.cc:2272] T 9d6efd72b4114248adef337292eaede0 P f825e4bed376497e95838e1b82dc1a03 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.455961 15720 tablet_replica.cc:333] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.456423 15720 raft_consensus.cc:2243] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.456817 15720 raft_consensus.cc:2272] T 9c5b0b4e5dc64c67a2830174409b84d9 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:51.458577 15720 tablet_replica.cc:333] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03: stopping tablet replica
I20260709 13:21:51.458999 15720 raft_consensus.cc:2243] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:51.459389 15720 raft_consensus.cc:2272] T c42f0026e60841c6b5a416128dc2f590 P f825e4bed376497e95838e1b82dc1a03 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:52.524405 15720 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23022)
W20260709 13:21:53.524942 15720 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23022)
I20260709 13:21:53.821771 15720 tablet_server.cc:196] TabletServer@127.15.90.4:0 shutdown complete.
I20260709 13:21:53.886741 15720 master.cc:562] Master@127.15.90.62:36463 shutting down...
I20260709 13:21:53.913165 15720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:53.913725 15720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:53.914062 15720 tablet_replica.cc:333] T 00000000000000000000000000000000 P eaea83fbf998431c991b081d9626e112: stopping tablet replica
I20260709 13:21:53.936636 15720 master.cc:584] Master@127.15.90.62:36463 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32381 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:21:54.022046 15720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.90.62:43891
I20260709 13:21:54.023224 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:54.029481 23939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.029990 23940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.030759 23942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:54.031448 15720 server_base.cc:1061] running on GCE node
I20260709 13:21:54.032593 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:54.032812 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:54.032996 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603314032971 us; error 0 us; skew 500 ppm
I20260709 13:21:54.033501 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:54.036029 15720 webserver.cc:533] Webserver started at http://127.15.90.62:33683/ using document root <none> and password file <none>
I20260709 13:21:54.036521 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:54.036723 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:54.037006 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:54.038224 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/master-0-root/instance:
uuid: "b54b0629232842c487e7145728c65674"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-fpp7"
I20260709 13:21:54.042550 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:21:54.046114 23947 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.046875 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:21:54.047192 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/master-0-root
uuid: "b54b0629232842c487e7145728c65674"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-fpp7"
I20260709 13:21:54.047462 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:54.069774 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:54.071007 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:54.109184 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.62:43891
I20260709 13:21:54.109310 23998 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.62:43891 every 8 connection(s)
I20260709 13:21:54.113202 23999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.123376 23999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674: Bootstrap starting.
I20260709 13:21:54.128090 23999 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.132177 23999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674: No bootstrap required, opened a new log
I20260709 13:21:54.134266 23999 raft_consensus.cc:359] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54b0629232842c487e7145728c65674" member_type: VOTER }
I20260709 13:21:54.134635 23999 raft_consensus.cc:385] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.134811 23999 raft_consensus.cc:740] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b54b0629232842c487e7145728c65674, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.135386 23999 consensus_queue.cc:260] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54b0629232842c487e7145728c65674" member_type: VOTER }
I20260709 13:21:54.135820 23999 raft_consensus.cc:399] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:21:54.136006 23999 raft_consensus.cc:493] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:21:54.136210 23999 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.141047 23999 raft_consensus.cc:515] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54b0629232842c487e7145728c65674" member_type: VOTER }
I20260709 13:21:54.141570 23999 leader_election.cc:304] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b54b0629232842c487e7145728c65674; no voters: 
I20260709 13:21:54.142637 23999 leader_election.cc:290] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:21:54.143059 24002 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.144531 24002 raft_consensus.cc:697] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [term 1 LEADER]: Becoming Leader. State: Replica: b54b0629232842c487e7145728c65674, State: Running, Role: LEADER
I20260709 13:21:54.145264 24002 consensus_queue.cc:237] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54b0629232842c487e7145728c65674" member_type: VOTER }
I20260709 13:21:54.145733 23999 sys_catalog.cc:565] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:21:54.150183 24004 sys_catalog.cc:455] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b54b0629232842c487e7145728c65674. Latest consensus state: current_term: 1 leader_uuid: "b54b0629232842c487e7145728c65674" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54b0629232842c487e7145728c65674" member_type: VOTER } }
I20260709 13:21:54.150960 24004 sys_catalog.cc:458] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:54.150763 24003 sys_catalog.cc:455] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b54b0629232842c487e7145728c65674" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b54b0629232842c487e7145728c65674" member_type: VOTER } }
I20260709 13:21:54.151643 24003 sys_catalog.cc:458] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [sys.catalog]: This master's current role is: LEADER
I20260709 13:21:54.154390 24010 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:21:54.159155 24010 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:21:54.162209 15720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:21:54.168030 24010 catalog_manager.cc:1383] Generated new cluster ID: 9698ddfefe954ad39e2f2d46a1aa0b3f
I20260709 13:21:54.168318 24010 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:21:54.195942 24010 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:21:54.197247 24010 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:21:54.209014 24010 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674: Generated new TSK 0
I20260709 13:21:54.209638 24010 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:21:54.229249 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:54.235505 24020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.236452 24021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.238251 24023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:54.238843 15720 server_base.cc:1061] running on GCE node
I20260709 13:21:54.239804 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:54.239986 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:54.240103 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603314240092 us; error 0 us; skew 500 ppm
I20260709 13:21:54.240579 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:54.242810 15720 webserver.cc:533] Webserver started at http://127.15.90.1:36447/ using document root <none> and password file <none>
I20260709 13:21:54.243235 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:54.243391 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:54.243597 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:54.244678 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-0-root/instance:
uuid: "9881332cab4e4ab595147d53ae98b5bd"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-fpp7"
I20260709 13:21:54.248934 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:21:54.252588 24028 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.253389 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:21:54.253710 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-0-root
uuid: "9881332cab4e4ab595147d53ae98b5bd"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-fpp7"
I20260709 13:21:54.254009 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:54.268473 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:54.269711 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:54.271181 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:54.273484 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:54.273705 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.273950 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:54.274138 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.314874 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.1:46281
I20260709 13:21:54.314988 24090 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.1:46281 every 8 connection(s)
I20260709 13:21:54.320132 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:54.327272 24095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.330073 24096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.333550 24098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:54.334101 15720 server_base.cc:1061] running on GCE node
I20260709 13:21:54.334640 24091 heartbeater.cc:344] Connected to a master server at 127.15.90.62:43891
I20260709 13:21:54.335057 24091 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:54.335548 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:21:54.335863 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:54.335872 24091 heartbeater.cc:507] Master 127.15.90.62:43891 requested a full tablet report, sending...
I20260709 13:21:54.336057 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603314336041 us; error 0 us; skew 500 ppm
I20260709 13:21:54.336766 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:54.338603 23964 ts_manager.cc:194] Registered new tserver with Master: 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281)
I20260709 13:21:54.339484 15720 webserver.cc:533] Webserver started at http://127.15.90.2:36067/ using document root <none> and password file <none>
I20260709 13:21:54.340063 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:54.340272 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:54.340561 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:54.340709 23964 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38748
I20260709 13:21:54.341961 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-1-root/instance:
uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-fpp7"
I20260709 13:21:54.346292 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:21:54.349833 24103 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.350601 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:21:54.350900 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-1-root
uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-fpp7"
I20260709 13:21:54.351203 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:54.374147 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:54.375433 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:54.376963 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:54.379199 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:54.379437 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.379719 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:54.379908 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:21:54.420572 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.2:41943
I20260709 13:21:54.420691 24165 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.2:41943 every 8 connection(s)
I20260709 13:21:54.425417 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:21:54.433796 24169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:21:54.434854 24170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:54.438542 15720 server_base.cc:1061] running on GCE node
I20260709 13:21:54.438668 24166 heartbeater.cc:344] Connected to a master server at 127.15.90.62:43891
W20260709 13:21:54.438865 24172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:21:54.439174 24166 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:54.440129 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:21:54.440186 24166 heartbeater.cc:507] Master 127.15.90.62:43891 requested a full tablet report, sending...
W20260709 13:21:54.440615 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:21:54.440850 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603314440807 us; error 0 us; skew 500 ppm
I20260709 13:21:54.441457 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:21:54.442636 23964 ts_manager.cc:194] Registered new tserver with Master: ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:54.444439 23964 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38758
I20260709 13:21:54.445588 15720 webserver.cc:533] Webserver started at http://127.15.90.3:39863/ using document root <none> and password file <none>
I20260709 13:21:54.446285 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:21:54.446533 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:21:54.446843 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:21:54.448109 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-2-root/instance:
uuid: "f9f4275b212a48b8a777c34b01a975f3"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-fpp7"
I20260709 13:21:54.452569 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:21:54.455885 24177 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.456840 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:21:54.457155 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-2-root
uuid: "f9f4275b212a48b8a777c34b01a975f3"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-fpp7"
I20260709 13:21:54.457468 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:21:54.488161 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:21:54.489399 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:21:54.490864 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:21:54.493070 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:21:54.493299 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.493546 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:21:54.493716 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:21:54.533705 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.3:40549
I20260709 13:21:54.533803 24239 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.3:40549 every 8 connection(s)
I20260709 13:21:54.547318 24240 heartbeater.cc:344] Connected to a master server at 127.15.90.62:43891
I20260709 13:21:54.547721 24240 heartbeater.cc:461] Registering TS with master...
I20260709 13:21:54.548395 24240 heartbeater.cc:507] Master 127.15.90.62:43891 requested a full tablet report, sending...
I20260709 13:21:54.550259 23964 ts_manager.cc:194] Registered new tserver with Master: f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:54.550463 15720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013537717s
I20260709 13:21:54.551599 23964 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38760
I20260709 13:21:54.574750 23964 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38774:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:21:54.577646 23964 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:21:54.656669 24056 tablet_service.cc:1511] Processing CreateTablet for tablet 654798d1f7154143bb961fd8161627f2 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:54.656615 24054 tablet_service.cc:1511] Processing CreateTablet for tablet 569665773261478485c85ce61d1c6c31 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:54.658234 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654798d1f7154143bb961fd8161627f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.658870 24055 tablet_service.cc:1511] Processing CreateTablet for tablet ad696309438a4a93b6679eac647958e6 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:54.660245 24055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad696309438a4a93b6679eac647958e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.662040 24131 tablet_service.cc:1511] Processing CreateTablet for tablet 654798d1f7154143bb961fd8161627f2 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:54.663741 24131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654798d1f7154143bb961fd8161627f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.665109 24129 tablet_service.cc:1511] Processing CreateTablet for tablet 569665773261478485c85ce61d1c6c31 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:54.666426 24129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569665773261478485c85ce61d1c6c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.667008 24205 tablet_service.cc:1511] Processing CreateTablet for tablet 654798d1f7154143bb961fd8161627f2 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:21:54.667328 24204 tablet_service.cc:1511] Processing CreateTablet for tablet ad696309438a4a93b6679eac647958e6 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:54.667718 24130 tablet_service.cc:1511] Processing CreateTablet for tablet ad696309438a4a93b6679eac647958e6 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:21:54.668380 24205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654798d1f7154143bb961fd8161627f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.669032 24204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad696309438a4a93b6679eac647958e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.669086 24130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad696309438a4a93b6679eac647958e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.675747 24054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569665773261478485c85ce61d1c6c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.696810 24255 tablet_bootstrap.cc:492] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e: Bootstrap starting.
I20260709 13:21:54.699148 24053 tablet_service.cc:1511] Processing CreateTablet for tablet fd656814ed0044ec9af23bd2551e6fed (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:54.700567 24053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd656814ed0044ec9af23bd2551e6fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.703667 24203 tablet_service.cc:1511] Processing CreateTablet for tablet 569665773261478485c85ce61d1c6c31 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:21:54.705085 24203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569665773261478485c85ce61d1c6c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.727011 24131 tablet_service.cc:1511] Processing CreateTablet for tablet fd656814ed0044ec9af23bd2551e6fed (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:54.728477 24131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd656814ed0044ec9af23bd2551e6fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.730186 24255 tablet_bootstrap.cc:654] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.732730 24256 tablet_bootstrap.cc:492] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:21:54.736653 24202 tablet_service.cc:1511] Processing CreateTablet for tablet fd656814ed0044ec9af23bd2551e6fed (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:21:54.738036 24202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd656814ed0044ec9af23bd2551e6fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.738605 24054 tablet_service.cc:1511] Processing CreateTablet for tablet 21af5a82fb87418a96151689b649313d (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:54.740746 24054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21af5a82fb87418a96151689b649313d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.747225 24131 tablet_service.cc:1511] Processing CreateTablet for tablet 21af5a82fb87418a96151689b649313d (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:54.749936 24131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21af5a82fb87418a96151689b649313d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.755402 24204 tablet_service.cc:1511] Processing CreateTablet for tablet 21af5a82fb87418a96151689b649313d (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:21:54.757020 24204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21af5a82fb87418a96151689b649313d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.758735 24053 tablet_service.cc:1511] Processing CreateTablet for tablet b5db628004a740b3ad36e4194fb92de8 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:54.760083 24130 tablet_service.cc:1511] Processing CreateTablet for tablet b5db628004a740b3ad36e4194fb92de8 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:54.754361 24257 tablet_bootstrap.cc:492] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3: Bootstrap starting.
I20260709 13:21:54.761375 24130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5db628004a740b3ad36e4194fb92de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.762018 24256 tablet_bootstrap.cc:654] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.762267 24203 tablet_service.cc:1511] Processing CreateTablet for tablet b5db628004a740b3ad36e4194fb92de8 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:21:54.763518 24203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5db628004a740b3ad36e4194fb92de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.764645 24053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5db628004a740b3ad36e4194fb92de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.771747 24056 tablet_service.cc:1511] Processing CreateTablet for tablet 41c152dd2a6f442a92e00a1a126bc80c (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:54.773119 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c152dd2a6f442a92e00a1a126bc80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.791849 24257 tablet_bootstrap.cc:654] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.794227 24129 tablet_service.cc:1511] Processing CreateTablet for tablet 41c152dd2a6f442a92e00a1a126bc80c (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:54.795634 24129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c152dd2a6f442a92e00a1a126bc80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.800210 24256 tablet_bootstrap.cc:492] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd: No bootstrap required, opened a new log
I20260709 13:21:54.800747 24256 ts_tablet_manager.cc:1403] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.018s
I20260709 13:21:54.804469 24256 raft_consensus.cc:359] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.805446 24256 raft_consensus.cc:385] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.805809 24256 raft_consensus.cc:740] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.806694 24256 consensus_queue.cc:260] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.810261 24204 tablet_service.cc:1511] Processing CreateTablet for tablet 41c152dd2a6f442a92e00a1a126bc80c (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:21:54.811650 24204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c152dd2a6f442a92e00a1a126bc80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.813427 24131 tablet_service.cc:1511] Processing CreateTablet for tablet 24a28bb4f7f9422ab2afbad72729bb1a (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:54.814736 24131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a28bb4f7f9422ab2afbad72729bb1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.814868 24255 tablet_bootstrap.cc:492] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e: No bootstrap required, opened a new log
I20260709 13:21:54.815649 24255 ts_tablet_manager.cc:1403] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.000s
I20260709 13:21:54.816365 24257 tablet_bootstrap.cc:492] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3: No bootstrap required, opened a new log
I20260709 13:21:54.815819 24053 tablet_service.cc:1511] Processing CreateTablet for tablet 24a28bb4f7f9422ab2afbad72729bb1a (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:54.820194 24053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a28bb4f7f9422ab2afbad72729bb1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.838093 24056 tablet_service.cc:1511] Processing CreateTablet for tablet de2c13350cc54941bff39bab69daa1fb (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:54.839776 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2c13350cc54941bff39bab69daa1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.839601 24131 tablet_service.cc:1511] Processing CreateTablet for tablet de2c13350cc54941bff39bab69daa1fb (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:54.823766 24257 ts_tablet_manager.cc:1403] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.005s
I20260709 13:21:54.841099 24131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2c13350cc54941bff39bab69daa1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.832634 24091 heartbeater.cc:499] Master 127.15.90.62:43891 was elected leader, sending a full tablet report...
I20260709 13:21:54.843389 24257 raft_consensus.cc:359] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.848220 24257 raft_consensus.cc:385] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.848623 24257 raft_consensus.cc:740] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.849601 24257 consensus_queue.cc:260] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.834697 24204 tablet_service.cc:1511] Processing CreateTablet for tablet 24a28bb4f7f9422ab2afbad72729bb1a (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:21:54.852985 24204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a28bb4f7f9422ab2afbad72729bb1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.856088 24240 heartbeater.cc:499] Master 127.15.90.62:43891 was elected leader, sending a full tablet report...
I20260709 13:21:54.856750 24257 ts_tablet_manager.cc:1434] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:21:54.857880 24257 tablet_bootstrap.cc:492] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3: Bootstrap starting.
I20260709 13:21:54.833523 24256 ts_tablet_manager.cc:1434] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.023s
I20260709 13:21:54.862078 24256 tablet_bootstrap.cc:492] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:21:54.865020 24257 tablet_bootstrap.cc:654] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.868024 24203 tablet_service.cc:1511] Processing CreateTablet for tablet de2c13350cc54941bff39bab69daa1fb (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:21:54.869351 24203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2c13350cc54941bff39bab69daa1fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.869514 24256 tablet_bootstrap.cc:654] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.819653 24255 raft_consensus.cc:359] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.871918 24255 raft_consensus.cc:385] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.872406 24255 raft_consensus.cc:740] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.874692 24255 consensus_queue.cc:260] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.883153 24129 tablet_service.cc:1511] Processing CreateTablet for tablet 07696622824f41a3ba412dd532854333 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:54.884507 24129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07696622824f41a3ba412dd532854333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.884581 24202 tablet_service.cc:1511] Processing CreateTablet for tablet 07696622824f41a3ba412dd532854333 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:54.885792 24202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07696622824f41a3ba412dd532854333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.887943 24262 raft_consensus.cc:493] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:54.888437 24262 raft_consensus.cc:515] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.903961 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569665773261478485c85ce61d1c6c31" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd" is_pre_election: true
W20260709 13:21:54.905678 24180 leader_election.cc:343] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:54.907581 24056 tablet_service.cc:1511] Processing CreateTablet for tablet 07696622824f41a3ba412dd532854333 (DEFAULT_TABLE table=test-workload [id=48b57a56170d43949a71858ca332ac33]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:21:54.909752 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07696622824f41a3ba412dd532854333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:21:54.915632 24262 leader_election.cc:290] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:54.919449 24257 tablet_bootstrap.cc:492] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3: No bootstrap required, opened a new log
I20260709 13:21:54.922850 24257 ts_tablet_manager.cc:1403] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3: Time spent bootstrapping tablet: real 0.065s	user 0.038s	sys 0.008s
I20260709 13:21:54.924501 24141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569665773261478485c85ce61d1c6c31" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:54.925282 24141 raft_consensus.cc:2468] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 0.
I20260709 13:21:54.926421 24256 tablet_bootstrap.cc:492] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd: No bootstrap required, opened a new log
I20260709 13:21:54.926744 24178 leader_election.cc:304] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 9881332cab4e4ab595147d53ae98b5bd
I20260709 13:21:54.926978 24256 ts_tablet_manager.cc:1403] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.012s
I20260709 13:21:54.927266 24166 heartbeater.cc:499] Master 127.15.90.62:43891 was elected leader, sending a full tablet report...
I20260709 13:21:54.928037 24262 raft_consensus.cc:2804] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:54.928467 24262 raft_consensus.cc:493] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:54.928787 24262 raft_consensus.cc:3060] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.930109 24256 raft_consensus.cc:359] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.930864 24256 raft_consensus.cc:385] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.931207 24256 raft_consensus.cc:740] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.932004 24256 consensus_queue.cc:260] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.928076 24255 ts_tablet_manager.cc:1434] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent starting tablet: real 0.112s	user 0.011s	sys 0.008s
I20260709 13:21:54.936043 24255 tablet_bootstrap.cc:492] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e: Bootstrap starting.
I20260709 13:21:54.936359 24262 raft_consensus.cc:515] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.934391 24256 ts_tablet_manager.cc:1434] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:54.939070 24256 tablet_bootstrap.cc:492] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:21:54.940850 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569665773261478485c85ce61d1c6c31" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:21:54.941617 24066 raft_consensus.cc:3060] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.946244 24256 tablet_bootstrap.cc:654] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.950518 24066 raft_consensus.cc:2468] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 1.
I20260709 13:21:54.956061 24141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569665773261478485c85ce61d1c6c31" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:54.926779 24257 raft_consensus.cc:359] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.956691 24141 raft_consensus.cc:3060] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:54.956770 24257 raft_consensus.cc:385] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.957327 24257 raft_consensus.cc:740] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.946722 24255 tablet_bootstrap.cc:654] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.959738 24257 consensus_queue.cc:260] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.966368 24141 raft_consensus.cc:2468] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 1.
I20260709 13:21:54.967381 24262 leader_election.cc:290] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:54.967598 24178 leader_election.cc:304] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:54.968487 24262 raft_consensus.cc:2804] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:54.968923 24262 raft_consensus.cc:697] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Becoming Leader. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:21:54.969816 24262 consensus_queue.cc:237] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.971195 24257 ts_tablet_manager.cc:1434] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:21:54.972311 24257 tablet_bootstrap.cc:492] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3: Bootstrap starting.
I20260709 13:21:54.978246 24255 tablet_bootstrap.cc:492] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e: No bootstrap required, opened a new log
I20260709 13:21:54.979007 24255 ts_tablet_manager.cc:1403] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.000s
I20260709 13:21:54.980926 24256 tablet_bootstrap.cc:492] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: No bootstrap required, opened a new log
I20260709 13:21:54.980993 24257 tablet_bootstrap.cc:654] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:54.981688 24256 ts_tablet_manager.cc:1403] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.014s
I20260709 13:21:54.982120 23964 catalog_manager.cc:5697] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "f9f4275b212a48b8a777c34b01a975f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:54.984818 24256 raft_consensus.cc:359] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.982631 24255 raft_consensus.cc:359] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.985615 24256 raft_consensus.cc:385] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.985870 24255 raft_consensus.cc:385] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:54.986093 24256 raft_consensus.cc:740] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.986418 24255 raft_consensus.cc:740] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Initialized, Role: FOLLOWER
I20260709 13:21:54.987151 24256 consensus_queue.cc:260] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.987453 24255 consensus_queue.cc:260] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:54.989529 24256 ts_tablet_manager.cc:1434] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:54.990603 24256 tablet_bootstrap.cc:492] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:21:54.992686 24255 ts_tablet_manager.cc:1434] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:21:54.994190 24255 tablet_bootstrap.cc:492] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e: Bootstrap starting.
I20260709 13:21:54.998761 24257 tablet_bootstrap.cc:492] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3: No bootstrap required, opened a new log
I20260709 13:21:54.999490 24257 ts_tablet_manager.cc:1403] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.011s
I20260709 13:21:55.001237 24255 tablet_bootstrap.cc:654] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.002673 24257 raft_consensus.cc:359] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.003532 24257 raft_consensus.cc:385] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.003901 24257 raft_consensus.cc:740] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.004436 24256 tablet_bootstrap.cc:654] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.004949 24257 consensus_queue.cc:260] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.008507 24257 ts_tablet_manager.cc:1434] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:21:55.009843 24257 tablet_bootstrap.cc:492] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3: Bootstrap starting.
I20260709 13:21:55.013298 24255 tablet_bootstrap.cc:492] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e: No bootstrap required, opened a new log
I20260709 13:21:55.013926 24255 ts_tablet_manager.cc:1403] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:21:55.014258 24256 tablet_bootstrap.cc:492] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd: No bootstrap required, opened a new log
I20260709 13:21:55.014803 24256 ts_tablet_manager.cc:1403] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.002s
I20260709 13:21:55.016683 24257 tablet_bootstrap.cc:654] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.017107 24255 raft_consensus.cc:359] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.017957 24255 raft_consensus.cc:385] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.017647 24256 raft_consensus.cc:359] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.018330 24255 raft_consensus.cc:740] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.018517 24256 raft_consensus.cc:385] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.018894 24256 raft_consensus.cc:740] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.019170 24255 consensus_queue.cc:260] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.019742 24256 consensus_queue.cc:260] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.022110 24257 tablet_bootstrap.cc:492] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3: No bootstrap required, opened a new log
I20260709 13:21:55.022811 24257 ts_tablet_manager.cc:1403] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.008s
I20260709 13:21:55.023725 24255 ts_tablet_manager.cc:1434] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:21:55.024802 24255 tablet_bootstrap.cc:492] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e: Bootstrap starting.
I20260709 13:21:55.025744 24257 raft_consensus.cc:359] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.026520 24257 raft_consensus.cc:385] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.026796 24257 raft_consensus.cc:740] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.027518 24257 consensus_queue.cc:260] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.029716 24257 ts_tablet_manager.cc:1434] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:55.030696 24257 tablet_bootstrap.cc:492] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3: Bootstrap starting.
I20260709 13:21:55.022167 24256 ts_tablet_manager.cc:1434] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:21:55.031641 24255 tablet_bootstrap.cc:654] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.032574 24256 tablet_bootstrap.cc:492] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
W20260709 13:21:55.037871 24241 tablet.cc:2406] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:21:55.041522 24256 tablet_bootstrap.cc:654] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.044646 24255 tablet_bootstrap.cc:492] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e: No bootstrap required, opened a new log
I20260709 13:21:55.045138 24255 ts_tablet_manager.cc:1403] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 13:21:55.047757 24256 tablet_bootstrap.cc:492] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd: No bootstrap required, opened a new log
I20260709 13:21:55.048337 24256 ts_tablet_manager.cc:1403] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:21:55.048437 24257 tablet_bootstrap.cc:654] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.048378 24255 raft_consensus.cc:359] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.049474 24255 raft_consensus.cc:385] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.049734 24255 raft_consensus.cc:740] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.050405 24255 consensus_queue.cc:260] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.051575 24256 raft_consensus.cc:359] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.052407 24255 ts_tablet_manager.cc:1434] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:21:55.052855 24256 raft_consensus.cc:385] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.053354 24256 raft_consensus.cc:740] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.053736 24255 tablet_bootstrap.cc:492] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e: Bootstrap starting.
I20260709 13:21:55.054646 24256 consensus_queue.cc:260] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.061036 24255 tablet_bootstrap.cc:654] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.061398 24256 ts_tablet_manager.cc:1434] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:21:55.062889 24256 tablet_bootstrap.cc:492] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:21:55.068001 24261 raft_consensus.cc:493] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.068851 24261 raft_consensus.cc:515] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.083066 24261 leader_election.cc:290] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.090986 24257 tablet_bootstrap.cc:492] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3: No bootstrap required, opened a new log
I20260709 13:21:55.091898 24257 ts_tablet_manager.cc:1403] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.023s
I20260709 13:21:55.095261 24257 raft_consensus.cc:359] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.096179 24257 raft_consensus.cc:385] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.096657 24257 raft_consensus.cc:740] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.096951 24255 tablet_bootstrap.cc:492] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e: No bootstrap required, opened a new log
I20260709 13:21:55.097833 24255 ts_tablet_manager.cc:1403] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.004s
I20260709 13:21:55.097896 24257 consensus_queue.cc:260] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.101526 24257 ts_tablet_manager.cc:1434] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:21:55.102623 24257 tablet_bootstrap.cc:492] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3: Bootstrap starting.
I20260709 13:21:55.103164 24256 tablet_bootstrap.cc:654] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.106688 24255 raft_consensus.cc:359] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.107517 24255 raft_consensus.cc:385] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.107880 24255 raft_consensus.cc:740] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.110670 24257 tablet_bootstrap.cc:654] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.110863 24255 consensus_queue.cc:260] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.114265 24141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:55.115199 24141 raft_consensus.cc:2468] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 0.
I20260709 13:21:55.116576 24029 leader_election.cc:304] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:21:55.117409 24261 raft_consensus.cc:2804] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.117851 24261 raft_consensus.cc:493] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.118228 24261 raft_consensus.cc:3060] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.121786 24255 ts_tablet_manager.cc:1434] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:21:55.122924 24255 tablet_bootstrap.cc:492] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e: Bootstrap starting.
I20260709 13:21:55.130638 24255 tablet_bootstrap.cc:654] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.130945 24256 tablet_bootstrap.cc:492] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd: No bootstrap required, opened a new log
I20260709 13:21:55.131786 24256 ts_tablet_manager.cc:1403] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.023s
I20260709 13:21:55.135766 24256 raft_consensus.cc:359] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.136590 24256 raft_consensus.cc:385] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.137063 24256 raft_consensus.cc:740] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.138242 24256 consensus_queue.cc:260] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.142761 24255 tablet_bootstrap.cc:492] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e: No bootstrap required, opened a new log
I20260709 13:21:55.143399 24255 ts_tablet_manager.cc:1403] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:21:55.146512 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:55.146493 24255 raft_consensus.cc:359] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.147317 24215 raft_consensus.cc:2468] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 0.
I20260709 13:21:55.147415 24255 raft_consensus.cc:385] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.147823 24255 raft_consensus.cc:740] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.146512 24261 raft_consensus.cc:515] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.148710 24255 consensus_queue.cc:260] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.150533 24261 leader_election.cc:290] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 election: Requested vote from peers ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.151777 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:55.152413 24215 raft_consensus.cc:3060] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.153038 24141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:55.153613 24141 raft_consensus.cc:3060] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.154193 24257 tablet_bootstrap.cc:492] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3: No bootstrap required, opened a new log
I20260709 13:21:55.154704 24257 ts_tablet_manager.cc:1403] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.033s
W20260709 13:21:55.157155 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:21:55.159951 24257 raft_consensus.cc:359] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.160741 24256 ts_tablet_manager.cc:1434] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.011s
I20260709 13:21:55.159991 24141 raft_consensus.cc:2468] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 1.
I20260709 13:21:55.160979 24255 ts_tablet_manager.cc:1434] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:21:55.162194 24256 tablet_bootstrap.cc:492] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:21:55.162331 24029 leader_election.cc:304] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:21:55.161194 24257 raft_consensus.cc:385] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.163757 24257 raft_consensus.cc:740] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.164213 24255 tablet_bootstrap.cc:492] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e: Bootstrap starting.
I20260709 13:21:55.164651 24257 consensus_queue.cc:260] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.169828 24257 ts_tablet_manager.cc:1434] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:21:55.167958 24283 raft_consensus.cc:2804] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.170625 24255 tablet_bootstrap.cc:654] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.170948 24257 tablet_bootstrap.cc:492] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3: Bootstrap starting.
I20260709 13:21:55.171128 24283 raft_consensus.cc:697] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: Becoming Leader. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Running, Role: LEADER
I20260709 13:21:55.172307 24283 consensus_queue.cc:237] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.169704 24215 raft_consensus.cc:2468] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 1.
I20260709 13:21:55.176847 24256 tablet_bootstrap.cc:654] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.181267 24257 tablet_bootstrap.cc:654] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.186820 24262 raft_consensus.cc:493] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.187188 24267 raft_consensus.cc:493] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.187367 24262 raft_consensus.cc:515] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.187950 24267 raft_consensus.cc:515] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.189647 24256 tablet_bootstrap.cc:492] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd: No bootstrap required, opened a new log
I20260709 13:21:55.189743 24262 leader_election.cc:290] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:55.190239 24256 ts_tablet_manager.cc:1403] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 13:21:55.199694 24256 raft_consensus.cc:359] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.201781 24256 raft_consensus.cc:385] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.202150 24256 raft_consensus.cc:740] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.203219 24257 tablet_bootstrap.cc:492] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3: No bootstrap required, opened a new log
I20260709 13:21:55.190618 24267 leader_election.cc:290] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:55.192078 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd" is_pre_election: true
I20260709 13:21:55.193111 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21af5a82fb87418a96151689b649313d" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:55.204398 24140 raft_consensus.cc:2468] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 0.
I20260709 13:21:55.194836 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21af5a82fb87418a96151689b649313d" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd" is_pre_election: true
I20260709 13:21:55.205688 24178 leader_election.cc:304] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:55.205714 24065 raft_consensus.cc:2468] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 0.
I20260709 13:21:55.207376 24267 raft_consensus.cc:2804] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.207798 24267 raft_consensus.cc:493] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.208083 24267 raft_consensus.cc:3060] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.208858 24141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:55.203127 24256 consensus_queue.cc:260] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
W20260709 13:21:55.210502 24178 leader_election.cc:343] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.211495 24066 raft_consensus.cc:2468] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 0.
I20260709 13:21:55.211895 23964 catalog_manager.cc:5697] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1). New cstate: current_term: 1 leader_uuid: "9881332cab4e4ab595147d53ae98b5bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.212815 24256 ts_tablet_manager.cc:1434] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:21:55.214288 24256 tablet_bootstrap.cc:492] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:21:55.203838 24257 ts_tablet_manager.cc:1403] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.004s
I20260709 13:21:55.214586 24180 leader_election.cc:304] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3; no voters: ca86d948c52b4dcbafb3ae87dfb53e5e
I20260709 13:21:55.217751 24257 raft_consensus.cc:359] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.218204 24262 raft_consensus.cc:2804] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.218465 24257 raft_consensus.cc:385] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.218601 24262 raft_consensus.cc:493] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.218803 24257 raft_consensus.cc:740] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.218994 24262 raft_consensus.cc:3060] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.219707 24257 consensus_queue.cc:260] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.222998 24256 tablet_bootstrap.cc:654] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.229960 24255 tablet_bootstrap.cc:492] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e: No bootstrap required, opened a new log
I20260709 13:21:55.230239 24264 raft_consensus.cc:493] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.230456 24255 ts_tablet_manager.cc:1403] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent bootstrapping tablet: real 0.066s	user 0.029s	sys 0.034s
I20260709 13:21:55.230738 24264 raft_consensus.cc:515] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.233466 24255 raft_consensus.cc:359] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.234292 24255 raft_consensus.cc:385] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.234661 24255 raft_consensus.cc:740] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.235495 24255 consensus_queue.cc:260] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.238324 24264 leader_election.cc:290] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.246963 24262 raft_consensus.cc:515] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.254266 24283 raft_consensus.cc:493] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.254995 24283 raft_consensus.cc:515] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.258095 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:21:55.258855 24283 leader_election.cc:290] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.253384 24255 ts_tablet_manager.cc:1434] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.005s
I20260709 13:21:55.260167 24141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:55.260594 24255 tablet_bootstrap.cc:492] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e: Bootstrap starting.
I20260709 13:21:55.260962 24141 raft_consensus.cc:2468] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 0.
I20260709 13:21:55.249993 24264 raft_consensus.cc:493] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.262748 24029 leader_election.cc:304] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:21:55.263196 24264 raft_consensus.cc:515] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.263613 24283 raft_consensus.cc:2804] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.264043 24283 raft_consensus.cc:493] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.264381 24283 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.265087 24261 raft_consensus.cc:493] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.265419 24264 leader_election.cc:290] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.265564 24261 raft_consensus.cc:515] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.267576 24261 leader_election.cc:290] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.258818 24066 raft_consensus.cc:3060] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.269234 24214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654798d1f7154143bb961fd8161627f2" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:55.269899 24214 raft_consensus.cc:2468] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 0.
I20260709 13:21:55.271226 24032 leader_election.cc:304] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:55.273347 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd" is_pre_election: true
I20260709 13:21:55.274679 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654798d1f7154143bb961fd8161627f2" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd" is_pre_election: true
I20260709 13:21:55.275517 24064 raft_consensus.cc:2468] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 0.
I20260709 13:21:55.277215 24106 leader_election.cc:304] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:21:55.278205 24264 raft_consensus.cc:2804] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.278487 24261 raft_consensus.cc:2804] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.278581 24264 raft_consensus.cc:493] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.278941 24261 raft_consensus.cc:493] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.279002 24264 raft_consensus.cc:3060] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.279337 24261 raft_consensus.cc:3060] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.258881 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:55.280597 24215 raft_consensus.cc:2468] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 0.
I20260709 13:21:55.281786 24141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654798d1f7154143bb961fd8161627f2" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:55.253504 24267 raft_consensus.cc:515] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.285488 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:55.286085 24140 raft_consensus.cc:3060] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.286610 24066 raft_consensus.cc:2468] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 1.
I20260709 13:21:55.287711 24262 leader_election.cc:290] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:55.287935 24180 leader_election.cc:304] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:55.289001 24262 raft_consensus.cc:2804] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.289613 24262 raft_consensus.cc:697] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Becoming Leader. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:21:55.290524 24262 consensus_queue.cc:237] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.295329 24139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21af5a82fb87418a96151689b649313d" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:55.299429 24214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654798d1f7154143bb961fd8161627f2" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:55.300287 24214 raft_consensus.cc:2468] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 0.
I20260709 13:21:55.301342 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:55.302161 24215 raft_consensus.cc:2468] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 0.
I20260709 13:21:55.304839 24107 leader_election.cc:304] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:55.298004 24139 raft_consensus.cc:3060] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.296016 24267 leader_election.cc:290] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:55.297207 24261 raft_consensus.cc:515] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.322575 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654798d1f7154143bb961fd8161627f2" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:55.323422 24215 raft_consensus.cc:3060] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.308429 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21af5a82fb87418a96151689b649313d" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:21:55.324326 24066 raft_consensus.cc:3060] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.334431 24255 tablet_bootstrap.cc:654] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.338783 24140 raft_consensus.cc:2468] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 1.
I20260709 13:21:55.340152 24261 leader_election.cc:290] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 election: Requested vote from peers ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.342895 24139 raft_consensus.cc:2468] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 1.
I20260709 13:21:55.323028 24264 raft_consensus.cc:515] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.347736 24292 raft_consensus.cc:493] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.348364 24292 raft_consensus.cc:515] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.348680 24283 raft_consensus.cc:515] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.349999 24065 raft_consensus.cc:2393] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca86d948c52b4dcbafb3ae87dfb53e5e in current term 1: Already voted for candidate 9881332cab4e4ab595147d53ae98b5bd in this term.
I20260709 13:21:55.350981 24283 leader_election.cc:290] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 election: Requested vote from peers ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.352095 24214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:55.353308 24214 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.354465 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:55.353933 23963 catalog_manager.cc:5697] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "f9f4275b212a48b8a777c34b01a975f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:55.355058 24140 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.355309 24264 leader_election.cc:290] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.338805 24215 raft_consensus.cc:2468] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 1.
I20260709 13:21:55.352190 24138 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654798d1f7154143bb961fd8161627f2" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:55.355852 24141 raft_consensus.cc:2393] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9881332cab4e4ab595147d53ae98b5bd in current term 1: Already voted for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in this term.
I20260709 13:21:55.356822 24178 leader_election.cc:304] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:55.357142 24032 leader_election.cc:304] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:55.357808 24288 raft_consensus.cc:2804] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.358376 24288 raft_consensus.cc:697] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Becoming Leader. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:21:55.358628 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654798d1f7154143bb961fd8161627f2" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:21:55.359543 24065 raft_consensus.cc:2393] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca86d948c52b4dcbafb3ae87dfb53e5e in current term 1: Already voted for candidate 9881332cab4e4ab595147d53ae98b5bd in this term.
I20260709 13:21:55.359407 24288 consensus_queue.cc:237] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.361848 24257 ts_tablet_manager.cc:1434] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3: Time spent starting tablet: real 0.147s	user 0.043s	sys 0.043s
I20260709 13:21:55.357926 24256 tablet_bootstrap.cc:492] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd: No bootstrap required, opened a new log
I20260709 13:21:55.363623 24256 ts_tablet_manager.cc:1403] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.150s	user 0.043s	sys 0.037s
I20260709 13:21:55.366535 24256 raft_consensus.cc:359] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.367115 24214 raft_consensus.cc:2468] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 1.
I20260709 13:21:55.363026 24257 tablet_bootstrap.cc:492] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3: Bootstrap starting.
I20260709 13:21:55.370116 24140 raft_consensus.cc:2468] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 1.
I20260709 13:21:55.370998 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654798d1f7154143bb961fd8161627f2" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:55.373610 24032 leader_election.cc:304] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:55.374248 24215 raft_consensus.cc:2393] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ca86d948c52b4dcbafb3ae87dfb53e5e in current term 1: Already voted for candidate 9881332cab4e4ab595147d53ae98b5bd in this term.
I20260709 13:21:55.371893 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd" is_pre_election: true
I20260709 13:21:55.375191 24066 raft_consensus.cc:2468] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 1.
I20260709 13:21:55.375300 24065 raft_consensus.cc:2468] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 1.
I20260709 13:21:55.375818 24257 tablet_bootstrap.cc:654] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.372496 24283 raft_consensus.cc:2804] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.367208 24256 raft_consensus.cc:385] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.376695 24256 raft_consensus.cc:740] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.376761 24264 raft_consensus.cc:2764] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:21:55.377121 24261 raft_consensus.cc:2804] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.377767 24256 consensus_queue.cc:260] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.380028 24106 leader_election.cc:304] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:21:55.380932 24264 raft_consensus.cc:2804] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:55.381330 24264 raft_consensus.cc:493] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.381807 24264 raft_consensus.cc:3060] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:55.381340 24107 leader_election.cc:304] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3
I20260709 13:21:55.388701 24261 raft_consensus.cc:697] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: Becoming Leader. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Running, Role: LEADER
I20260709 13:21:55.389385 24294 raft_consensus.cc:2749] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.391379 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:55.392851 24255 tablet_bootstrap.cc:492] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e: No bootstrap required, opened a new log
I20260709 13:21:55.392699 24261 consensus_queue.cc:237] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.393565 24255 ts_tablet_manager.cc:1403] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.006s
I20260709 13:21:55.402573 24255 raft_consensus.cc:359] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.378224 24292 leader_election.cc:290] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.403896 24255 raft_consensus.cc:385] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.403791 24283 raft_consensus.cc:697] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: Becoming Leader. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Running, Role: LEADER
I20260709 13:21:55.394906 24256 ts_tablet_manager.cc:1434] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.003s
I20260709 13:21:55.405716 24256 tablet_bootstrap.cc:492] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:21:55.405344 24283 consensus_queue.cc:237] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.402171 23963 catalog_manager.cc:5697] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3). New cstate: current_term: 1 leader_uuid: "f9f4275b212a48b8a777c34b01a975f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:55.398063 24264 raft_consensus.cc:515] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.404415 24255 raft_consensus.cc:740] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.411579 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:21:55.411777 24255 consensus_queue.cc:260] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.412366 24066 raft_consensus.cc:3060] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:55.413933 24255 ts_tablet_manager.cc:1434] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:21:55.417002 24257 tablet_bootstrap.cc:492] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3: No bootstrap required, opened a new log
I20260709 13:21:55.417515 24257 ts_tablet_manager.cc:1403] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3: Time spent bootstrapping tablet: real 0.055s	user 0.025s	sys 0.000s
I20260709 13:21:55.420331 24257 raft_consensus.cc:359] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.421126 24257 raft_consensus.cc:385] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.421378 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:55.422113 24255 tablet_bootstrap.cc:492] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e: Bootstrap starting.
I20260709 13:21:55.422658 24264 leader_election.cc:290] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.424335 24066 raft_consensus.cc:2468] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 2.
I20260709 13:21:55.425611 24106 leader_election.cc:304] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: f9f4275b212a48b8a777c34b01a975f3
I20260709 13:21:55.426545 24264 raft_consensus.cc:2804] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:55.427327 24264 raft_consensus.cc:697] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Becoming Leader. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:21:55.427685 24255 tablet_bootstrap.cc:654] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.421380 24257 raft_consensus.cc:740] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.428373 24264 consensus_queue.cc:237] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.428843 24257 consensus_queue.cc:260] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.431166 24257 ts_tablet_manager.cc:1434] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:21:55.432183 24257 tablet_bootstrap.cc:492] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3: Bootstrap starting.
I20260709 13:21:55.448678 24256 tablet_bootstrap.cc:654] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.454007 24288 consensus_queue.cc:1048] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.458292 24255 tablet_bootstrap.cc:492] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e: No bootstrap required, opened a new log
I20260709 13:21:55.458916 24255 ts_tablet_manager.cc:1403] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 13:21:55.458479 23963 catalog_manager.cc:5697] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1). New cstate: current_term: 1 leader_uuid: "9881332cab4e4ab595147d53ae98b5bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.461747 24255 raft_consensus.cc:359] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.461807 24292 raft_consensus.cc:493] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.465008 24255 raft_consensus.cc:385] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.465334 24255 raft_consensus.cc:740] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.465330 24292 raft_consensus.cc:515] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.466428 24255 consensus_queue.cc:260] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.463768 24257 tablet_bootstrap.cc:654] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.468638 24255 ts_tablet_manager.cc:1434] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:21:55.468202 23964 catalog_manager.cc:5697] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e reported cstate change: term changed from 1 to 2, leader changed from f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3) to ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2). New cstate: current_term: 2 leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.469224 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5db628004a740b3ad36e4194fb92de8" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd" is_pre_election: true
I20260709 13:21:55.469561 24255 tablet_bootstrap.cc:492] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e: Bootstrap starting.
I20260709 13:21:55.469960 24065 raft_consensus.cc:2468] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 0.
I20260709 13:21:55.470136 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5db628004a740b3ad36e4194fb92de8" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:55.470854 24215 raft_consensus.cc:2468] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 0.
I20260709 13:21:55.471510 24106 leader_election.cc:304] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:21:55.472513 24292 leader_election.cc:290] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.472770 24294 raft_consensus.cc:2804] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.473181 24294 raft_consensus.cc:493] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.473599 24294 raft_consensus.cc:3060] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.476109 24255 tablet_bootstrap.cc:654] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.483824 24292 raft_consensus.cc:493] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.484483 24292 raft_consensus.cc:515] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.487433 24256 tablet_bootstrap.cc:492] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: No bootstrap required, opened a new log
I20260709 13:21:55.487927 24256 ts_tablet_manager.cc:1403] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.001s
I20260709 13:21:55.487622 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2c13350cc54941bff39bab69daa1fb" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd" is_pre_election: true
W20260709 13:21:55.490644 24106 leader_election.cc:343] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.492689 24255 tablet_bootstrap.cc:492] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e: No bootstrap required, opened a new log
I20260709 13:21:55.492762 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2c13350cc54941bff39bab69daa1fb" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:55.493319 24255 ts_tablet_manager.cc:1403] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 13:21:55.493943 24292 leader_election.cc:290] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
W20260709 13:21:55.494382 24107 leader_election.cc:343] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.494849 24107 leader_election.cc:304] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3
I20260709 13:21:55.495553 24292 raft_consensus.cc:2749] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:21:55.496168 24255 raft_consensus.cc:359] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.496764 24255 raft_consensus.cc:385] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.496987 24255 raft_consensus.cc:740] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.497596 24255 consensus_queue.cc:260] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.490685 24256 raft_consensus.cc:359] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.498858 24256 raft_consensus.cc:385] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.499204 24256 raft_consensus.cc:740] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.498981 24294 raft_consensus.cc:515] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.500049 24256 consensus_queue.cc:260] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.504114 24256 ts_tablet_manager.cc:1434] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:21:55.505021 24256 tablet_bootstrap.cc:492] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:21:55.501770 24255 ts_tablet_manager.cc:1434] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:21:55.509362 24294 leader_election.cc:290] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.511406 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5db628004a740b3ad36e4194fb92de8" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:55.512108 24215 raft_consensus.cc:3060] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.512960 24256 tablet_bootstrap.cc:654] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.514449 24267 consensus_queue.cc:1048] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.516619 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5db628004a740b3ad36e4194fb92de8" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:21:55.517405 24065 raft_consensus.cc:3060] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.520783 24215 raft_consensus.cc:2468] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 1.
I20260709 13:21:55.522585 24107 leader_election.cc:304] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:55.523705 24294 raft_consensus.cc:2804] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.524466 24294 raft_consensus.cc:697] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 LEADER]: Becoming Leader. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:21:55.525408 24294 consensus_queue.cc:237] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.527375 24065 raft_consensus.cc:2468] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 1.
I20260709 13:21:55.529392 24292 raft_consensus.cc:493] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.530154 24292 raft_consensus.cc:515] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.532871 24292 leader_election.cc:290] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.533812 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd" is_pre_election: true
I20260709 13:21:55.535490 24065 raft_consensus.cc:2468] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 0.
I20260709 13:21:55.536033 24257 tablet_bootstrap.cc:492] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3: No bootstrap required, opened a new log
I20260709 13:21:55.537420 24257 ts_tablet_manager.cc:1403] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3: Time spent bootstrapping tablet: real 0.105s	user 0.023s	sys 0.006s
I20260709 13:21:55.543514 24257 raft_consensus.cc:359] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.544636 24257 raft_consensus.cc:385] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.545092 24257 raft_consensus.cc:740] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.546233 24257 consensus_queue.cc:260] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.536996 24106 leader_election.cc:304] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:21:55.548779 24257 ts_tablet_manager.cc:1434] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:21:55.548879 24294 raft_consensus.cc:2804] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.550343 24294 raft_consensus.cc:493] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.550765 24294 raft_consensus.cc:3060] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.550096 23964 catalog_manager.cc:5697] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1). New cstate: current_term: 1 leader_uuid: "9881332cab4e4ab595147d53ae98b5bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.551550 24256 tablet_bootstrap.cc:492] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: No bootstrap required, opened a new log
I20260709 13:21:55.552027 24256 ts_tablet_manager.cc:1403] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.022s
I20260709 13:21:55.536662 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:55.553251 24215 raft_consensus.cc:2468] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 0.
I20260709 13:21:55.554939 24256 raft_consensus.cc:359] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.555660 24256 raft_consensus.cc:385] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.556118 24256 raft_consensus.cc:740] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.556910 24256 consensus_queue.cc:260] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.558972 24256 ts_tablet_manager.cc:1434] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:21:55.561086 24257 tablet_bootstrap.cc:492] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3: Bootstrap starting.
I20260709 13:21:55.564064 24294 raft_consensus.cc:515] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.566938 24257 tablet_bootstrap.cc:654] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:21:55.568390 24294 leader_election.cc:290] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.568651 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:55.568828 24283 raft_consensus.cc:493] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.569278 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:21:55.569372 24215 raft_consensus.cc:3060] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.569399 24283 raft_consensus.cc:515] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.570070 24066 raft_consensus.cc:3060] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.571995 24283 leader_election.cc:290] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.574198 24214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2c13350cc54941bff39bab69daa1fb" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:55.574903 24214 raft_consensus.cc:2468] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 0.
I20260709 13:21:55.576403 24141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2c13350cc54941bff39bab69daa1fb" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:55.577103 24141 raft_consensus.cc:2468] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 0.
I20260709 13:21:55.577845 24215 raft_consensus.cc:2468] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 1.
I20260709 13:21:55.581768 24032 leader_election.cc:304] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:55.582927 24066 raft_consensus.cc:2468] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 1.
I20260709 13:21:55.583535 24107 leader_election.cc:304] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:55.585199 24294 raft_consensus.cc:2804] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.585666 24294 raft_consensus.cc:697] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 LEADER]: Becoming Leader. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:21:55.586531 24294 consensus_queue.cc:237] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.589360 24283 raft_consensus.cc:2804] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.589963 24283 raft_consensus.cc:493] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.590389 24283 raft_consensus.cc:3060] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.598286 24261 raft_consensus.cc:493] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:55.598910 24261 raft_consensus.cc:515] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.601229 24283 raft_consensus.cc:515] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.602643 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07696622824f41a3ba412dd532854333" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:55.603360 24283 leader_election.cc:290] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 election: Requested vote from peers ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.603410 24257 tablet_bootstrap.cc:492] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3: No bootstrap required, opened a new log
I20260709 13:21:55.605157 24257 ts_tablet_manager.cc:1403] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.020s
W20260709 13:21:55.605618 24032 leader_election.cc:343] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:21:55.606245 24261 leader_election.cc:290] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.606668 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2c13350cc54941bff39bab69daa1fb" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:55.607362 24140 raft_consensus.cc:3060] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.608256 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2c13350cc54941bff39bab69daa1fb" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:55.608861 24215 raft_consensus.cc:3060] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.608680 24257 raft_consensus.cc:359] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.609419 24257 raft_consensus.cc:385] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:21:55.609725 24257 raft_consensus.cc:740] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Initialized, Role: FOLLOWER
I20260709 13:21:55.610463 24257 consensus_queue.cc:260] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.610204 23963 catalog_manager.cc:5697] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e reported cstate change: term changed from 0 to 1, leader changed from <none> to ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2). New cstate: current_term: 1 leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.606266 24141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07696622824f41a3ba412dd532854333" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:55.612216 24141 raft_consensus.cc:2468] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 0.
I20260709 13:21:55.612660 24257 ts_tablet_manager.cc:1434] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:21:55.614049 24029 leader_election.cc:304] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: f9f4275b212a48b8a777c34b01a975f3
I20260709 13:21:55.615762 24261 raft_consensus.cc:2804] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:21:55.616218 24261 raft_consensus.cc:493] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:55.616645 24261 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.617100 24140 raft_consensus.cc:2468] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 1.
I20260709 13:21:55.617324 24215 raft_consensus.cc:2468] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 1.
I20260709 13:21:55.618422 24029 leader_election.cc:304] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:21:55.618698 23963 catalog_manager.cc:5697] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e reported cstate change: term changed from 0 to 1, leader changed from <none> to ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2). New cstate: current_term: 1 leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.619830 24283 raft_consensus.cc:2804] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.620370 24283 raft_consensus.cc:697] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: Becoming Leader. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Running, Role: LEADER
I20260709 13:21:55.621645 24283 consensus_queue.cc:237] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.625530 24261 raft_consensus.cc:515] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.628687 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07696622824f41a3ba412dd532854333" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:55.629364 24140 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.631028 24261 leader_election.cc:290] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 election: Requested vote from peers ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:55.630939 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07696622824f41a3ba412dd532854333" candidate_uuid: "9881332cab4e4ab595147d53ae98b5bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:55.632325 23962 catalog_manager.cc:5697] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1). New cstate: current_term: 1 leader_uuid: "9881332cab4e4ab595147d53ae98b5bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.633419 24215 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:21:55.637082 24140 raft_consensus.cc:2468] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 1.
I20260709 13:21:55.638264 24029 leader_election.cc:304] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:21:55.639137 24261 raft_consensus.cc:2804] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:21:55.639590 24261 raft_consensus.cc:697] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: Becoming Leader. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Running, Role: LEADER
I20260709 13:21:55.641081 24215 raft_consensus.cc:2468] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9881332cab4e4ab595147d53ae98b5bd in term 1.
I20260709 13:21:55.640910 24261 consensus_queue.cc:237] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.647660 23962 catalog_manager.cc:5697] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1). New cstate: current_term: 1 leader_uuid: "9881332cab4e4ab595147d53ae98b5bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:55.747174 24140 raft_consensus.cc:1240] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Rejecting Update request from peer f9f4275b212a48b8a777c34b01a975f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:21:55.748443 24288 consensus_queue.cc:1059] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.748999 24288 consensus_queue.cc:1243] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Peer ca86d948c52b4dcbafb3ae87dfb53e5e log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:21:55.749328 24267 raft_consensus.cc:3055] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:55.749622 24267 raft_consensus.cc:740] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:21:55.750270 24267 consensus_queue.cc:260] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:55.751052 24267 raft_consensus.cc:3060] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:55.770862 24261 consensus_queue.cc:1048] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.780846 24283 consensus_queue.cc:1048] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.788913 15720 ts_manager.cc:295] Set tserver state for 9881332cab4e4ab595147d53ae98b5bd to MAINTENANCE_MODE
I20260709 13:21:55.789752 15720 tablet_server.cc:179] TabletServer@127.15.90.1:0 shutting down...
I20260709 13:21:55.810673 24283 consensus_queue.cc:1048] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:21:55.811616 24261 consensus_queue.cc:1048] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.822300 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:55.825137 15720 tablet_replica.cc:333] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: stopping tablet replica
I20260709 13:21:55.826048 15720 raft_consensus.cc:2243] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:55.826927 15720 pending_rounds.cc:70] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Trying to abort 1 pending ops.
I20260709 13:21:55.827229 15720 pending_rounds.cc:77] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305639180872826880 op_type: NO_OP noop_request { }
I20260709 13:21:55.827665 15720 raft_consensus.cc:2889] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:55.828065 15720 raft_consensus.cc:2272] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:55.828413 24180 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 109 similar messages]
I20260709 13:21:55.837512 15720 tablet_replica.cc:333] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd: stopping tablet replica
I20260709 13:21:55.838380 15720 raft_consensus.cc:2243] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:55.838842 15720 raft_consensus.cc:2272] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:55.841682 15720 tablet_replica.cc:333] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd: stopping tablet replica
W20260709 13:21:55.841672 24180 consensus_peers.cc:597] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:55.842557 15720 raft_consensus.cc:2243] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:55.843024 15720 raft_consensus.cc:2272] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:55.844740 15720 tablet_replica.cc:333] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd: stopping tablet replica
I20260709 13:21:55.845404 15720 raft_consensus.cc:2243] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:55.846104 15720 raft_consensus.cc:2272] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:55.848112 15720 tablet_replica.cc:333] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd: stopping tablet replica
I20260709 13:21:55.848623 15720 raft_consensus.cc:2243] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:55.849038 15720 raft_consensus.cc:2272] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:55.851042 15720 tablet_replica.cc:333] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd: stopping tablet replica
I20260709 13:21:55.851550 15720 raft_consensus.cc:2243] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:55.852339 15720 raft_consensus.cc:2272] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:55.854521 15720 tablet_replica.cc:333] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: stopping tablet replica
I20260709 13:21:55.855023 15720 raft_consensus.cc:2243] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:55.855655 15720 pending_rounds.cc:70] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Trying to abort 1 pending ops.
I20260709 13:21:55.855899 15720 pending_rounds.cc:77] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305639180799430656 op_type: NO_OP noop_request { }
I20260709 13:21:55.856277 15720 raft_consensus.cc:2889] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:55.856637 15720 raft_consensus.cc:2272] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:55.858737 15720 tablet_replica.cc:333] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd: stopping tablet replica
I20260709 13:21:55.859197 15720 raft_consensus.cc:2243] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:55.859593 15720 raft_consensus.cc:2272] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:55.861114 15720 tablet_replica.cc:333] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: stopping tablet replica
I20260709 13:21:55.861521 15720 raft_consensus.cc:2243] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:55.861994 15720 pending_rounds.cc:70] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Trying to abort 1 pending ops.
I20260709 13:21:55.862140 15720 pending_rounds.cc:77] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305639179891994624 op_type: NO_OP noop_request { }
I20260709 13:21:55.862352 15720 raft_consensus.cc:2889] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:21:55.862552 15720 raft_consensus.cc:2272] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:55.864490 15720 tablet_replica.cc:333] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd: stopping tablet replica
I20260709 13:21:55.864892 15720 raft_consensus.cc:2243] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:55.865185 15720 raft_consensus.cc:2272] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:55.893501 15720 tablet_server.cc:196] TabletServer@127.15.90.1:0 shutdown complete.
W20260709 13:21:55.899341 24106 consensus_peers.cc:597] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:55.910084 24215 raft_consensus.cc:1275] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:21:55.910378 24215 pending_rounds.cc:85] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3: Aborting all ops after (but not including) 0
I20260709 13:21:55.910615 24215 pending_rounds.cc:107] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:21:55.910813 24215 raft_consensus.cc:2889] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:21:55.912057 24294 consensus_queue.cc:1048] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:55.930955 24180 consensus_peers.cc:597] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:55.930962 24267 consensus_queue.cc:1048] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:55.960913 24264 consensus_queue.cc:1048] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:55.972219 24106 consensus_peers.cc:597] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:56.098724 24294 consensus_queue.cc:1048] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:56.110410 24106 consensus_peers.cc:597] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:56.158128 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:56.879441 24262 raft_consensus.cc:493] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:56.880087 24262 raft_consensus.cc:515] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:56.881924 24262 leader_election.cc:290] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:56.883140 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:56.883906 24140 raft_consensus.cc:2468] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 1.
I20260709 13:21:56.885247 24178 leader_election.cc:304] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:56.886137 24262 raft_consensus.cc:2804] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:21:56.886226 24180 leader_election.cc:336] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:56.886641 24262 raft_consensus.cc:493] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:56.886993 24262 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:56.892371 24262 raft_consensus.cc:515] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:56.894044 24262 leader_election.cc:290] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:56.895226 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:56.895931 24140 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:56.897653 24180 leader_election.cc:336] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:56.900571 24140 raft_consensus.cc:2468] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 2.
I20260709 13:21:56.901594 24178 leader_election.cc:304] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 9881332cab4e4ab595147d53ae98b5bd
I20260709 13:21:56.902246 24262 raft_consensus.cc:2804] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:56.902735 24262 raft_consensus.cc:697] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Becoming Leader. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:21:56.903596 24262 consensus_queue.cc:237] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:56.911484 23963 catalog_manager.cc:5697] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 reported cstate change: term changed from 1 to 2, leader changed from 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1) to f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "f9f4275b212a48b8a777c34b01a975f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: HEALTHY } } }
W20260709 13:21:57.159271 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:57.204566 24262 raft_consensus.cc:493] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.205156 24262 raft_consensus.cc:515] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.206806 24262 leader_election.cc:290] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:57.208145 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2c13350cc54941bff39bab69daa1fb" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:57.208976 24140 raft_consensus.cc:2468] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 1.
I20260709 13:21:57.210004 24178 leader_election.cc:304] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:57.210816 24262 raft_consensus.cc:2804] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:21:57.210863 24180 leader_election.cc:336] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:57.211187 24262 raft_consensus.cc:493] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.211591 24262 raft_consensus.cc:3060] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.217202 24262 raft_consensus.cc:515] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.218833 24262 leader_election.cc:290] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:57.219970 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2c13350cc54941bff39bab69daa1fb" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:57.220566 24140 raft_consensus.cc:3060] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:57.222295 24180 leader_election.cc:336] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:57.225932 24140 raft_consensus.cc:2468] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 2.
I20260709 13:21:57.226954 24178 leader_election.cc:304] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 9881332cab4e4ab595147d53ae98b5bd
I20260709 13:21:57.227644 24262 raft_consensus.cc:2804] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:57.228122 24262 raft_consensus.cc:697] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Becoming Leader. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:21:57.228801 24262 consensus_queue.cc:237] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.236508 23963 catalog_manager.cc:5697] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 reported cstate change: term changed from 1 to 2, leader changed from 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1) to f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "f9f4275b212a48b8a777c34b01a975f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:57.282004 24292 raft_consensus.cc:493] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9881332cab4e4ab595147d53ae98b5bd)
I20260709 13:21:57.282837 24292 raft_consensus.cc:515] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.285399 24292 leader_election.cc:290] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:57.285483 24262 raft_consensus.cc:493] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9881332cab4e4ab595147d53ae98b5bd)
I20260709 13:21:57.287261 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:57.287397 24262 raft_consensus.cc:515] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.288545 24215 raft_consensus.cc:2468] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 1.
W20260709 13:21:57.289696 24106 leader_election.cc:336] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:57.290411 24262 leader_election.cc:290] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:57.291150 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:57.291936 24140 raft_consensus.cc:2468] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 1.
I20260709 13:21:57.292764 24107 leader_election.cc:304] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 9881332cab4e4ab595147d53ae98b5bd
W20260709 13:21:57.294574 24180 leader_election.cc:336] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:57.294948 24292 raft_consensus.cc:2804] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:57.295125 24178 leader_election.cc:304] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 9881332cab4e4ab595147d53ae98b5bd
I20260709 13:21:57.295387 24292 raft_consensus.cc:493] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9881332cab4e4ab595147d53ae98b5bd)
I20260709 13:21:57.295866 24292 raft_consensus.cc:3060] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.296617 24262 raft_consensus.cc:2804] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:57.297058 24262 raft_consensus.cc:493] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9881332cab4e4ab595147d53ae98b5bd)
I20260709 13:21:57.297367 24262 raft_consensus.cc:3060] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.302906 24292 raft_consensus.cc:515] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.303121 24262 raft_consensus.cc:515] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.304714 24292 leader_election.cc:290] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:57.305619 24262 leader_election.cc:290] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:57.306242 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:57.306242 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:57.307281 24215 raft_consensus.cc:2393] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca86d948c52b4dcbafb3ae87dfb53e5e in current term 2: Already voted for candidate f9f4275b212a48b8a777c34b01a975f3 in this term.
I20260709 13:21:57.307294 24140 raft_consensus.cc:2393] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f9f4275b212a48b8a777c34b01a975f3 in current term 2: Already voted for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in this term.
W20260709 13:21:57.308818 24106 leader_election.cc:336] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:57.309311 24106 leader_election.cc:304] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3
I20260709 13:21:57.310073 24292 raft_consensus.cc:2749] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:21:57.312178 24180 leader_election.cc:336] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:57.312670 24180 leader_election.cc:304] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9f4275b212a48b8a777c34b01a975f3; no voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e
I20260709 13:21:57.313304 24262 raft_consensus.cc:2749] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:21:57.324018 24262 raft_consensus.cc:493] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9881332cab4e4ab595147d53ae98b5bd)
I20260709 13:21:57.324509 24262 raft_consensus.cc:515] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.326342 24262 leader_election.cc:290] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943), 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281)
I20260709 13:21:57.327172 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654798d1f7154143bb961fd8161627f2" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
W20260709 13:21:57.330404 24180 leader_election.cc:336] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:57.330837 24180 leader_election.cc:304] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9f4275b212a48b8a777c34b01a975f3; no voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e
I20260709 13:21:57.331468 24262 raft_consensus.cc:2749] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:21:57.338792 24292 raft_consensus.cc:493] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9881332cab4e4ab595147d53ae98b5bd)
I20260709 13:21:57.339419 24292 raft_consensus.cc:515] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.341264 24292 leader_election.cc:290] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:57.342443 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654798d1f7154143bb961fd8161627f2" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:57.343031 24215 raft_consensus.cc:2468] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 1.
I20260709 13:21:57.343964 24107 leader_election.cc:304] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 
W20260709 13:21:57.344746 24106 leader_election.cc:336] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:57.344792 24292 raft_consensus.cc:2804] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:21:57.345288 24292 raft_consensus.cc:493] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9881332cab4e4ab595147d53ae98b5bd)
I20260709 13:21:57.345582 24292 raft_consensus.cc:3060] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.350721 24292 raft_consensus.cc:515] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.352334 24292 leader_election.cc:290] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:57.353403 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654798d1f7154143bb961fd8161627f2" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:57.353924 24215 raft_consensus.cc:3060] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:57.356364 24106 leader_election.cc:336] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:57.358845 24215 raft_consensus.cc:2468] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 2.
I20260709 13:21:57.359987 24107 leader_election.cc:304] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 9881332cab4e4ab595147d53ae98b5bd
I20260709 13:21:57.360716 24292 raft_consensus.cc:2804] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:57.361618 24292 raft_consensus.cc:697] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Becoming Leader. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:21:57.362437 24292 consensus_queue.cc:237] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.369707 23963 catalog_manager.cc:5697] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e reported cstate change: term changed from 1 to 2, leader changed from 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1) to ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2). New cstate: current_term: 2 leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:21:57.412693 24262 raft_consensus.cc:493] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:57.413206 24262 raft_consensus.cc:515] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.414794 24262 leader_election.cc:290] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:57.416128 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07696622824f41a3ba412dd532854333" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" is_pre_election: true
I20260709 13:21:57.416935 24140 raft_consensus.cc:2468] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 1.
I20260709 13:21:57.417990 24178 leader_election.cc:304] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:21:57.418718 24262 raft_consensus.cc:2804] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:21:57.418740 24180 leader_election.cc:336] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:57.419093 24262 raft_consensus.cc:493] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:57.419488 24262 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:57.421924 24140 raft_consensus.cc:1275] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:57.423336 24267 consensus_queue.cc:1048] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:21:57.427249 24262 raft_consensus.cc:515] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:57.430133 24262 leader_election.cc:290] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:21:57.431738 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07696622824f41a3ba412dd532854333" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:21:57.433043 24140 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:21:57.434108 24180 leader_election.cc:336] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:57.439879 24140 raft_consensus.cc:2468] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 2.
I20260709 13:21:57.441560 24178 leader_election.cc:304] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 9881332cab4e4ab595147d53ae98b5bd
I20260709 13:21:57.444108 24262 raft_consensus.cc:2804] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:57.444903 24262 raft_consensus.cc:697] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Becoming Leader. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:21:57.446020 24262 consensus_queue.cc:237] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
W20260709 13:21:57.450273 24180 consensus_peers.cc:597] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.463450 23963 catalog_manager.cc:5697] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 reported cstate change: term changed from 1 to 2, leader changed from 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1) to f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "f9f4275b212a48b8a777c34b01a975f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:57.677680 24141 raft_consensus.cc:1275] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:57.679021 24267 consensus_queue.cc:1048] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:57.692610 24180 consensus_peers.cc:597] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.849561 24215 raft_consensus.cc:1275] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:57.850988 24292 consensus_queue.cc:1048] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:21:57.862795 24106 consensus_peers.cc:597] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:57.948796 24141 raft_consensus.cc:1275] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:21:57.949965 24343 consensus_queue.cc:1048] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:21:57.964903 24180 consensus_peers.cc:597] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:57.984874 24180 consensus_peers.cc:597] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:58.160264 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:21:58.268841 24106 consensus_peers.cc:597] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:58.313709 24180 consensus_peers.cc:597] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:58.465077 24106 consensus_peers.cc:597] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:58.578979 24106 consensus_peers.cc:597] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:21:59.161688 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:21:59.322933 24337 raft_consensus.cc:493] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:21:59.323786 24337 raft_consensus.cc:515] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:59.326097 24337 leader_election.cc:290] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:59.327479 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3" is_pre_election: true
I20260709 13:21:59.328590 24215 raft_consensus.cc:2468] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 2.
I20260709 13:21:59.329993 24107 leader_election.cc:304] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 
W20260709 13:21:59.330658 24106 leader_election.cc:336] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:59.330853 24337 raft_consensus.cc:2804] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:21:59.331302 24337 raft_consensus.cc:493] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:21:59.331619 24337 raft_consensus.cc:3060] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:59.339131 24337 raft_consensus.cc:515] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:59.340898 24337 leader_election.cc:290] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:21:59.342010 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:21:59.342731 24215 raft_consensus.cc:3060] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:21:59.344796 24106 leader_election.cc:336] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111)
I20260709 13:21:59.349779 24215 raft_consensus.cc:2468] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 3.
I20260709 13:21:59.350778 24107 leader_election.cc:304] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca86d948c52b4dcbafb3ae87dfb53e5e, f9f4275b212a48b8a777c34b01a975f3; no voters: 9881332cab4e4ab595147d53ae98b5bd
I20260709 13:21:59.351502 24337 raft_consensus.cc:2804] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:59.352409 24337 raft_consensus.cc:697] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Becoming Leader. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:21:59.353426 24337 consensus_queue.cc:237] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:21:59.361302 23964 catalog_manager.cc:5697] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e reported cstate change: term changed from 1 to 3, leader changed from 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1) to ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2). New cstate: current_term: 3 leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
W20260709 13:21:59.770104 24106 consensus_peers.cc:597] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:59.886574 24215 raft_consensus.cc:1275] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:21:59.888044 24352 consensus_queue.cc:1048] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:00.038589 24106 consensus_peers.cc:597] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:00.162806 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:22:00.169031 24180 consensus_peers.cc:597] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:00.176954 24180 consensus_peers.cc:597] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:00.181007 24180 consensus_peers.cc:597] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:00.489081 24180 consensus_peers.cc:597] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:22:00.664803 24106 consensus_peers.cc:597] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:00.694638 24106 consensus_peers.cc:597] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:22:00.878919 24180 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111) [suppressed 98 similar messages]
W20260709 13:22:00.881428 24180 consensus_peers.cc:597] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:22:00.911734 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:00.919582 24362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:00.922253 24363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:00.923020 24365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:00.923581 15720 server_base.cc:1061] running on GCE node
I20260709 13:22:00.925452 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:00.925724 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:00.925959 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603320925939 us; error 0 us; skew 500 ppm
I20260709 13:22:00.927017 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:00.929878 15720 webserver.cc:533] Webserver started at http://127.15.90.1:36447/ using document root <none> and password file <none>
I20260709 13:22:00.930413 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:00.930604 15720 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:22:00.935017 15720 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:22:00.939196 24370 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:00.940063 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:22:00.940392 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-0-root
uuid: "9881332cab4e4ab595147d53ae98b5bd"
format_stamp: "Formatted at 2026-07-09 13:21:54 on dist-test-slave-fpp7"
I20260709 13:22:00.940773 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783603071664575-15720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:00.966265 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:00.967618 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:00.969182 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:00.972860 24377 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:22:01.025331 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:22:01.025676 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:22:01.026014 15720 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:22:01.031582 24377 tablet_bootstrap.cc:492] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:22:01.045809 24377 tablet_bootstrap.cc:492] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.046587 24377 tablet_bootstrap.cc:492] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap complete.
I20260709 13:22:01.047235 24377 ts_tablet_manager.cc:1403] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:22:01.049743 24377 raft_consensus.cc:359] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.050290 24377 raft_consensus.cc:740] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.051031 24377 consensus_queue.cc:260] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.054785 24377 ts_tablet_manager.cc:1434] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:22:01.055608 24377 tablet_bootstrap.cc:492] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:22:01.070217 15720 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:22:01.070616 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.045s	user 0.036s	sys 0.007s
I20260709 13:22:01.071820 24377 tablet_bootstrap.cc:492] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.072896 24377 tablet_bootstrap.cc:492] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap complete.
I20260709 13:22:01.073596 24377 ts_tablet_manager.cc:1403] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:22:01.076532 24377 raft_consensus.cc:359] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.077270 24377 raft_consensus.cc:740] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.078022 24377 consensus_queue.cc:260] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.080230 24377 ts_tablet_manager.cc:1434] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:22:01.081176 24377 tablet_bootstrap.cc:492] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:22:01.101135 24377 tablet_bootstrap.cc:492] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:22:01.102002 24377 tablet_bootstrap.cc:492] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap complete.
I20260709 13:22:01.102648 24377 ts_tablet_manager.cc:1403] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:22:01.105015 24377 raft_consensus.cc:359] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.105769 24377 raft_consensus.cc:740] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.106551 24377 consensus_queue.cc:260] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.108374 24377 ts_tablet_manager.cc:1434] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:22:01.109131 24377 tablet_bootstrap.cc:492] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:22:01.122139 24377 tablet_bootstrap.cc:492] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.123140 24377 tablet_bootstrap.cc:492] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap complete.
I20260709 13:22:01.123824 24377 ts_tablet_manager.cc:1403] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:22:01.126195 24377 raft_consensus.cc:359] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.126906 24377 raft_consensus.cc:740] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.127807 24377 consensus_queue.cc:260] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.129860 24377 ts_tablet_manager.cc:1434] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:01.130717 24377 tablet_bootstrap.cc:492] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:22:01.138195 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.1:46281
I20260709 13:22:01.138319 24438 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.1:46281 every 8 connection(s)
I20260709 13:22:01.141898 24377 tablet_bootstrap.cc:492] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.143114 24377 tablet_bootstrap.cc:492] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap complete.
I20260709 13:22:01.143952 24377 ts_tablet_manager.cc:1403] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.006s
I20260709 13:22:01.143891 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:01.147272 24377 raft_consensus.cc:359] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.148056 24377 raft_consensus.cc:740] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.148854 24377 consensus_queue.cc:260] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.150940 24377 ts_tablet_manager.cc:1434] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:22:01.151710 24377 tablet_bootstrap.cc:492] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
W20260709 13:22:01.163957 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:01.166806 24377 tablet_bootstrap.cc:492] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:22:01.166998 24440 heartbeater.cc:344] Connected to a master server at 127.15.90.62:43891
I20260709 13:22:01.167496 24440 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:01.167811 24377 tablet_bootstrap.cc:492] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap complete.
I20260709 13:22:01.168466 24440 heartbeater.cc:507] Master 127.15.90.62:43891 requested a full tablet report, sending...
I20260709 13:22:01.168501 24377 ts_tablet_manager.cc:1403] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:22:01.171455 24377 raft_consensus.cc:359] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.172247 24377 raft_consensus.cc:740] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.172544 24215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21af5a82fb87418a96151689b649313d"
dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
mode: GRACEFUL
new_leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
 from {username='slave'} at 127.0.0.1:35662
I20260709 13:22:01.173206 24215 raft_consensus.cc:606] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Received request to transfer leadership to TS ca86d948c52b4dcbafb3ae87dfb53e5e
I20260709 13:22:01.173012 24377 consensus_queue.cc:260] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.175025 24377 ts_tablet_manager.cc:1434] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:22:01.175540 23963 ts_manager.cc:194] Re-registered known tserver with Master: 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281)
I20260709 13:22:01.175896 24377 tablet_bootstrap.cc:492] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:22:01.185554 23963 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51300
I20260709 13:22:01.188400 24377 tablet_bootstrap.cc:492] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.189075 24440 heartbeater.cc:499] Master 127.15.90.62:43891 was elected leader, sending a full tablet report...
I20260709 13:22:01.189344 24377 tablet_bootstrap.cc:492] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap complete.
I20260709 13:22:01.190088 24377 ts_tablet_manager.cc:1403] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.005s
I20260709 13:22:01.192342 24140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad696309438a4a93b6679eac647958e6"
dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
mode: GRACEFUL
new_leader_uuid: "f9f4275b212a48b8a777c34b01a975f3"
 from {username='slave'} at 127.0.0.1:53266
I20260709 13:22:01.192955 24140 raft_consensus.cc:606] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Received request to transfer leadership to TS f9f4275b212a48b8a777c34b01a975f3
I20260709 13:22:01.192662 24377 raft_consensus.cc:359] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.193410 24377 raft_consensus.cc:740] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.194300 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:01.194245 24377 consensus_queue.cc:260] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.194978 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:01.195772 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:01.196185 24377 ts_tablet_manager.cc:1434] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:22:01.196878 24377 tablet_bootstrap.cc:492] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:22:01.208496 24377 tablet_bootstrap.cc:492] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.209200 24377 tablet_bootstrap.cc:492] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap complete.
I20260709 13:22:01.209867 24377 ts_tablet_manager.cc:1403] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:22:01.212396 24377 raft_consensus.cc:359] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.212894 24377 raft_consensus.cc:740] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.213564 24377 consensus_queue.cc:260] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.215622 24377 ts_tablet_manager.cc:1434] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:01.216442 24377 tablet_bootstrap.cc:492] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:22:01.228894 24377 tablet_bootstrap.cc:492] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:22:01.229719 24377 tablet_bootstrap.cc:492] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap complete.
I20260709 13:22:01.230247 24377 ts_tablet_manager.cc:1403] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:22:01.232095 24377 raft_consensus.cc:359] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.232656 24377 raft_consensus.cc:740] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.233183 24377 consensus_queue.cc:260] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.234678 24377 ts_tablet_manager.cc:1434] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:01.235325 24377 tablet_bootstrap.cc:492] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap starting.
I20260709 13:22:01.246135 24377 tablet_bootstrap.cc:492] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:22:01.246794 24377 tablet_bootstrap.cc:492] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Bootstrap complete.
I20260709 13:22:01.247429 24377 ts_tablet_manager.cc:1403] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Time spent bootstrapping tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:22:01.249306 24377 raft_consensus.cc:359] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.249914 24377 raft_consensus.cc:740] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9881332cab4e4ab595147d53ae98b5bd, State: Initialized, Role: FOLLOWER
I20260709 13:22:01.250473 24377 consensus_queue.cc:260] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.252094 24377 ts_tablet_manager.cc:1434] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Time spent starting tablet: real 0.004s	user 0.008s	sys 0.000s
I20260709 13:22:01.257407 24413 raft_consensus.cc:3060] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:22:01.270522 24411 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.279446 24411 pending_rounds.cc:85] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Aborting all ops after (but not including) 0
I20260709 13:22:01.279750 24411 pending_rounds.cc:107] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:22:01.280123 24411 raft_consensus.cc:2889] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:22:01.282085 24458 raft_consensus.cc:993] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e: : Instructing follower f9f4275b212a48b8a777c34b01a975f3 to start an election
I20260709 13:22:01.282610 24458 raft_consensus.cc:1081] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Signalling peer f9f4275b212a48b8a777c34b01a975f3 to start an election
I20260709 13:22:01.284284 24215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad696309438a4a93b6679eac647958e6"
dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
 from {username='slave'} at 127.0.0.1:41924
I20260709 13:22:01.284839 24215 raft_consensus.cc:493] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.285192 24215 raft_consensus.cc:3060] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:01.291368 24215 raft_consensus.cc:515] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.292898 24215 leader_election.cc:290] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 4 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:22:01.293794 24411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:22:01.293939 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad696309438a4a93b6679eac647958e6" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:22:01.294564 24411 raft_consensus.cc:3060] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:01.294634 24140 raft_consensus.cc:3055] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:01.295107 24140 raft_consensus.cc:740] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:22:01.295918 24140 consensus_queue.cc:260] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.297232 24140 raft_consensus.cc:3060] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:01.300786 24411 raft_consensus.cc:2468] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 4.
I20260709 13:22:01.302086 24180 leader_election.cc:304] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:22:01.303032 24350 raft_consensus.cc:2804] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:01.304257 24350 raft_consensus.cc:697] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 4 LEADER]: Becoming Leader. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:22:01.305496 24140 raft_consensus.cc:2468] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 4.
I20260709 13:22:01.305284 24350 consensus_queue.cc:237] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.313455 23964 catalog_manager.cc:5697] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 reported cstate change: term changed from 3 to 4, leader changed from ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2) to f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3). New cstate: current_term: 4 leader_uuid: "f9f4275b212a48b8a777c34b01a975f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:01.444933 24462 raft_consensus.cc:993] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3: : Instructing follower ca86d948c52b4dcbafb3ae87dfb53e5e to start an election
I20260709 13:22:01.445396 24350 raft_consensus.cc:1081] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Signalling peer ca86d948c52b4dcbafb3ae87dfb53e5e to start an election
I20260709 13:22:01.446877 24140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21af5a82fb87418a96151689b649313d"
dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
 from {username='slave'} at 127.0.0.1:56118
I20260709 13:22:01.447340 24140 raft_consensus.cc:493] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:01.447790 24140 raft_consensus.cc:3060] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.453756 24140 raft_consensus.cc:515] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.455374 24140 leader_election.cc:290] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:22:01.456609 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21af5a82fb87418a96151689b649313d" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:22:01.456609 24411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21af5a82fb87418a96151689b649313d" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:22:01.457274 24215 raft_consensus.cc:3055] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:01.457595 24411 raft_consensus.cc:3060] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.457602 24215 raft_consensus.cc:740] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:22:01.458802 24215 consensus_queue.cc:260] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.459851 24215 raft_consensus.cc:3060] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.463064 24411 raft_consensus.cc:2468] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 2.
I20260709 13:22:01.464143 24106 leader_election.cc:304] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:22:01.464264 24215 raft_consensus.cc:2468] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 2.
I20260709 13:22:01.464910 24458 raft_consensus.cc:2804] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:01.465379 24458 raft_consensus.cc:697] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Becoming Leader. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:22:01.466194 24458 consensus_queue.cc:237] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:01.473917 23964 catalog_manager.cc:5697] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e reported cstate change: term changed from 1 to 2, leader changed from f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3) to ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2). New cstate: current_term: 2 leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:01.528282 24411 raft_consensus.cc:3060] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.546873 24411 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.550559 24413 raft_consensus.cc:3060] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:01.552387 24411 pending_rounds.cc:85] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Aborting all ops after (but not including) 0
I20260709 13:22:01.552700 24411 pending_rounds.cc:107] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:22:01.552978 24411 raft_consensus.cc:2889] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:22:01.556779 24413 pending_rounds.cc:85] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Aborting all ops after (but not including) 0
I20260709 13:22:01.557051 24413 pending_rounds.cc:107] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:22:01.557317 24413 raft_consensus.cc:2889] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:22:01.687402 24411 raft_consensus.cc:1275] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:22:01.688616 24350 consensus_queue.cc:1048] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:01.699120 24140 raft_consensus.cc:1275] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:22:01.700591 24462 consensus_queue.cc:1048] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:01.894502 24411 raft_consensus.cc:1275] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.895829 24458 consensus_queue.cc:1048] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:01.903398 24215 raft_consensus.cc:1275] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:01.905077 24352 consensus_queue.cc:1048] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:02.164942 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:02.206210 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:02.213279 24140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a"
dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
mode: GRACEFUL
new_leader_uuid: "f9f4275b212a48b8a777c34b01a975f3"
 from {username='slave'} at 127.0.0.1:53266
I20260709 13:22:02.213864 24140 raft_consensus.cc:606] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 LEADER]: Received request to transfer leadership to TS f9f4275b212a48b8a777c34b01a975f3
I20260709 13:22:02.216391 24215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "569665773261478485c85ce61d1c6c31"
dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
mode: GRACEFUL
new_leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
 from {username='slave'} at 127.0.0.1:35662
I20260709 13:22:02.216837 24215 raft_consensus.cc:606] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Received request to transfer leadership to TS ca86d948c52b4dcbafb3ae87dfb53e5e
I20260709 13:22:02.217905 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:02.218397 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:02.218946 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:02.233534 24477 raft_consensus.cc:993] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e: : Instructing follower f9f4275b212a48b8a777c34b01a975f3 to start an election
I20260709 13:22:02.234139 24459 raft_consensus.cc:1081] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 LEADER]: Signalling peer f9f4275b212a48b8a777c34b01a975f3 to start an election
I20260709 13:22:02.235523 24215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a"
dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
 from {username='slave'} at 127.0.0.1:41924
I20260709 13:22:02.236042 24215 raft_consensus.cc:493] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:02.236297 24215 raft_consensus.cc:3060] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.240882 24215 raft_consensus.cc:515] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:02.242161 24215 leader_election.cc:290] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:22:02.243183 24411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:22:02.243222 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:22:02.244071 24140 raft_consensus.cc:3055] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:02.244042 24411 raft_consensus.cc:3060] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.244570 24140 raft_consensus.cc:740] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:22:02.245316 24140 consensus_queue.cc:260] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:02.246516 24140 raft_consensus.cc:3060] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.251216 24411 raft_consensus.cc:2468] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 2.
I20260709 13:22:02.252460 24180 leader_election.cc:304] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:22:02.253041 24140 raft_consensus.cc:2468] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 2.
I20260709 13:22:02.253337 24350 raft_consensus.cc:2804] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.254179 24350 raft_consensus.cc:697] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Becoming Leader. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:22:02.255378 24350 consensus_queue.cc:237] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:02.262588 23963 catalog_manager.cc:5697] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 reported cstate change: term changed from 1 to 2, leader changed from ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2) to f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3). New cstate: current_term: 2 leader_uuid: "f9f4275b212a48b8a777c34b01a975f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:02.506863 24479 raft_consensus.cc:993] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3: : Instructing follower ca86d948c52b4dcbafb3ae87dfb53e5e to start an election
I20260709 13:22:02.507390 24350 raft_consensus.cc:1081] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Signalling peer ca86d948c52b4dcbafb3ae87dfb53e5e to start an election
I20260709 13:22:02.508740 24140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "569665773261478485c85ce61d1c6c31"
dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
 from {username='slave'} at 127.0.0.1:56118
I20260709 13:22:02.509186 24140 raft_consensus.cc:493] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:02.509472 24140 raft_consensus.cc:3060] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.513938 24140 raft_consensus.cc:515] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:02.515259 24140 leader_election.cc:290] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:22:02.516408 24411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569665773261478485c85ce61d1c6c31" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:22:02.516461 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569665773261478485c85ce61d1c6c31" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:22:02.516979 24411 raft_consensus.cc:3060] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.517066 24215 raft_consensus.cc:3055] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:02.517510 24215 raft_consensus.cc:740] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:22:02.518134 24215 consensus_queue.cc:260] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:02.519248 24215 raft_consensus.cc:3060] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:02.522073 24411 raft_consensus.cc:2468] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 2.
I20260709 13:22:02.523379 24106 leader_election.cc:304] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:22:02.524011 24215 raft_consensus.cc:2468] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 2.
I20260709 13:22:02.524180 24459 raft_consensus.cc:2804] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:02.524648 24459 raft_consensus.cc:697] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Becoming Leader. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:22:02.525516 24459 consensus_queue.cc:237] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:02.531612 23963 catalog_manager.cc:5697] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e reported cstate change: term changed from 1 to 2, leader changed from f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3) to ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2). New cstate: current_term: 2 leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:02.787824 24140 raft_consensus.cc:1275] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.789337 24350 consensus_queue.cc:1048] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:02.800830 24411 raft_consensus.cc:1275] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:02.802677 24350 consensus_queue.cc:1048] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:03.115060 24411 raft_consensus.cc:1275] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.116305 24459 consensus_queue.cc:1048] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:03.125773 24215 raft_consensus.cc:1275] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:03.127535 24493 consensus_queue.cc:1048] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:03.165807 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:03.225296 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:03.232848 24215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07696622824f41a3ba412dd532854333"
dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
mode: GRACEFUL
new_leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
 from {username='slave'} at 127.0.0.1:35662
I20260709 13:22:03.233291 24215 raft_consensus.cc:606] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Received request to transfer leadership to TS ca86d948c52b4dcbafb3ae87dfb53e5e
I20260709 13:22:03.235842 24140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c"
dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
mode: GRACEFUL
new_leader_uuid: "f9f4275b212a48b8a777c34b01a975f3"
 from {username='slave'} at 127.0.0.1:53266
I20260709 13:22:03.236308 24140 raft_consensus.cc:606] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Received request to transfer leadership to TS f9f4275b212a48b8a777c34b01a975f3
I20260709 13:22:03.237448 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:03.238029 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:03.238715 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:03.526516 24474 raft_consensus.cc:993] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3: : Instructing follower ca86d948c52b4dcbafb3ae87dfb53e5e to start an election
I20260709 13:22:03.526960 24350 raft_consensus.cc:1081] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Signalling peer ca86d948c52b4dcbafb3ae87dfb53e5e to start an election
I20260709 13:22:03.528242 24140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07696622824f41a3ba412dd532854333"
dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
 from {username='slave'} at 127.0.0.1:56118
I20260709 13:22:03.528678 24140 raft_consensus.cc:493] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:03.528954 24140 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:03.533785 24140 raft_consensus.cc:515] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:03.535252 24140 leader_election.cc:290] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:22:03.535890 24413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07696622824f41a3ba412dd532854333" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:22:03.536216 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07696622824f41a3ba412dd532854333" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:22:03.536510 24413 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:03.536806 24215 raft_consensus.cc:3055] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:03.537096 24215 raft_consensus.cc:740] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:22:03.537717 24215 consensus_queue.cc:260] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:03.538589 24215 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:03.542610 24413 raft_consensus.cc:2468] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 3.
I20260709 13:22:03.543442 24215 raft_consensus.cc:2468] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 3.
I20260709 13:22:03.543798 24106 leader_election.cc:304] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:22:03.544610 24459 raft_consensus.cc:2804] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:03.545076 24459 raft_consensus.cc:697] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Becoming Leader. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:22:03.545894 24459 consensus_queue.cc:237] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:03.552059 23963 catalog_manager.cc:5697] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e reported cstate change: term changed from 2 to 3, leader changed from f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3) to ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2). New cstate: current_term: 3 leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:03.666515 24492 raft_consensus.cc:993] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e: : Instructing follower f9f4275b212a48b8a777c34b01a975f3 to start an election
I20260709 13:22:03.666992 24459 raft_consensus.cc:1081] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Signalling peer f9f4275b212a48b8a777c34b01a975f3 to start an election
I20260709 13:22:03.668413 24215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c"
dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
 from {username='slave'} at 127.0.0.1:41924
I20260709 13:22:03.668836 24215 raft_consensus.cc:493] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:03.669098 24215 raft_consensus.cc:3060] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:03.673576 24215 raft_consensus.cc:515] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:03.674976 24215 leader_election.cc:290] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 3 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:22:03.675801 24411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:22:03.676054 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c152dd2a6f442a92e00a1a126bc80c" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:22:03.676436 24411 raft_consensus.cc:3060] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:03.676551 24140 raft_consensus.cc:3055] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:03.676914 24140 raft_consensus.cc:740] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:22:03.677687 24140 consensus_queue.cc:260] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:03.678923 24140 raft_consensus.cc:3060] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:03.683229 24411 raft_consensus.cc:2468] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 3.
I20260709 13:22:03.684342 24180 leader_election.cc:304] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:22:03.685020 24350 raft_consensus.cc:2804] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:03.685457 24140 raft_consensus.cc:2468] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 3.
I20260709 13:22:03.685513 24350 raft_consensus.cc:697] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 3 LEADER]: Becoming Leader. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:22:03.686636 24350 consensus_queue.cc:237] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:03.694180 23963 catalog_manager.cc:5697] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 reported cstate change: term changed from 2 to 3, leader changed from ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2) to f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "f9f4275b212a48b8a777c34b01a975f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:03.996649 24215 raft_consensus.cc:1275] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:03.997932 24459 consensus_queue.cc:1048] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:04.007750 24411 raft_consensus.cc:1275] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:04.009294 24492 consensus_queue.cc:1048] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:04.107897 24140 raft_consensus.cc:1275] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:04.108999 24501 consensus_queue.cc:1048] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:04.117194 24411 raft_consensus.cc:1275] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:04.119270 24474 consensus_queue.cc:1048] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:22:04.166623 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:04.245832 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:04.253713 24140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07696622824f41a3ba412dd532854333"
dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
mode: GRACEFUL
new_leader_uuid: "f9f4275b212a48b8a777c34b01a975f3"
 from {username='slave'} at 127.0.0.1:53266
I20260709 13:22:04.254231 24140 raft_consensus.cc:606] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Received request to transfer leadership to TS f9f4275b212a48b8a777c34b01a975f3
I20260709 13:22:04.256528 24215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed"
dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
mode: GRACEFUL
new_leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
 from {username='slave'} at 127.0.0.1:35662
I20260709 13:22:04.257014 24215 raft_consensus.cc:606] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Received request to transfer leadership to TS ca86d948c52b4dcbafb3ae87dfb53e5e
I20260709 13:22:04.258044 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:04.258482 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:04.259102 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:04.315565 24350 raft_consensus.cc:993] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3: : Instructing follower ca86d948c52b4dcbafb3ae87dfb53e5e to start an election
I20260709 13:22:04.316047 24474 raft_consensus.cc:1081] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Signalling peer ca86d948c52b4dcbafb3ae87dfb53e5e to start an election
I20260709 13:22:04.317348 24140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed"
dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
 from {username='slave'} at 127.0.0.1:56118
I20260709 13:22:04.317799 24140 raft_consensus.cc:493] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.318065 24140 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.322428 24140 raft_consensus.cc:515] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:04.323758 24140 leader_election.cc:290] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:22:04.324561 24411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:22:04.324779 24215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:22:04.325125 24411 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.325294 24215 raft_consensus.cc:3055] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:04.325618 24215 raft_consensus.cc:740] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:22:04.326318 24215 consensus_queue.cc:260] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:04.327584 24215 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:04.330332 24411 raft_consensus.cc:2468] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 3.
I20260709 13:22:04.331200 24106 leader_election.cc:304] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:22:04.331847 24492 raft_consensus.cc:2804] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:04.332348 24492 raft_consensus.cc:697] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Becoming Leader. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:22:04.332307 24215 raft_consensus.cc:2468] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 3.
I20260709 13:22:04.333491 24492 consensus_queue.cc:237] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:04.339434 23963 catalog_manager.cc:5697] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e reported cstate change: term changed from 2 to 3, leader changed from f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3) to ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2). New cstate: current_term: 3 leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:04.394135 24459 raft_consensus.cc:993] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e: : Instructing follower f9f4275b212a48b8a777c34b01a975f3 to start an election
I20260709 13:22:04.394586 24492 raft_consensus.cc:1081] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Signalling peer f9f4275b212a48b8a777c34b01a975f3 to start an election
I20260709 13:22:04.395984 24215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07696622824f41a3ba412dd532854333"
dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
 from {username='slave'} at 127.0.0.1:41924
I20260709 13:22:04.396396 24215 raft_consensus.cc:493] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:04.396651 24215 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:04.400959 24215 raft_consensus.cc:515] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:04.402253 24215 leader_election.cc:290] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 4 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:22:04.403018 24411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07696622824f41a3ba412dd532854333" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:22:04.403465 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07696622824f41a3ba412dd532854333" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:22:04.403614 24411 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:04.404039 24140 raft_consensus.cc:3055] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:04.404332 24140 raft_consensus.cc:740] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:22:04.405011 24140 consensus_queue.cc:260] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:04.406107 24140 raft_consensus.cc:3060] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:04.409763 24411 raft_consensus.cc:2468] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 4.
I20260709 13:22:04.410784 24180 leader_election.cc:304] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:22:04.411417 24474 raft_consensus.cc:2804] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:04.411890 24474 raft_consensus.cc:697] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 4 LEADER]: Becoming Leader. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:22:04.412124 24140 raft_consensus.cc:2468] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 4.
I20260709 13:22:04.412740 24474 consensus_queue.cc:237] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:04.419348 23963 catalog_manager.cc:5697] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 reported cstate change: term changed from 3 to 4, leader changed from ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2) to f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3). New cstate: current_term: 4 leader_uuid: "f9f4275b212a48b8a777c34b01a975f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:04.806279 24411 raft_consensus.cc:1275] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:04.807446 24492 consensus_queue.cc:1048] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:04.819820 24215 raft_consensus.cc:1275] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:22:04.821336 24459 consensus_queue.cc:1048] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:04.846441 24411 raft_consensus.cc:1275] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:22:04.847568 24474 consensus_queue.cc:1048] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:04.854804 24140 raft_consensus.cc:1275] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:22:04.856750 24501 consensus_queue.cc:1048] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:22:05.167467 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:05.264972 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:05.271973 24215 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a"
dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
mode: GRACEFUL
new_leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
 from {username='slave'} at 127.0.0.1:35662
I20260709 13:22:05.272595 24215 raft_consensus.cc:606] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Received request to transfer leadership to TS ca86d948c52b4dcbafb3ae87dfb53e5e
I20260709 13:22:05.274856 24140 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed"
dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
mode: GRACEFUL
new_leader_uuid: "f9f4275b212a48b8a777c34b01a975f3"
 from {username='slave'} at 127.0.0.1:53266
I20260709 13:22:05.275383 24140 raft_consensus.cc:606] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Received request to transfer leadership to TS f9f4275b212a48b8a777c34b01a975f3
I20260709 13:22:05.276594 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:05.277141 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:05.277724 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:05.360661 24522 raft_consensus.cc:993] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e: : Instructing follower f9f4275b212a48b8a777c34b01a975f3 to start an election
I20260709 13:22:05.361244 24523 raft_consensus.cc:1081] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Signalling peer f9f4275b212a48b8a777c34b01a975f3 to start an election
I20260709 13:22:05.362630 24215 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed"
dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
 from {username='slave'} at 127.0.0.1:41924
I20260709 13:22:05.363050 24215 raft_consensus.cc:493] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:05.363320 24215 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:05.367892 24215 raft_consensus.cc:515] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:05.369300 24215 leader_election.cc:290] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 4 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943)
I20260709 13:22:05.370023 24411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:22:05.370244 24140 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd656814ed0044ec9af23bd2551e6fed" candidate_uuid: "f9f4275b212a48b8a777c34b01a975f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
I20260709 13:22:05.370594 24411 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:05.370862 24140 raft_consensus.cc:3055] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:22:05.371160 24140 raft_consensus.cc:740] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:22:05.371814 24140 consensus_queue.cc:260] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:05.372676 24140 raft_consensus.cc:3060] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:22:05.375049 24411 raft_consensus.cc:2468] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 4.
I20260709 13:22:05.376106 24180 leader_election.cc:304] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, f9f4275b212a48b8a777c34b01a975f3; no voters: 
I20260709 13:22:05.376797 24474 raft_consensus.cc:2804] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:22:05.377157 24140 raft_consensus.cc:2468] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f4275b212a48b8a777c34b01a975f3 in term 4.
I20260709 13:22:05.377223 24474 raft_consensus.cc:697] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 4 LEADER]: Becoming Leader. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:22:05.378201 24474 consensus_queue.cc:237] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:05.384110 23962 catalog_manager.cc:5697] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 reported cstate change: term changed from 3 to 4, leader changed from ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2) to f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3). New cstate: current_term: 4 leader_uuid: "f9f4275b212a48b8a777c34b01a975f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:05.760717 24521 raft_consensus.cc:993] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3: : Instructing follower ca86d948c52b4dcbafb3ae87dfb53e5e to start an election
I20260709 13:22:05.761190 24474 raft_consensus.cc:1081] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Signalling peer ca86d948c52b4dcbafb3ae87dfb53e5e to start an election
I20260709 13:22:05.762589 24140 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a"
dest_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e"
 from {username='slave'} at 127.0.0.1:56118
I20260709 13:22:05.763017 24140 raft_consensus.cc:493] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:05.763284 24140 raft_consensus.cc:3060] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:05.767603 24140 raft_consensus.cc:515] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:05.768923 24140 leader_election.cc:290] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 election: Requested vote from peers 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281), f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3:40549)
I20260709 13:22:05.769758 24411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9881332cab4e4ab595147d53ae98b5bd"
I20260709 13:22:05.770119 24214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a28bb4f7f9422ab2afbad72729bb1a" candidate_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f9f4275b212a48b8a777c34b01a975f3"
I20260709 13:22:05.770394 24411 raft_consensus.cc:3060] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:05.770725 24214 raft_consensus.cc:3055] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:05.771050 24214 raft_consensus.cc:740] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9f4275b212a48b8a777c34b01a975f3, State: Running, Role: LEADER
I20260709 13:22:05.771871 24214 consensus_queue.cc:260] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:05.773164 24214 raft_consensus.cc:3060] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:05.773622 24412 raft_consensus.cc:1275] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:22:05.774888 24474 consensus_queue.cc:1048] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:05.778146 24411 raft_consensus.cc:2468] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 3.
I20260709 13:22:05.779292 24106 leader_election.cc:304] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9881332cab4e4ab595147d53ae98b5bd, ca86d948c52b4dcbafb3ae87dfb53e5e; no voters: 
I20260709 13:22:05.780020 24522 raft_consensus.cc:2804] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:05.780532 24522 raft_consensus.cc:697] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Becoming Leader. State: Replica: ca86d948c52b4dcbafb3ae87dfb53e5e, State: Running, Role: LEADER
I20260709 13:22:05.781265 24522 consensus_queue.cc:237] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } }
I20260709 13:22:05.788092 24214 raft_consensus.cc:2468] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca86d948c52b4dcbafb3ae87dfb53e5e in term 3.
I20260709 13:22:05.800390 24140 raft_consensus.cc:1275] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Refusing update from remote peer f9f4275b212a48b8a777c34b01a975f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:22:05.802302 23963 catalog_manager.cc:5697] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e reported cstate change: term changed from 2 to 3, leader changed from f9f4275b212a48b8a777c34b01a975f3 (127.15.90.3) to ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2). New cstate: current_term: 3 leader_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:05.802560 24350 consensus_queue.cc:1048] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca86d948c52b4dcbafb3ae87dfb53e5e" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 41943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:22:06.168404 24012 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:22:06.251545 24411 raft_consensus.cc:1275] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:06.252871 24522 consensus_queue.cc:1048] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9881332cab4e4ab595147d53ae98b5bd" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 46281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:06.264506 24214 raft_consensus.cc:1275] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Refusing update from remote peer ca86d948c52b4dcbafb3ae87dfb53e5e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:06.265712 24522 consensus_queue.cc:1048] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f4275b212a48b8a777c34b01a975f3" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 40549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:06.284160 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:06.314041 15720 tablet_server.cc:179] TabletServer@127.15.90.1:46281 shutting down...
W20260709 13:22:06.317652 24180 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 13:22:06.320844 24180 consensus_peers.cc:597] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:06.335484 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:06.336220 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:06.336902 15720 raft_consensus.cc:2243] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.337363 15720 raft_consensus.cc:2272] T b5db628004a740b3ad36e4194fb92de8 P 9881332cab4e4ab595147d53ae98b5bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.339653 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:06.340782 15720 raft_consensus.cc:2243] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.341498 15720 raft_consensus.cc:2272] T 21af5a82fb87418a96151689b649313d P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.344591 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:06.345618 15720 raft_consensus.cc:2243] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.346326 15720 raft_consensus.cc:2272] T 24a28bb4f7f9422ab2afbad72729bb1a P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.348958 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:06.349534 15720 raft_consensus.cc:2243] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.349936 15720 raft_consensus.cc:2272] T ad696309438a4a93b6679eac647958e6 P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.351584 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:06.352144 15720 raft_consensus.cc:2243] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.352535 15720 raft_consensus.cc:2272] T 569665773261478485c85ce61d1c6c31 P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.354405 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:06.354861 15720 raft_consensus.cc:2243] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.355232 15720 raft_consensus.cc:2272] T 654798d1f7154143bb961fd8161627f2 P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.356936 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:06.357366 15720 raft_consensus.cc:2243] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.357700 15720 raft_consensus.cc:2272] T 07696622824f41a3ba412dd532854333 P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.359371 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:06.359848 15720 raft_consensus.cc:2243] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.360167 15720 raft_consensus.cc:2272] T de2c13350cc54941bff39bab69daa1fb P 9881332cab4e4ab595147d53ae98b5bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.361853 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:06.362306 15720 raft_consensus.cc:2243] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.362690 15720 raft_consensus.cc:2272] T fd656814ed0044ec9af23bd2551e6fed P 9881332cab4e4ab595147d53ae98b5bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.364768 15720 tablet_replica.cc:333] stopping tablet replica
I20260709 13:22:06.365195 15720 raft_consensus.cc:2243] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.365545 15720 raft_consensus.cc:2272] T 41c152dd2a6f442a92e00a1a126bc80c P 9881332cab4e4ab595147d53ae98b5bd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:06.376494 24180 consensus_peers.cc:597] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:06.383997 24180 consensus_peers.cc:597] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:06.384342 24180 consensus_peers.cc:597] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 -> Peer 9881332cab4e4ab595147d53ae98b5bd (127.15.90.1:46281): Couldn't send request to peer 9881332cab4e4ab595147d53ae98b5bd. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:46281: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:06.393558 15720 tablet_server.cc:196] TabletServer@127.15.90.1:46281 shutdown complete.
I20260709 13:22:06.411155 15720 tablet_server.cc:179] TabletServer@127.15.90.2:0 shutting down...
I20260709 13:22:06.434103 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:06.434803 15720 tablet_replica.cc:333] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e: stopping tablet replica
I20260709 13:22:06.435475 15720 raft_consensus.cc:2243] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.436009 15720 raft_consensus.cc:2272] T 07696622824f41a3ba412dd532854333 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.438071 15720 tablet_replica.cc:333] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e: stopping tablet replica
I20260709 13:22:06.438601 15720 raft_consensus.cc:2243] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:06.439371 15720 raft_consensus.cc:2272] T 24a28bb4f7f9422ab2afbad72729bb1a P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.442458 15720 tablet_replica.cc:333] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e: stopping tablet replica
I20260709 13:22:06.443001 15720 raft_consensus.cc:2243] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:06.443768 15720 raft_consensus.cc:2272] T 21af5a82fb87418a96151689b649313d P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.445812 15720 tablet_replica.cc:333] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e: stopping tablet replica
I20260709 13:22:06.446305 15720 raft_consensus.cc:2243] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.446700 15720 raft_consensus.cc:2272] T de2c13350cc54941bff39bab69daa1fb P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.448710 15720 tablet_replica.cc:333] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e: stopping tablet replica
I20260709 13:22:06.449203 15720 raft_consensus.cc:2243] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.449687 15720 raft_consensus.cc:2272] T 41c152dd2a6f442a92e00a1a126bc80c P ca86d948c52b4dcbafb3ae87dfb53e5e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.451481 15720 tablet_replica.cc:333] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e: stopping tablet replica
I20260709 13:22:06.452010 15720 raft_consensus.cc:2243] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.452512 15720 raft_consensus.cc:2272] T fd656814ed0044ec9af23bd2551e6fed P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.455369 15720 tablet_replica.cc:333] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e: stopping tablet replica
I20260709 13:22:06.456117 15720 raft_consensus.cc:2243] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:22:06.456404 24178 consensus_peers.cc:597] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 -> Peer ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943): Couldn't send request to peer ca86d948c52b4dcbafb3ae87dfb53e5e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:06.457023 15720 raft_consensus.cc:2272] T 569665773261478485c85ce61d1c6c31 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.459081 15720 tablet_replica.cc:333] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e: stopping tablet replica
I20260709 13:22:06.459570 15720 raft_consensus.cc:2243] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:06.460353 15720 raft_consensus.cc:2272] T 654798d1f7154143bb961fd8161627f2 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.462309 15720 tablet_replica.cc:333] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e: stopping tablet replica
I20260709 13:22:06.462749 15720 raft_consensus.cc:2243] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.463186 15720 raft_consensus.cc:2272] T ad696309438a4a93b6679eac647958e6 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.465101 15720 tablet_replica.cc:333] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e: stopping tablet replica
I20260709 13:22:06.465549 15720 raft_consensus.cc:2243] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:06.466253 15720 raft_consensus.cc:2272] T b5db628004a740b3ad36e4194fb92de8 P ca86d948c52b4dcbafb3ae87dfb53e5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.496366 15720 tablet_server.cc:196] TabletServer@127.15.90.2:0 shutdown complete.
I20260709 13:22:06.519516 15720 tablet_server.cc:179] TabletServer@127.15.90.3:0 shutting down...
I20260709 13:22:06.543613 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:06.544407 15720 tablet_replica.cc:333] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3: stopping tablet replica
I20260709 13:22:06.545089 15720 raft_consensus.cc:2243] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:06.545872 15720 raft_consensus.cc:2272] T 07696622824f41a3ba412dd532854333 P f9f4275b212a48b8a777c34b01a975f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.548070 15720 tablet_replica.cc:333] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3: stopping tablet replica
I20260709 13:22:06.548659 15720 raft_consensus.cc:2243] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.549067 15720 raft_consensus.cc:2272] T 24a28bb4f7f9422ab2afbad72729bb1a P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.552174 15720 tablet_replica.cc:333] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3: stopping tablet replica
I20260709 13:22:06.552861 15720 raft_consensus.cc:2243] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.553334 15720 raft_consensus.cc:2272] T b5db628004a740b3ad36e4194fb92de8 P f9f4275b212a48b8a777c34b01a975f3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:06.554183 24178 consensus_peers.cc:597] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 -> Peer ca86d948c52b4dcbafb3ae87dfb53e5e (127.15.90.2:41943): Couldn't send request to peer ca86d948c52b4dcbafb3ae87dfb53e5e. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:41943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:06.555549 15720 tablet_replica.cc:333] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3: stopping tablet replica
I20260709 13:22:06.556246 15720 raft_consensus.cc:2243] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:06.557008 15720 raft_consensus.cc:2272] T de2c13350cc54941bff39bab69daa1fb P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.559521 15720 tablet_replica.cc:333] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3: stopping tablet replica
I20260709 13:22:06.560051 15720 raft_consensus.cc:2243] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:06.560755 15720 raft_consensus.cc:2272] T 41c152dd2a6f442a92e00a1a126bc80c P f9f4275b212a48b8a777c34b01a975f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.562546 15720 tablet_replica.cc:333] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3: stopping tablet replica
I20260709 13:22:06.563077 15720 raft_consensus.cc:2243] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:06.563875 15720 raft_consensus.cc:2272] T fd656814ed0044ec9af23bd2551e6fed P f9f4275b212a48b8a777c34b01a975f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.566164 15720 tablet_replica.cc:333] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3: stopping tablet replica
I20260709 13:22:06.566701 15720 raft_consensus.cc:2243] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.567108 15720 raft_consensus.cc:2272] T 21af5a82fb87418a96151689b649313d P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.568930 15720 tablet_replica.cc:333] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3: stopping tablet replica
I20260709 13:22:06.569422 15720 raft_consensus.cc:2243] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.569816 15720 raft_consensus.cc:2272] T 654798d1f7154143bb961fd8161627f2 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.571619 15720 tablet_replica.cc:333] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3: stopping tablet replica
I20260709 13:22:06.572127 15720 raft_consensus.cc:2243] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:22:06.572839 15720 raft_consensus.cc:2272] T ad696309438a4a93b6679eac647958e6 P f9f4275b212a48b8a777c34b01a975f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.574797 15720 tablet_replica.cc:333] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3: stopping tablet replica
I20260709 13:22:06.575274 15720 raft_consensus.cc:2243] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:06.575665 15720 raft_consensus.cc:2272] T 569665773261478485c85ce61d1c6c31 P f9f4275b212a48b8a777c34b01a975f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.605738 15720 tablet_server.cc:196] TabletServer@127.15.90.3:0 shutdown complete.
I20260709 13:22:06.627351 15720 master.cc:562] Master@127.15.90.62:43891 shutting down...
I20260709 13:22:06.648608 15720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:06.649196 15720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:06.649628 15720 tablet_replica.cc:333] T 00000000000000000000000000000000 P b54b0629232842c487e7145728c65674: stopping tablet replica
I20260709 13:22:06.670863 15720 master.cc:584] Master@127.15.90.62:43891 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12692 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:22:06.714542 15720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.90.62:36825
I20260709 13:22:06.715551 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:06.720692 24541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:06.720834 24542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:06.722061 24544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:06.723456 15720 server_base.cc:1061] running on GCE node
I20260709 13:22:06.724249 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:06.724484 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:06.724642 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603326724610 us; error 0 us; skew 500 ppm
I20260709 13:22:06.725158 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:06.727445 15720 webserver.cc:533] Webserver started at http://127.15.90.62:38771/ using document root <none> and password file <none>
I20260709 13:22:06.727953 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:06.728147 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:06.728435 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:06.729482 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/master-0-root/instance:
uuid: "de238a0e7e1c474d8c31e03fa0d0898d"
format_stamp: "Formatted at 2026-07-09 13:22:06 on dist-test-slave-fpp7"
I20260709 13:22:06.733716 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:06.736913 24549 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:06.737644 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:06.737926 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/master-0-root
uuid: "de238a0e7e1c474d8c31e03fa0d0898d"
format_stamp: "Formatted at 2026-07-09 13:22:06 on dist-test-slave-fpp7"
I20260709 13:22:06.738206 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:06.753506 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:06.754611 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:06.791978 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.62:36825
I20260709 13:22:06.792058 24600 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.62:36825 every 8 connection(s)
I20260709 13:22:06.795852 24601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:06.805977 24601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d: Bootstrap starting.
I20260709 13:22:06.810541 24601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:06.814468 24601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d: No bootstrap required, opened a new log
I20260709 13:22:06.816450 24601 raft_consensus.cc:359] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de238a0e7e1c474d8c31e03fa0d0898d" member_type: VOTER }
I20260709 13:22:06.816793 24601 raft_consensus.cc:385] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:06.816973 24601 raft_consensus.cc:740] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de238a0e7e1c474d8c31e03fa0d0898d, State: Initialized, Role: FOLLOWER
I20260709 13:22:06.817425 24601 consensus_queue.cc:260] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de238a0e7e1c474d8c31e03fa0d0898d" member_type: VOTER }
I20260709 13:22:06.817818 24601 raft_consensus.cc:399] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:06.818004 24601 raft_consensus.cc:493] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:06.818202 24601 raft_consensus.cc:3060] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:06.822598 24601 raft_consensus.cc:515] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de238a0e7e1c474d8c31e03fa0d0898d" member_type: VOTER }
I20260709 13:22:06.823025 24601 leader_election.cc:304] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de238a0e7e1c474d8c31e03fa0d0898d; no voters: 
I20260709 13:22:06.824012 24601 leader_election.cc:290] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:06.824319 24604 raft_consensus.cc:2804] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:06.825721 24604 raft_consensus.cc:697] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [term 1 LEADER]: Becoming Leader. State: Replica: de238a0e7e1c474d8c31e03fa0d0898d, State: Running, Role: LEADER
I20260709 13:22:06.826283 24604 consensus_queue.cc:237] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de238a0e7e1c474d8c31e03fa0d0898d" member_type: VOTER }
I20260709 13:22:06.826817 24601 sys_catalog.cc:565] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:06.830832 24605 sys_catalog.cc:455] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de238a0e7e1c474d8c31e03fa0d0898d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de238a0e7e1c474d8c31e03fa0d0898d" member_type: VOTER } }
I20260709 13:22:06.831640 24605 sys_catalog.cc:458] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:06.832098 24606 sys_catalog.cc:455] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [sys.catalog]: SysCatalogTable state changed. Reason: New leader de238a0e7e1c474d8c31e03fa0d0898d. Latest consensus state: current_term: 1 leader_uuid: "de238a0e7e1c474d8c31e03fa0d0898d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de238a0e7e1c474d8c31e03fa0d0898d" member_type: VOTER } }
I20260709 13:22:06.832933 24606 sys_catalog.cc:458] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:06.837504 24612 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:06.842612 24612 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:06.843665 15720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:06.850450 24612 catalog_manager.cc:1383] Generated new cluster ID: 50f13be3ccf24d5488dc8a5eacdc9697
I20260709 13:22:06.850716 24612 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:06.893637 24612 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:06.894955 24612 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:06.910141 24612 catalog_manager.cc:6070] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d: Generated new TSK 0
I20260709 13:22:06.910787 24612 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:06.974658 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:06.980342 24622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:06.981540 24623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:06.983121 15720 server_base.cc:1061] running on GCE node
W20260709 13:22:06.983870 24625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:06.984829 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:06.985011 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:06.985128 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603326985118 us; error 0 us; skew 500 ppm
I20260709 13:22:06.985575 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:06.987902 15720 webserver.cc:533] Webserver started at http://127.15.90.1:45819/ using document root <none> and password file <none>
I20260709 13:22:06.988368 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:06.988531 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:06.988736 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:06.989771 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-0-root/instance:
uuid: "9a9d74900aef4225b4246087a3531e40"
format_stamp: "Formatted at 2026-07-09 13:22:06 on dist-test-slave-fpp7"
I20260709 13:22:06.994190 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:06.997543 24630 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:06.998297 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 13:22:06.998612 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-0-root
uuid: "9a9d74900aef4225b4246087a3531e40"
format_stamp: "Formatted at 2026-07-09 13:22:06 on dist-test-slave-fpp7"
I20260709 13:22:06.998898 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:07.018018 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:07.019133 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:07.020622 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:07.022825 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:07.023250 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.023741 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:07.023958 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.066385 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.1:39109
I20260709 13:22:07.066485 24692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.1:39109 every 8 connection(s)
I20260709 13:22:07.071204 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:07.078369 24697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.080520 24698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.082975 15720 server_base.cc:1061] running on GCE node
W20260709 13:22:07.083004 24700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.084465 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:07.084605 24693 heartbeater.cc:344] Connected to a master server at 127.15.90.62:36825
W20260709 13:22:07.084748 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:07.085081 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603327085061 us; error 0 us; skew 500 ppm
I20260709 13:22:07.085130 24693 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:07.085726 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:07.086021 24693 heartbeater.cc:507] Master 127.15.90.62:36825 requested a full tablet report, sending...
I20260709 13:22:07.088380 24566 ts_manager.cc:194] Registered new tserver with Master: 9a9d74900aef4225b4246087a3531e40 (127.15.90.1:39109)
I20260709 13:22:07.088440 15720 webserver.cc:533] Webserver started at http://127.15.90.2:38507/ using document root <none> and password file <none>
I20260709 13:22:07.089154 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:07.089399 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:07.089656 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:07.090415 24566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46226
I20260709 13:22:07.090700 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-1-root/instance:
uuid: "1762cf133ed049788bcfb58835c15087"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-fpp7"
I20260709 13:22:07.095009 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:22:07.098212 24705 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.098968 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:07.099256 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-1-root
uuid: "1762cf133ed049788bcfb58835c15087"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-fpp7"
I20260709 13:22:07.099550 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:07.121474 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:07.122644 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:07.124147 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:07.126264 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:07.126502 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.126756 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:07.126935 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.167640 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.2:40969
I20260709 13:22:07.167791 24767 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.2:40969 every 8 connection(s)
I20260709 13:22:07.172309 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:07.179535 24771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.181231 24772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:07.183025 24774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:07.183894 15720 server_base.cc:1061] running on GCE node
I20260709 13:22:07.184902 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:07.185154 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:07.185397 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603327185382 us; error 0 us; skew 500 ppm
I20260709 13:22:07.185398 24768 heartbeater.cc:344] Connected to a master server at 127.15.90.62:36825
I20260709 13:22:07.185947 24768 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:07.186260 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:07.186829 24768 heartbeater.cc:507] Master 127.15.90.62:36825 requested a full tablet report, sending...
I20260709 13:22:07.189047 15720 webserver.cc:533] Webserver started at http://127.15.90.3:44577/ using document root <none> and password file <none>
I20260709 13:22:07.189170 24566 ts_manager.cc:194] Registered new tserver with Master: 1762cf133ed049788bcfb58835c15087 (127.15.90.2:40969)
I20260709 13:22:07.189635 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:07.189905 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:07.190171 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:07.190735 24566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46234
I20260709 13:22:07.191293 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-2-root/instance:
uuid: "27a9ab3cbae141d1b940a6fc8c969141"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-fpp7"
I20260709 13:22:07.196086 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:07.199018 24779 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.199779 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:22:07.200078 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-2-root
uuid: "27a9ab3cbae141d1b940a6fc8c969141"
format_stamp: "Formatted at 2026-07-09 13:22:07 on dist-test-slave-fpp7"
I20260709 13:22:07.200305 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783603071664575-15720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:07.209590 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:07.210593 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:07.211939 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:07.213953 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:07.214145 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.214390 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:07.214555 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:07.254041 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.3:33533
I20260709 13:22:07.254135 24841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.3:33533 every 8 connection(s)
I20260709 13:22:07.267294 24842 heartbeater.cc:344] Connected to a master server at 127.15.90.62:36825
I20260709 13:22:07.267716 24842 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:07.268376 24842 heartbeater.cc:507] Master 127.15.90.62:36825 requested a full tablet report, sending...
I20260709 13:22:07.270104 24566 ts_manager.cc:194] Registered new tserver with Master: 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533)
I20260709 13:22:07.270959 15720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013671821s
I20260709 13:22:07.271723 24566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46248
I20260709 13:22:07.294638 24566 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46256:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:07.296681 24566 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:07.365149 24658 tablet_service.cc:1511] Processing CreateTablet for tablet 5e03d0fad7674062be845ed47f25e3f6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2165231b78df40c3afaa65faf3911767]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:07.365938 24807 tablet_service.cc:1511] Processing CreateTablet for tablet 5e03d0fad7674062be845ed47f25e3f6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2165231b78df40c3afaa65faf3911767]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:07.366385 24806 tablet_service.cc:1511] Processing CreateTablet for tablet 71e8a70588c34134bd534a5ea0204a01 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2165231b78df40c3afaa65faf3911767]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:07.366639 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e03d0fad7674062be845ed47f25e3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.365149 24657 tablet_service.cc:1511] Processing CreateTablet for tablet 71e8a70588c34134bd534a5ea0204a01 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2165231b78df40c3afaa65faf3911767]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:07.367282 24807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e03d0fad7674062be845ed47f25e3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.368223 24657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e8a70588c34134bd534a5ea0204a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.368242 24806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e8a70588c34134bd534a5ea0204a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.386140 24733 tablet_service.cc:1511] Processing CreateTablet for tablet 5e03d0fad7674062be845ed47f25e3f6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2165231b78df40c3afaa65faf3911767]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:07.387801 24733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e03d0fad7674062be845ed47f25e3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.389886 24732 tablet_service.cc:1511] Processing CreateTablet for tablet 71e8a70588c34134bd534a5ea0204a01 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2165231b78df40c3afaa65faf3911767]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:07.391601 24732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e8a70588c34134bd534a5ea0204a01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.392884 24858 tablet_bootstrap.cc:492] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141: Bootstrap starting.
I20260709 13:22:07.398835 24858 tablet_bootstrap.cc:654] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.400187 24857 tablet_bootstrap.cc:492] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40: Bootstrap starting.
I20260709 13:22:07.410328 24858 tablet_bootstrap.cc:492] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141: No bootstrap required, opened a new log
I20260709 13:22:07.410811 24858 ts_tablet_manager.cc:1403] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:22:07.408512 24857 tablet_bootstrap.cc:654] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.413808 24858 raft_consensus.cc:359] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.414665 24858 raft_consensus.cc:385] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.415050 24858 raft_consensus.cc:740] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27a9ab3cbae141d1b940a6fc8c969141, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.416363 24858 consensus_queue.cc:260] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.420342 24860 tablet_bootstrap.cc:492] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087: Bootstrap starting.
I20260709 13:22:07.423036 24858 ts_tablet_manager.cc:1434] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:22:07.423763 24842 heartbeater.cc:499] Master 127.15.90.62:36825 was elected leader, sending a full tablet report...
I20260709 13:22:07.424060 24858 tablet_bootstrap.cc:492] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141: Bootstrap starting.
I20260709 13:22:07.423797 24857 tablet_bootstrap.cc:492] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40: No bootstrap required, opened a new log
I20260709 13:22:07.424939 24857 ts_tablet_manager.cc:1403] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:22:07.428666 24860 tablet_bootstrap.cc:654] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.430461 24858 tablet_bootstrap.cc:654] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.430228 24857 raft_consensus.cc:359] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:07.431192 24857 raft_consensus.cc:385] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.431602 24857 raft_consensus.cc:740] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a9d74900aef4225b4246087a3531e40, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.432878 24857 consensus_queue.cc:260] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:07.438668 24857 ts_tablet_manager.cc:1434] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:22:07.439033 24693 heartbeater.cc:499] Master 127.15.90.62:36825 was elected leader, sending a full tablet report...
I20260709 13:22:07.439766 24857 tablet_bootstrap.cc:492] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40: Bootstrap starting.
I20260709 13:22:07.441586 24858 tablet_bootstrap.cc:492] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141: No bootstrap required, opened a new log
I20260709 13:22:07.441763 24860 tablet_bootstrap.cc:492] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087: No bootstrap required, opened a new log
I20260709 13:22:07.444243 24858 ts_tablet_manager.cc:1403] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:22:07.444473 24860 ts_tablet_manager.cc:1403] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.007s
I20260709 13:22:07.445436 24857 tablet_bootstrap.cc:654] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.447364 24858 raft_consensus.cc:359] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:07.448127 24858 raft_consensus.cc:385] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.448542 24858 raft_consensus.cc:740] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27a9ab3cbae141d1b940a6fc8c969141, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.448146 24860 raft_consensus.cc:359] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:07.449612 24860 raft_consensus.cc:385] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.449985 24860 raft_consensus.cc:740] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1762cf133ed049788bcfb58835c15087, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.449311 24858 consensus_queue.cc:260] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:07.452898 24858 ts_tablet_manager.cc:1434] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:07.450856 24860 consensus_queue.cc:260] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:07.455117 24857 tablet_bootstrap.cc:492] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40: No bootstrap required, opened a new log
I20260709 13:22:07.455510 24768 heartbeater.cc:499] Master 127.15.90.62:36825 was elected leader, sending a full tablet report...
I20260709 13:22:07.455660 24857 ts_tablet_manager.cc:1403] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:22:07.456102 24860 ts_tablet_manager.cc:1434] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:22:07.458348 24860 tablet_bootstrap.cc:492] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087: Bootstrap starting.
I20260709 13:22:07.460237 24857 raft_consensus.cc:359] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.460956 24857 raft_consensus.cc:385] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.461241 24857 raft_consensus.cc:740] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a9d74900aef4225b4246087a3531e40, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.462038 24857 consensus_queue.cc:260] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.464692 24860 tablet_bootstrap.cc:654] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.464906 24857 ts_tablet_manager.cc:1434] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:22:07.469839 24860 tablet_bootstrap.cc:492] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087: No bootstrap required, opened a new log
I20260709 13:22:07.470295 24860 ts_tablet_manager.cc:1403] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:22:07.472664 24860 raft_consensus.cc:359] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.473184 24860 raft_consensus.cc:385] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.473441 24860 raft_consensus.cc:740] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1762cf133ed049788bcfb58835c15087, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.474086 24860 consensus_queue.cc:260] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.475657 24860 ts_tablet_manager.cc:1434] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:22:07.479316 24867 raft_consensus.cc:493] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:07.479802 24867 raft_consensus.cc:515] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.482116 24867 leader_election.cc:290] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a9d74900aef4225b4246087a3531e40 (127.15.90.1:39109), 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533)
I20260709 13:22:07.492043 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e8a70588c34134bd534a5ea0204a01" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9d74900aef4225b4246087a3531e40" is_pre_election: true
I20260709 13:22:07.492643 24668 raft_consensus.cc:2468] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 0.
I20260709 13:22:07.493793 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e8a70588c34134bd534a5ea0204a01" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141" is_pre_election: true
I20260709 13:22:07.493973 24706 leader_election.cc:304] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1762cf133ed049788bcfb58835c15087, 9a9d74900aef4225b4246087a3531e40; no voters: 
I20260709 13:22:07.494679 24817 raft_consensus.cc:2468] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 0.
I20260709 13:22:07.494925 24867 raft_consensus.cc:2804] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:07.495344 24867 raft_consensus.cc:493] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:07.495721 24867 raft_consensus.cc:3060] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:07.500866 24867 raft_consensus.cc:515] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.502442 24867 leader_election.cc:290] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 election: Requested vote from peers 9a9d74900aef4225b4246087a3531e40 (127.15.90.1:39109), 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533)
I20260709 13:22:07.503126 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e8a70588c34134bd534a5ea0204a01" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9d74900aef4225b4246087a3531e40"
I20260709 13:22:07.503636 24668 raft_consensus.cc:3060] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:07.503790 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e8a70588c34134bd534a5ea0204a01" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141"
I20260709 13:22:07.504321 24817 raft_consensus.cc:3060] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:07.509336 24668 raft_consensus.cc:2468] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 1.
I20260709 13:22:07.510244 24706 leader_election.cc:304] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1762cf133ed049788bcfb58835c15087, 9a9d74900aef4225b4246087a3531e40; no voters: 
I20260709 13:22:07.510200 24817 raft_consensus.cc:2468] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 1.
I20260709 13:22:07.511111 24867 raft_consensus.cc:2804] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:07.511979 24867 raft_consensus.cc:697] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Becoming Leader. State: Replica: 1762cf133ed049788bcfb58835c15087, State: Running, Role: LEADER
I20260709 13:22:07.513036 24867 consensus_queue.cc:237] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.519313 24566 catalog_manager.cc:5697] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1762cf133ed049788bcfb58835c15087 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "1762cf133ed049788bcfb58835c15087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:07.728009 24867 raft_consensus.cc:493] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:07.728588 24867 raft_consensus.cc:515] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:07.730135 24867 leader_election.cc:290] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a9d74900aef4225b4246087a3531e40 (127.15.90.1:39109), 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533)
I20260709 13:22:07.730988 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03d0fad7674062be845ed47f25e3f6" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9d74900aef4225b4246087a3531e40" is_pre_election: true
I20260709 13:22:07.731159 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03d0fad7674062be845ed47f25e3f6" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141" is_pre_election: true
I20260709 13:22:07.731703 24668 raft_consensus.cc:2468] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 0.
I20260709 13:22:07.731773 24817 raft_consensus.cc:2468] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 0.
I20260709 13:22:07.732993 24707 leader_election.cc:304] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1762cf133ed049788bcfb58835c15087, 27a9ab3cbae141d1b940a6fc8c969141; no voters: 
I20260709 13:22:07.733740 24867 raft_consensus.cc:2804] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:07.734084 24867 raft_consensus.cc:493] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:07.734407 24867 raft_consensus.cc:3060] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:07.739114 24867 raft_consensus.cc:515] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:07.740664 24867 leader_election.cc:290] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 election: Requested vote from peers 9a9d74900aef4225b4246087a3531e40 (127.15.90.1:39109), 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533)
I20260709 13:22:07.741380 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03d0fad7674062be845ed47f25e3f6" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9d74900aef4225b4246087a3531e40"
I20260709 13:22:07.741595 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03d0fad7674062be845ed47f25e3f6" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141"
I20260709 13:22:07.741930 24668 raft_consensus.cc:3060] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:07.742151 24817 raft_consensus.cc:3060] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:07.746623 24668 raft_consensus.cc:2468] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 1.
I20260709 13:22:07.747152 24817 raft_consensus.cc:2468] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 1.
I20260709 13:22:07.747588 24706 leader_election.cc:304] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1762cf133ed049788bcfb58835c15087, 9a9d74900aef4225b4246087a3531e40; no voters: 
I20260709 13:22:07.748415 24867 raft_consensus.cc:2804] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:07.748813 24867 raft_consensus.cc:697] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Becoming Leader. State: Replica: 1762cf133ed049788bcfb58835c15087, State: Running, Role: LEADER
I20260709 13:22:07.749570 24867 consensus_queue.cc:237] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:07.755213 24566 catalog_manager.cc:5697] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1762cf133ed049788bcfb58835c15087 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "1762cf133ed049788bcfb58835c15087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:07.836675 24566 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46268:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:07.839325 24566 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:07.862636 24657 tablet_service.cc:1511] Processing CreateTablet for tablet 3d82a02533794f798b8e1bf8e042a202 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6106d11a14084a1aac2a772e643c1a7c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:07.863966 24657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d82a02533794f798b8e1bf8e042a202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.863843 24732 tablet_service.cc:1511] Processing CreateTablet for tablet 3d82a02533794f798b8e1bf8e042a202 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6106d11a14084a1aac2a772e643c1a7c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:07.865135 24732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d82a02533794f798b8e1bf8e042a202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.866933 24806 tablet_service.cc:1511] Processing CreateTablet for tablet 3d82a02533794f798b8e1bf8e042a202 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6106d11a14084a1aac2a772e643c1a7c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:22:07.867061 24658 tablet_service.cc:1511] Processing CreateTablet for tablet 7f29467dec564023bbf3c0dc204acf4f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6106d11a14084a1aac2a772e643c1a7c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:07.868192 24806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d82a02533794f798b8e1bf8e042a202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.868369 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f29467dec564023bbf3c0dc204acf4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.878307 24733 tablet_service.cc:1511] Processing CreateTablet for tablet 7f29467dec564023bbf3c0dc204acf4f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6106d11a14084a1aac2a772e643c1a7c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:07.879580 24733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f29467dec564023bbf3c0dc204acf4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.880146 24857 tablet_bootstrap.cc:492] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40: Bootstrap starting.
I20260709 13:22:07.885183 24807 tablet_service.cc:1511] Processing CreateTablet for tablet 7f29467dec564023bbf3c0dc204acf4f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6106d11a14084a1aac2a772e643c1a7c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:22:07.886196 24857 tablet_bootstrap.cc:654] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.886474 24807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f29467dec564023bbf3c0dc204acf4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:07.892149 24860 tablet_bootstrap.cc:492] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087: Bootstrap starting.
I20260709 13:22:07.900020 24858 tablet_bootstrap.cc:492] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141: Bootstrap starting.
I20260709 13:22:07.908720 24860 tablet_bootstrap.cc:654] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.909178 24867 consensus_queue.cc:1048] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:07.913395 24858 tablet_bootstrap.cc:654] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.913074 24857 tablet_bootstrap.cc:492] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40: No bootstrap required, opened a new log
I20260709 13:22:07.914186 24857 ts_tablet_manager.cc:1403] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.010s
I20260709 13:22:07.918099 24857 raft_consensus.cc:359] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.919049 24857 raft_consensus.cc:385] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.919425 24857 raft_consensus.cc:740] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a9d74900aef4225b4246087a3531e40, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.931119 24860 tablet_bootstrap.cc:492] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087: No bootstrap required, opened a new log
I20260709 13:22:07.931660 24860 ts_tablet_manager.cc:1403] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.013s
I20260709 13:22:07.920571 24857 consensus_queue.cc:260] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.934271 24857 ts_tablet_manager.cc:1434] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:22:07.934705 24860 raft_consensus.cc:359] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.935513 24860 raft_consensus.cc:385] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.935846 24860 raft_consensus.cc:740] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1762cf133ed049788bcfb58835c15087, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.936757 24860 consensus_queue.cc:260] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.938081 24858 tablet_bootstrap.cc:492] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141: No bootstrap required, opened a new log
I20260709 13:22:07.938679 24858 ts_tablet_manager.cc:1403] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141: Time spent bootstrapping tablet: real 0.039s	user 0.026s	sys 0.001s
I20260709 13:22:07.939569 24860 ts_tablet_manager.cc:1434] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:22:07.940189 24857 tablet_bootstrap.cc:492] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40: Bootstrap starting.
I20260709 13:22:07.940547 24867 consensus_queue.cc:1048] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:07.941823 24858 raft_consensus.cc:359] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.942586 24858 raft_consensus.cc:385] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.943028 24858 raft_consensus.cc:740] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27a9ab3cbae141d1b940a6fc8c969141, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.943830 24858 consensus_queue.cc:260] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.947126 24858 ts_tablet_manager.cc:1434] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:22:07.942628 24860 tablet_bootstrap.cc:492] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087: Bootstrap starting.
I20260709 13:22:07.948308 24858 tablet_bootstrap.cc:492] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141: Bootstrap starting.
I20260709 13:22:07.951068 24857 tablet_bootstrap.cc:654] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.955093 24860 tablet_bootstrap.cc:654] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.956262 24858 tablet_bootstrap.cc:654] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:07.964044 24857 tablet_bootstrap.cc:492] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40: No bootstrap required, opened a new log
I20260709 13:22:07.966593 24857 ts_tablet_manager.cc:1403] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.003s
I20260709 13:22:07.969337 24860 tablet_bootstrap.cc:492] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087: No bootstrap required, opened a new log
I20260709 13:22:07.969851 24860 ts_tablet_manager.cc:1403] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.006s
I20260709 13:22:07.972890 24860 raft_consensus.cc:359] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.973604 24860 raft_consensus.cc:385] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.973995 24858 tablet_bootstrap.cc:492] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141: No bootstrap required, opened a new log
I20260709 13:22:07.973804 24857 raft_consensus.cc:359] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.973923 24860 raft_consensus.cc:740] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1762cf133ed049788bcfb58835c15087, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.974721 24858 ts_tablet_manager.cc:1403] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.008s
I20260709 13:22:07.974915 24857 raft_consensus.cc:385] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.975304 24857 raft_consensus.cc:740] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a9d74900aef4225b4246087a3531e40, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.975484 24860 consensus_queue.cc:260] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.976114 24857 consensus_queue.cc:260] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.977807 24858 raft_consensus.cc:359] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.978539 24858 raft_consensus.cc:385] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:07.978562 24867 raft_consensus.cc:493] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:07.978757 24857 ts_tablet_manager.cc:1434] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:22:07.979079 24858 raft_consensus.cc:740] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27a9ab3cbae141d1b940a6fc8c969141, State: Initialized, Role: FOLLOWER
I20260709 13:22:07.979270 24867 raft_consensus.cc:515] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.979921 24858 consensus_queue.cc:260] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.981365 24867 leader_election.cc:290] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a9d74900aef4225b4246087a3531e40 (127.15.90.1:39109), 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533)
I20260709 13:22:07.982049 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9d74900aef4225b4246087a3531e40" is_pre_election: true
I20260709 13:22:07.982750 24668 raft_consensus.cc:2468] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 0.
I20260709 13:22:07.983028 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141" is_pre_election: true
I20260709 13:22:07.983615 24817 raft_consensus.cc:2468] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 0.
I20260709 13:22:07.984877 24707 leader_election.cc:304] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1762cf133ed049788bcfb58835c15087, 27a9ab3cbae141d1b940a6fc8c969141; no voters: 
I20260709 13:22:07.985222 24858 ts_tablet_manager.cc:1434] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:07.985693 24867 raft_consensus.cc:2804] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:07.986073 24867 raft_consensus.cc:493] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:07.986393 24867 raft_consensus.cc:3060] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:07.987092 24860 ts_tablet_manager.cc:1434] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:22:07.993803 24867 raft_consensus.cc:515] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:07.996191 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9d74900aef4225b4246087a3531e40"
I20260709 13:22:07.996491 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141"
I20260709 13:22:07.996770 24668 raft_consensus.cc:3060] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:07.997094 24817 raft_consensus.cc:3060] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.000408 24867 leader_election.cc:290] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 election: Requested vote from peers 9a9d74900aef4225b4246087a3531e40 (127.15.90.1:39109), 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533)
I20260709 13:22:08.003789 24817 raft_consensus.cc:2468] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 1.
I20260709 13:22:08.003789 24668 raft_consensus.cc:2468] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 1.
I20260709 13:22:08.005074 24707 leader_election.cc:304] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1762cf133ed049788bcfb58835c15087, 27a9ab3cbae141d1b940a6fc8c969141; no voters: 
I20260709 13:22:08.005726 24867 raft_consensus.cc:2804] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.006196 24867 raft_consensus.cc:697] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Becoming Leader. State: Replica: 1762cf133ed049788bcfb58835c15087, State: Running, Role: LEADER
I20260709 13:22:08.006950 24867 consensus_queue.cc:237] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.014154 24565 catalog_manager.cc:5697] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1762cf133ed049788bcfb58835c15087 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "1762cf133ed049788bcfb58835c15087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.059065 24867 raft_consensus.cc:493] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:08.059551 24867 raft_consensus.cc:515] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.061224 24867 leader_election.cc:290] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a9d74900aef4225b4246087a3531e40 (127.15.90.1:39109), 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533)
I20260709 13:22:08.061926 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d82a02533794f798b8e1bf8e042a202" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9d74900aef4225b4246087a3531e40" is_pre_election: true
I20260709 13:22:08.062160 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d82a02533794f798b8e1bf8e042a202" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141" is_pre_election: true
I20260709 13:22:08.062565 24668 raft_consensus.cc:2468] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 0.
I20260709 13:22:08.062742 24817 raft_consensus.cc:2468] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 0.
I20260709 13:22:08.063516 24706 leader_election.cc:304] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1762cf133ed049788bcfb58835c15087, 9a9d74900aef4225b4246087a3531e40; no voters: 
I20260709 13:22:08.064266 24867 raft_consensus.cc:2804] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:08.064603 24867 raft_consensus.cc:493] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:08.064885 24867 raft_consensus.cc:3060] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.069756 24867 raft_consensus.cc:515] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.071193 24867 leader_election.cc:290] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 election: Requested vote from peers 9a9d74900aef4225b4246087a3531e40 (127.15.90.1:39109), 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533)
I20260709 13:22:08.071965 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d82a02533794f798b8e1bf8e042a202" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9d74900aef4225b4246087a3531e40"
I20260709 13:22:08.072081 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d82a02533794f798b8e1bf8e042a202" candidate_uuid: "1762cf133ed049788bcfb58835c15087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141"
I20260709 13:22:08.072518 24668 raft_consensus.cc:3060] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.072664 24817 raft_consensus.cc:3060] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:08.077111 24668 raft_consensus.cc:2468] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 1.
I20260709 13:22:08.077838 24817 raft_consensus.cc:2468] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1762cf133ed049788bcfb58835c15087 in term 1.
I20260709 13:22:08.078051 24706 leader_election.cc:304] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1762cf133ed049788bcfb58835c15087, 9a9d74900aef4225b4246087a3531e40; no voters: 
I20260709 13:22:08.078929 24867 raft_consensus.cc:2804] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:08.079394 24867 raft_consensus.cc:697] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Becoming Leader. State: Replica: 1762cf133ed049788bcfb58835c15087, State: Running, Role: LEADER
I20260709 13:22:08.080246 24867 consensus_queue.cc:237] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.086265 24565 catalog_manager.cc:5697] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1762cf133ed049788bcfb58835c15087 (127.15.90.2). New cstate: current_term: 1 leader_uuid: "1762cf133ed049788bcfb58835c15087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.140189 24743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e03d0fad7674062be845ed47f25e3f6"
dest_uuid: "1762cf133ed049788bcfb58835c15087"
mode: GRACEFUL
new_leader_uuid: "9a9d74900aef4225b4246087a3531e40"
 from {username='slave'} at 127.0.0.1:59922
I20260709 13:22:08.140739 24743 raft_consensus.cc:606] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Received request to transfer leadership to TS 9a9d74900aef4225b4246087a3531e40
I20260709 13:22:08.148397 24743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d82a02533794f798b8e1bf8e042a202"
dest_uuid: "1762cf133ed049788bcfb58835c15087"
mode: GRACEFUL
new_leader_uuid: "9a9d74900aef4225b4246087a3531e40"
 from {username='slave'} at 127.0.0.1:59922
I20260709 13:22:08.148875 24743 raft_consensus.cc:606] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Received request to transfer leadership to TS 9a9d74900aef4225b4246087a3531e40
I20260709 13:22:08.153440 24743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f"
dest_uuid: "1762cf133ed049788bcfb58835c15087"
mode: GRACEFUL
new_leader_uuid: "9a9d74900aef4225b4246087a3531e40"
 from {username='slave'} at 127.0.0.1:59922
I20260709 13:22:08.153908 24743 raft_consensus.cc:606] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Received request to transfer leadership to TS 9a9d74900aef4225b4246087a3531e40
I20260709 13:22:08.183157 24867 consensus_queue.cc:1048] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.189957 24870 raft_consensus.cc:993] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087: : Instructing follower 9a9d74900aef4225b4246087a3531e40 to start an election
I20260709 13:22:08.190492 24867 raft_consensus.cc:1081] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Signalling peer 9a9d74900aef4225b4246087a3531e40 to start an election
I20260709 13:22:08.192307 24667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e03d0fad7674062be845ed47f25e3f6"
dest_uuid: "9a9d74900aef4225b4246087a3531e40"
 from {username='slave'} at 127.0.0.1:51562
I20260709 13:22:08.192875 24667 raft_consensus.cc:493] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:08.193249 24667 raft_consensus.cc:3060] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.199105 24667 raft_consensus.cc:515] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:08.204353 24867 consensus_queue.cc:1048] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.209398 24667 leader_election.cc:290] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [CANDIDATE]: Term 2 election: Requested vote from peers 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533), 1762cf133ed049788bcfb58835c15087 (127.15.90.2:40969)
I20260709 13:22:08.222204 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03d0fad7674062be845ed47f25e3f6" candidate_uuid: "9a9d74900aef4225b4246087a3531e40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141"
I20260709 13:22:08.222879 24817 raft_consensus.cc:3060] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.228307 24743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e03d0fad7674062be845ed47f25e3f6" candidate_uuid: "9a9d74900aef4225b4246087a3531e40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1762cf133ed049788bcfb58835c15087"
I20260709 13:22:08.228992 24743 raft_consensus.cc:3055] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:08.229316 24743 raft_consensus.cc:740] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1762cf133ed049788bcfb58835c15087, State: Running, Role: LEADER
I20260709 13:22:08.230291 24817 raft_consensus.cc:2468] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a9d74900aef4225b4246087a3531e40 in term 2.
I20260709 13:22:08.230154 24743 consensus_queue.cc:260] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:08.231578 24743 raft_consensus.cc:3060] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.231746 24632 leader_election.cc:304] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27a9ab3cbae141d1b940a6fc8c969141, 9a9d74900aef4225b4246087a3531e40; no voters: 
I20260709 13:22:08.232712 24865 raft_consensus.cc:2804] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:08.234014 24865 raft_consensus.cc:697] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 2 LEADER]: Becoming Leader. State: Replica: 9a9d74900aef4225b4246087a3531e40, State: Running, Role: LEADER
I20260709 13:22:08.234861 24865 consensus_queue.cc:237] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } }
I20260709 13:22:08.239004 24743 raft_consensus.cc:2468] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a9d74900aef4225b4246087a3531e40 in term 2.
I20260709 13:22:08.242210 24565 catalog_manager.cc:5697] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 reported cstate change: term changed from 1 to 2, leader changed from 1762cf133ed049788bcfb58835c15087 (127.15.90.2) to 9a9d74900aef4225b4246087a3531e40 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "9a9d74900aef4225b4246087a3531e40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.452824 24895 consensus_queue.cc:1048] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.459810 24867 raft_consensus.cc:993] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087: : Instructing follower 9a9d74900aef4225b4246087a3531e40 to start an election
I20260709 13:22:08.460263 24870 raft_consensus.cc:1081] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Signalling peer 9a9d74900aef4225b4246087a3531e40 to start an election
I20260709 13:22:08.461829 24668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f"
dest_uuid: "9a9d74900aef4225b4246087a3531e40"
 from {username='slave'} at 127.0.0.1:51562
I20260709 13:22:08.462522 24668 raft_consensus.cc:493] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:08.462925 24668 raft_consensus.cc:3060] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.466563 24867 consensus_queue.cc:1048] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.470243 24668 raft_consensus.cc:515] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.473939 24668 leader_election.cc:290] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [CANDIDATE]: Term 2 election: Requested vote from peers 1762cf133ed049788bcfb58835c15087 (127.15.90.2:40969), 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533)
I20260709 13:22:08.475461 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f" candidate_uuid: "9a9d74900aef4225b4246087a3531e40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141"
I20260709 13:22:08.476547 24743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f" candidate_uuid: "9a9d74900aef4225b4246087a3531e40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1762cf133ed049788bcfb58835c15087"
I20260709 13:22:08.476145 24817 raft_consensus.cc:3060] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.477128 24743 raft_consensus.cc:3055] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:08.477567 24743 raft_consensus.cc:740] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1762cf133ed049788bcfb58835c15087, State: Running, Role: LEADER
I20260709 13:22:08.478420 24743 consensus_queue.cc:260] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.479588 24743 raft_consensus.cc:3060] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.482512 24817 raft_consensus.cc:2468] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a9d74900aef4225b4246087a3531e40 in term 2.
I20260709 13:22:08.483620 24632 leader_election.cc:304] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27a9ab3cbae141d1b940a6fc8c969141, 9a9d74900aef4225b4246087a3531e40; no voters: 
I20260709 13:22:08.484447 24865 raft_consensus.cc:2804] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:08.484743 24743 raft_consensus.cc:2468] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a9d74900aef4225b4246087a3531e40 in term 2.
I20260709 13:22:08.484953 24865 raft_consensus.cc:697] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 2 LEADER]: Becoming Leader. State: Replica: 9a9d74900aef4225b4246087a3531e40, State: Running, Role: LEADER
I20260709 13:22:08.485813 24865 consensus_queue.cc:237] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.491964 24563 catalog_manager.cc:5697] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 reported cstate change: term changed from 1 to 2, leader changed from 1762cf133ed049788bcfb58835c15087 (127.15.90.2) to 9a9d74900aef4225b4246087a3531e40 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "9a9d74900aef4225b4246087a3531e40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.599531 24867 consensus_queue.cc:1048] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.610584 24895 consensus_queue.cc:1048] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:08.617951 24870 raft_consensus.cc:993] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087: : Instructing follower 9a9d74900aef4225b4246087a3531e40 to start an election
I20260709 13:22:08.618518 24895 raft_consensus.cc:1081] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Signalling peer 9a9d74900aef4225b4246087a3531e40 to start an election
I20260709 13:22:08.620139 24668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d82a02533794f798b8e1bf8e042a202"
dest_uuid: "9a9d74900aef4225b4246087a3531e40"
 from {username='slave'} at 127.0.0.1:51562
I20260709 13:22:08.620615 24668 raft_consensus.cc:493] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:08.620920 24668 raft_consensus.cc:3060] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.625779 24668 raft_consensus.cc:515] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.627851 24668 leader_election.cc:290] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [CANDIDATE]: Term 2 election: Requested vote from peers 1762cf133ed049788bcfb58835c15087 (127.15.90.2:40969), 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3:33533)
I20260709 13:22:08.628496 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d82a02533794f798b8e1bf8e042a202" candidate_uuid: "9a9d74900aef4225b4246087a3531e40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141"
I20260709 13:22:08.628185 24743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d82a02533794f798b8e1bf8e042a202" candidate_uuid: "9a9d74900aef4225b4246087a3531e40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1762cf133ed049788bcfb58835c15087"
I20260709 13:22:08.629169 24817 raft_consensus.cc:3060] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.629261 24743 raft_consensus.cc:3055] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:08.629714 24743 raft_consensus.cc:740] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1762cf133ed049788bcfb58835c15087, State: Running, Role: LEADER
I20260709 13:22:08.630518 24743 consensus_queue.cc:260] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.631834 24743 raft_consensus.cc:3060] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:08.634541 24817 raft_consensus.cc:2468] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a9d74900aef4225b4246087a3531e40 in term 2.
I20260709 13:22:08.635746 24632 leader_election.cc:304] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27a9ab3cbae141d1b940a6fc8c969141, 9a9d74900aef4225b4246087a3531e40; no voters: 
I20260709 13:22:08.636538 24865 raft_consensus.cc:2804] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:08.636972 24865 raft_consensus.cc:697] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 2 LEADER]: Becoming Leader. State: Replica: 9a9d74900aef4225b4246087a3531e40, State: Running, Role: LEADER
I20260709 13:22:08.637137 24743 raft_consensus.cc:2468] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a9d74900aef4225b4246087a3531e40 in term 2.
I20260709 13:22:08.637790 24865 consensus_queue.cc:237] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.643847 24565 catalog_manager.cc:5697] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 reported cstate change: term changed from 1 to 2, leader changed from 1762cf133ed049788bcfb58835c15087 (127.15.90.2) to 9a9d74900aef4225b4246087a3531e40 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "9a9d74900aef4225b4246087a3531e40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:08.697263 24817 raft_consensus.cc:1275] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [term 2 FOLLOWER]: Refusing update from remote peer 9a9d74900aef4225b4246087a3531e40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:08.697263 24743 raft_consensus.cc:1275] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 2 FOLLOWER]: Refusing update from remote peer 9a9d74900aef4225b4246087a3531e40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:08.699868 24865 consensus_queue.cc:1048] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:08.700963 24900 consensus_queue.cc:1048] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:08.882416 15720 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:22:08.884030 15720 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:22:08.884444 15720 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:22:08.897476 24668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f"
dest_uuid: "9a9d74900aef4225b4246087a3531e40"
mode: GRACEFUL
new_leader_uuid: "27a9ab3cbae141d1b940a6fc8c969141"
 from {username='slave'} at 127.0.0.1:51574
I20260709 13:22:08.898111 24668 raft_consensus.cc:606] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 2 LEADER]: Received request to transfer leadership to TS 27a9ab3cbae141d1b940a6fc8c969141
I20260709 13:22:08.899350 15720 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:22:08.940774 24817 raft_consensus.cc:1275] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 2 FOLLOWER]: Refusing update from remote peer 9a9d74900aef4225b4246087a3531e40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:08.942147 24906 consensus_queue.cc:1048] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:08.948577 24900 raft_consensus.cc:993] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40: : Instructing follower 27a9ab3cbae141d1b940a6fc8c969141 to start an election
I20260709 13:22:08.949119 24865 raft_consensus.cc:1081] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 2 LEADER]: Signalling peer 27a9ab3cbae141d1b940a6fc8c969141 to start an election
I20260709 13:22:08.950886 24816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f"
dest_uuid: "27a9ab3cbae141d1b940a6fc8c969141"
 from {username='slave'} at 127.0.0.1:34310
I20260709 13:22:08.951575 24816 raft_consensus.cc:493] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:08.952068 24816 raft_consensus.cc:3060] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:08.954748 24743 raft_consensus.cc:1275] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 2 FOLLOWER]: Refusing update from remote peer 9a9d74900aef4225b4246087a3531e40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:08.956079 24900 consensus_queue.cc:1048] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:08.964298 24816 raft_consensus.cc:515] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.965413 24817 raft_consensus.cc:1240] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 3 FOLLOWER]: Rejecting Update request from peer 9a9d74900aef4225b4246087a3531e40 for earlier term 2. Current term is 3. Ops: []
I20260709 13:22:08.970320 24900 consensus_queue.cc:1059] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:08.971308 24906 raft_consensus.cc:3055] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:08.971765 24906 raft_consensus.cc:740] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a9d74900aef4225b4246087a3531e40, State: Running, Role: LEADER
I20260709 13:22:08.972791 24906 consensus_queue.cc:260] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:08.973074 24816 leader_election.cc:290] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [CANDIDATE]: Term 3 election: Requested vote from peers 9a9d74900aef4225b4246087a3531e40 (127.15.90.1:39109), 1762cf133ed049788bcfb58835c15087 (127.15.90.2:40969)
I20260709 13:22:08.973904 24906 raft_consensus.cc:3060] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:08.986202 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f" candidate_uuid: "27a9ab3cbae141d1b940a6fc8c969141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a9d74900aef4225b4246087a3531e40"
I20260709 13:22:08.994786 24668 raft_consensus.cc:2468] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27a9ab3cbae141d1b940a6fc8c969141 in term 3.
I20260709 13:22:08.994874 24743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f29467dec564023bbf3c0dc204acf4f" candidate_uuid: "27a9ab3cbae141d1b940a6fc8c969141" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1762cf133ed049788bcfb58835c15087"
I20260709 13:22:08.995656 24743 raft_consensus.cc:3060] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:08.996551 24780 leader_election.cc:304] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27a9ab3cbae141d1b940a6fc8c969141, 9a9d74900aef4225b4246087a3531e40; no voters: 
I20260709 13:22:08.997646 24862 raft_consensus.cc:2804] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:08.998608 24862 raft_consensus.cc:697] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 3 LEADER]: Becoming Leader. State: Replica: 27a9ab3cbae141d1b940a6fc8c969141, State: Running, Role: LEADER
I20260709 13:22:08.999784 24862 consensus_queue.cc:237] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } }
I20260709 13:22:09.003576 24743 raft_consensus.cc:2468] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27a9ab3cbae141d1b940a6fc8c969141 in term 3.
I20260709 13:22:09.005776 24565 catalog_manager.cc:5697] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 reported cstate change: term changed from 2 to 3, leader changed from 9a9d74900aef4225b4246087a3531e40 (127.15.90.1) to 27a9ab3cbae141d1b940a6fc8c969141 (127.15.90.3). New cstate: current_term: 3 leader_uuid: "27a9ab3cbae141d1b940a6fc8c969141" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a9d74900aef4225b4246087a3531e40" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 39109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1762cf133ed049788bcfb58835c15087" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 40969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27a9ab3cbae141d1b940a6fc8c969141" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 33533 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:09.037148 15720 tablet_server.cc:179] TabletServer@127.15.90.1:0 shutting down...
I20260709 13:22:09.062023 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:09.062770 15720 tablet_replica.cc:333] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40: stopping tablet replica
I20260709 13:22:09.063485 15720 raft_consensus.cc:2243] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:09.064394 15720 pending_rounds.cc:70] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40: Trying to abort 1 pending ops.
I20260709 13:22:09.064599 15720 pending_rounds.cc:77] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639234109456384 op_type: NO_OP noop_request { }
I20260709 13:22:09.064909 15720 raft_consensus.cc:2889] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:09.065220 15720 raft_consensus.cc:2272] T 3d82a02533794f798b8e1bf8e042a202 P 9a9d74900aef4225b4246087a3531e40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.068881 15720 tablet_replica.cc:333] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40: stopping tablet replica
I20260709 13:22:09.069572 15720 raft_consensus.cc:2243] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:09.070007 15720 raft_consensus.cc:2272] T 7f29467dec564023bbf3c0dc204acf4f P 9a9d74900aef4225b4246087a3531e40 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:09.072475 24706 consensus_peers.cc:597] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 -> Peer 9a9d74900aef4225b4246087a3531e40 (127.15.90.1:39109): Couldn't send request to peer 9a9d74900aef4225b4246087a3531e40. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:09.073766 15720 tablet_replica.cc:333] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40: stopping tablet replica
I20260709 13:22:09.074345 15720 raft_consensus.cc:2243] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:09.074832 15720 raft_consensus.cc:2272] T 71e8a70588c34134bd534a5ea0204a01 P 9a9d74900aef4225b4246087a3531e40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.077051 15720 tablet_replica.cc:333] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40: stopping tablet replica
I20260709 13:22:09.077522 15720 raft_consensus.cc:2243] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:09.078279 15720 raft_consensus.cc:2272] T 5e03d0fad7674062be845ed47f25e3f6 P 9a9d74900aef4225b4246087a3531e40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.093677 15720 tablet_server.cc:196] TabletServer@127.15.90.1:0 shutdown complete.
I20260709 13:22:09.111171 15720 tablet_server.cc:179] TabletServer@127.15.90.2:0 shutting down...
I20260709 13:22:09.134552 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:09.135285 15720 tablet_replica.cc:333] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087: stopping tablet replica
I20260709 13:22:09.136003 15720 raft_consensus.cc:2243] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:09.136551 15720 raft_consensus.cc:2272] T 3d82a02533794f798b8e1bf8e042a202 P 1762cf133ed049788bcfb58835c15087 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.139243 15720 tablet_replica.cc:333] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087: stopping tablet replica
I20260709 13:22:09.139942 15720 raft_consensus.cc:2243] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:09.140419 15720 raft_consensus.cc:2272] T 7f29467dec564023bbf3c0dc204acf4f P 1762cf133ed049788bcfb58835c15087 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.143198 15720 tablet_replica.cc:333] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087: stopping tablet replica
I20260709 13:22:09.143646 15720 raft_consensus.cc:2243] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:09.144593 15720 raft_consensus.cc:2272] T 71e8a70588c34134bd534a5ea0204a01 P 1762cf133ed049788bcfb58835c15087 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.146793 15720 tablet_replica.cc:333] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087: stopping tablet replica
I20260709 13:22:09.147228 15720 raft_consensus.cc:2243] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:09.147598 15720 raft_consensus.cc:2272] T 5e03d0fad7674062be845ed47f25e3f6 P 1762cf133ed049788bcfb58835c15087 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.172729 15720 tablet_server.cc:196] TabletServer@127.15.90.2:0 shutdown complete.
I20260709 13:22:09.188473 15720 tablet_server.cc:179] TabletServer@127.15.90.3:0 shutting down...
I20260709 13:22:09.209693 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:09.210431 15720 tablet_replica.cc:333] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141: stopping tablet replica
I20260709 13:22:09.211102 15720 raft_consensus.cc:2243] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:09.211654 15720 raft_consensus.cc:2272] T 3d82a02533794f798b8e1bf8e042a202 P 27a9ab3cbae141d1b940a6fc8c969141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.214588 15720 tablet_replica.cc:333] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141: stopping tablet replica
I20260709 13:22:09.215137 15720 raft_consensus.cc:2243] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:09.215574 15720 raft_consensus.cc:2272] T 5e03d0fad7674062be845ed47f25e3f6 P 27a9ab3cbae141d1b940a6fc8c969141 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.218329 15720 tablet_replica.cc:333] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141: stopping tablet replica
I20260709 13:22:09.218878 15720 raft_consensus.cc:2243] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:09.219466 15720 pending_rounds.cc:70] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141: Trying to abort 2 pending ops.
I20260709 13:22:09.219709 15720 pending_rounds.cc:77] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305639235591405568 op_type: NO_OP noop_request { }
I20260709 13:22:09.220001 15720 raft_consensus.cc:2889] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:09.220220 15720 pending_rounds.cc:77] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305639233486299136 op_type: NO_OP noop_request { }
I20260709 13:22:09.220455 15720 raft_consensus.cc:2889] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:22:09.220729 15720 raft_consensus.cc:2272] T 7f29467dec564023bbf3c0dc204acf4f P 27a9ab3cbae141d1b940a6fc8c969141 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.223369 15720 tablet_replica.cc:333] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141: stopping tablet replica
I20260709 13:22:09.223943 15720 raft_consensus.cc:2243] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:09.224557 15720 raft_consensus.cc:2272] T 71e8a70588c34134bd534a5ea0204a01 P 27a9ab3cbae141d1b940a6fc8c969141 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.248890 15720 tablet_server.cc:196] TabletServer@127.15.90.3:0 shutdown complete.
I20260709 13:22:09.264365 15720 master.cc:562] Master@127.15.90.62:36825 shutting down...
I20260709 13:22:09.285190 15720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:09.285729 15720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:09.286032 15720 tablet_replica.cc:333] T 00000000000000000000000000000000 P de238a0e7e1c474d8c31e03fa0d0898d: stopping tablet replica
I20260709 13:22:09.304980 15720 master.cc:584] Master@127.15.90.62:36825 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2628 ms)
[----------] 6 tests from LeaderRebalancerTest (257518 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:22:09.343660 15720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.90.62:44919
I20260709 13:22:09.344861 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:09.350147 24915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:09.350240 24914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:09.351504 24917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:09.352779 15720 server_base.cc:1061] running on GCE node
I20260709 13:22:09.353528 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:09.353749 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:09.353902 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603329353886 us; error 0 us; skew 500 ppm
I20260709 13:22:09.354393 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:09.356630 15720 webserver.cc:533] Webserver started at http://127.15.90.62:33509/ using document root <none> and password file <none>
I20260709 13:22:09.357102 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:09.357297 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:09.357549 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:09.358611 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/master-0-root/instance:
uuid: "4b865eaee08c4ad6bc458e9170eeca01"
format_stamp: "Formatted at 2026-07-09 13:22:09 on dist-test-slave-fpp7"
I20260709 13:22:09.362788 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:22:09.365967 24922 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:09.366693 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:22:09.366971 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/master-0-root
uuid: "4b865eaee08c4ad6bc458e9170eeca01"
format_stamp: "Formatted at 2026-07-09 13:22:09 on dist-test-slave-fpp7"
I20260709 13:22:09.367250 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:09.381610 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:09.382822 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:09.420200 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.62:44919
I20260709 13:22:09.420300 24973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.62:44919 every 8 connection(s)
I20260709 13:22:09.423892 24974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.434834 24974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01: Bootstrap starting.
I20260709 13:22:09.439581 24974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:09.443557 24974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01: No bootstrap required, opened a new log
I20260709 13:22:09.445608 24974 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b865eaee08c4ad6bc458e9170eeca01" member_type: VOTER }
I20260709 13:22:09.445947 24974 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:09.446117 24974 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b865eaee08c4ad6bc458e9170eeca01, State: Initialized, Role: FOLLOWER
I20260709 13:22:09.446666 24974 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b865eaee08c4ad6bc458e9170eeca01" member_type: VOTER }
I20260709 13:22:09.447070 24974 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:09.447252 24974 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:09.447450 24974 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:09.451639 24974 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b865eaee08c4ad6bc458e9170eeca01" member_type: VOTER }
I20260709 13:22:09.452133 24974 leader_election.cc:304] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b865eaee08c4ad6bc458e9170eeca01; no voters: 
I20260709 13:22:09.453154 24974 leader_election.cc:290] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:09.453450 24977 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:09.454759 24977 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [term 1 LEADER]: Becoming Leader. State: Replica: 4b865eaee08c4ad6bc458e9170eeca01, State: Running, Role: LEADER
I20260709 13:22:09.455389 24977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b865eaee08c4ad6bc458e9170eeca01" member_type: VOTER }
I20260709 13:22:09.456069 24974 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:09.458250 24978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b865eaee08c4ad6bc458e9170eeca01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b865eaee08c4ad6bc458e9170eeca01" member_type: VOTER } }
I20260709 13:22:09.458259 24979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b865eaee08c4ad6bc458e9170eeca01. Latest consensus state: current_term: 1 leader_uuid: "4b865eaee08c4ad6bc458e9170eeca01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b865eaee08c4ad6bc458e9170eeca01" member_type: VOTER } }
I20260709 13:22:09.458998 24978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:09.459112 24979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:09.467484 24982 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:09.475158 24982 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:09.476097 15720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:09.483891 24982 catalog_manager.cc:1383] Generated new cluster ID: c015ccd8f0984eb0a5f925d168d06180
I20260709 13:22:09.484130 24982 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:09.499084 24982 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:09.500563 24982 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:09.514642 24982 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01: Generated new TSK 0
I20260709 13:22:09.515204 24982 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:09.542512 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:09.548645 24995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:09.549561 24996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:09.552141 15720 server_base.cc:1061] running on GCE node
W20260709 13:22:09.552561 24998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:09.553555 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:09.553730 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:09.553854 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603329553844 us; error 0 us; skew 500 ppm
I20260709 13:22:09.554370 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:09.556661 15720 webserver.cc:533] Webserver started at http://127.15.90.1:45311/ using document root <none> and password file <none>
I20260709 13:22:09.557080 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:09.557224 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:09.557585 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:09.558637 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-0-root/instance:
uuid: "0cfaba879caa48989267551827a9d729"
format_stamp: "Formatted at 2026-07-09 13:22:09 on dist-test-slave-fpp7"
I20260709 13:22:09.563202 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:22:09.566738 25003 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:09.567520 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:09.567847 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-0-root
uuid: "0cfaba879caa48989267551827a9d729"
format_stamp: "Formatted at 2026-07-09 13:22:09 on dist-test-slave-fpp7"
I20260709 13:22:09.568145 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:09.587419 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:09.588694 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:09.590106 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:09.592767 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:09.593065 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:09.593333 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:09.593535 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:09.642935 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.1:42129
I20260709 13:22:09.643060 25065 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.1:42129 every 8 connection(s)
I20260709 13:22:09.647643 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:09.654671 25070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:09.655604 25071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:09.659019 25073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:09.659113 15720 server_base.cc:1061] running on GCE node
I20260709 13:22:09.660523 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:09.660775 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:09.660974 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603329660956 us; error 0 us; skew 500 ppm
I20260709 13:22:09.661638 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:09.664438 15720 webserver.cc:533] Webserver started at http://127.15.90.2:42917/ using document root <none> and password file <none>
I20260709 13:22:09.664937 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:09.665171 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:09.665565 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:09.666949 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-1-root/instance:
uuid: "a523bed461d94e16b91e8c7bc3eb849b"
format_stamp: "Formatted at 2026-07-09 13:22:09 on dist-test-slave-fpp7"
I20260709 13:22:09.667215 25066 heartbeater.cc:344] Connected to a master server at 127.15.90.62:44919
I20260709 13:22:09.667661 25066 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:09.668419 25066 heartbeater.cc:507] Master 127.15.90.62:44919 requested a full tablet report, sending...
I20260709 13:22:09.670642 24939 ts_manager.cc:194] Registered new tserver with Master: 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129)
I20260709 13:22:09.672123 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:22:09.672945 24939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33180
I20260709 13:22:09.675849 25078 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:09.676663 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:22:09.676908 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-1-root
uuid: "a523bed461d94e16b91e8c7bc3eb849b"
format_stamp: "Formatted at 2026-07-09 13:22:09 on dist-test-slave-fpp7"
I20260709 13:22:09.677171 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:09.694051 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:09.695144 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:09.696656 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:09.698841 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:09.699008 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:09.699321 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:09.699477 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:09.738483 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.2:35839
I20260709 13:22:09.738613 25140 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.2:35839 every 8 connection(s)
I20260709 13:22:09.743372 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:09.749591 25144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:09.750603 25145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:09.751789 25147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:09.753907 15720 server_base.cc:1061] running on GCE node
I20260709 13:22:09.754994 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:09.755264 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:09.755465 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603329755447 us; error 0 us; skew 500 ppm
I20260709 13:22:09.756040 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:09.756289 25141 heartbeater.cc:344] Connected to a master server at 127.15.90.62:44919
I20260709 13:22:09.756662 25141 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:09.757548 25141 heartbeater.cc:507] Master 127.15.90.62:44919 requested a full tablet report, sending...
I20260709 13:22:09.758574 15720 webserver.cc:533] Webserver started at http://127.15.90.3:43799/ using document root <none> and password file <none>
I20260709 13:22:09.759126 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:09.759341 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:09.759596 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:09.759622 24939 ts_manager.cc:194] Registered new tserver with Master: a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:09.760831 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-2-root/instance:
uuid: "5763209744194094ba5ef8926ff0607a"
format_stamp: "Formatted at 2026-07-09 13:22:09 on dist-test-slave-fpp7"
I20260709 13:22:09.761125 24939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33182
I20260709 13:22:09.765273 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:09.768648 25152 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:09.769550 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:09.769832 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-2-root
uuid: "5763209744194094ba5ef8926ff0607a"
format_stamp: "Formatted at 2026-07-09 13:22:09 on dist-test-slave-fpp7"
I20260709 13:22:09.770098 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783603071664575-15720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:09.810881 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:09.812095 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:09.813593 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:09.815933 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:09.816107 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:09.816394 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:09.816551 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:09.854620 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.3:41241
I20260709 13:22:09.854725 25214 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.3:41241 every 8 connection(s)
I20260709 13:22:09.868517 25215 heartbeater.cc:344] Connected to a master server at 127.15.90.62:44919
I20260709 13:22:09.869012 25215 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:09.869836 25215 heartbeater.cc:507] Master 127.15.90.62:44919 requested a full tablet report, sending...
I20260709 13:22:09.871644 24939 ts_manager.cc:194] Registered new tserver with Master: 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:09.872252 15720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014485894s
I20260709 13:22:09.873102 24939 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33194
I20260709 13:22:09.896435 24939 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33196:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:09.899243 24939 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:09.967586 25106 tablet_service.cc:1511] Processing CreateTablet for tablet f31cf153dd3645e69848b0148bcc7401 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:09.968070 25180 tablet_service.cc:1511] Processing CreateTablet for tablet f31cf153dd3645e69848b0148bcc7401 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:09.969841 25106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31cf153dd3645e69848b0148bcc7401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.970489 25180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31cf153dd3645e69848b0148bcc7401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.972174 25105 tablet_service.cc:1511] Processing CreateTablet for tablet e27a94daca084c39904deaf22bf64bc7 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:09.972369 25104 tablet_service.cc:1511] Processing CreateTablet for tablet e759d2753f6b4ddda48a010f9485698e (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:09.973620 25105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27a94daca084c39904deaf22bf64bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.973894 25178 tablet_service.cc:1511] Processing CreateTablet for tablet e759d2753f6b4ddda48a010f9485698e (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:09.975250 25178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e759d2753f6b4ddda48a010f9485698e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.975862 25029 tablet_service.cc:1511] Processing CreateTablet for tablet e759d2753f6b4ddda48a010f9485698e (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:09.977829 25029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e759d2753f6b4ddda48a010f9485698e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.978199 25104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e759d2753f6b4ddda48a010f9485698e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.978768 25103 tablet_service.cc:1511] Processing CreateTablet for tablet cdb8c6a649c14286bc5db194a159cb12 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:09.980044 25103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb8c6a649c14286bc5db194a159cb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.981575 25177 tablet_service.cc:1511] Processing CreateTablet for tablet cdb8c6a649c14286bc5db194a159cb12 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:09.982928 25177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb8c6a649c14286bc5db194a159cb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.982863 25031 tablet_service.cc:1511] Processing CreateTablet for tablet f31cf153dd3645e69848b0148bcc7401 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:09.984261 25031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31cf153dd3645e69848b0148bcc7401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.984722 25028 tablet_service.cc:1511] Processing CreateTablet for tablet cdb8c6a649c14286bc5db194a159cb12 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:09.986027 25028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb8c6a649c14286bc5db194a159cb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.986063 25176 tablet_service.cc:1511] Processing CreateTablet for tablet bec99940072a4483ab476881a82c1285 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:09.987882 25030 tablet_service.cc:1511] Processing CreateTablet for tablet e27a94daca084c39904deaf22bf64bc7 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:09.989183 25030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27a94daca084c39904deaf22bf64bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.972369 25179 tablet_service.cc:1511] Processing CreateTablet for tablet e27a94daca084c39904deaf22bf64bc7 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:09.991957 25175 tablet_service.cc:1511] Processing CreateTablet for tablet cfcd88aad12d4581bd0777fe9248f56c (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:09.993371 25102 tablet_service.cc:1511] Processing CreateTablet for tablet bec99940072a4483ab476881a82c1285 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:09.994833 25102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec99940072a4483ab476881a82c1285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.996719 25101 tablet_service.cc:1511] Processing CreateTablet for tablet cfcd88aad12d4581bd0777fe9248f56c (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:09.998154 25101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfcd88aad12d4581bd0777fe9248f56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:09.999589 25179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27a94daca084c39904deaf22bf64bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.000377 25176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec99940072a4483ab476881a82c1285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.001080 25175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfcd88aad12d4581bd0777fe9248f56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.000919 25026 tablet_service.cc:1511] Processing CreateTablet for tablet cfcd88aad12d4581bd0777fe9248f56c (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:10.002332 25026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfcd88aad12d4581bd0777fe9248f56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.004793 25174 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8e79cd172b4c2abce4091a486b3b60 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:10.006412 25174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8e79cd172b4c2abce4091a486b3b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.008002 25027 tablet_service.cc:1511] Processing CreateTablet for tablet bec99940072a4483ab476881a82c1285 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:10.009699 25027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec99940072a4483ab476881a82c1285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.017292 25025 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8e79cd172b4c2abce4091a486b3b60 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:10.019320 25025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8e79cd172b4c2abce4091a486b3b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.025148 25100 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8e79cd172b4c2abce4091a486b3b60 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:10.026573 25100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8e79cd172b4c2abce4091a486b3b60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.063289 25024 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5197a405cd410a9077aaf68df394dd (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:10.064797 25024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5197a405cd410a9077aaf68df394dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.071345 25099 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5197a405cd410a9077aaf68df394dd (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:10.072806 25099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5197a405cd410a9077aaf68df394dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.084939 25230 tablet_bootstrap.cc:492] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:10.090059 25173 tablet_service.cc:1511] Processing CreateTablet for tablet 2f5197a405cd410a9077aaf68df394dd (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:10.091468 25173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f5197a405cd410a9077aaf68df394dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.093642 25230 tablet_bootstrap.cc:654] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.104619 25026 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4a4522a24a41409d25f48aff64a620 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:10.105108 25230 tablet_bootstrap.cc:492] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:10.105654 25230 ts_tablet_manager.cc:1403] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 13:22:10.105957 25026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4a4522a24a41409d25f48aff64a620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.108578 25230 raft_consensus.cc:359] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.109344 25230 raft_consensus.cc:385] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.109637 25230 raft_consensus.cc:740] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.110594 25230 consensus_queue.cc:260] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.111792 25098 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4a4522a24a41409d25f48aff64a620 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:10.115845 25098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4a4522a24a41409d25f48aff64a620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.119433 25066 heartbeater.cc:499] Master 127.15.90.62:44919 was elected leader, sending a full tablet report...
I20260709 13:22:10.125139 25232 tablet_bootstrap.cc:492] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:10.145437 25174 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4a4522a24a41409d25f48aff64a620 (DEFAULT_TABLE table=test-workload [id=34d37fe197114d9286194974d9d4704c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:10.149163 25174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4a4522a24a41409d25f48aff64a620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:10.152180 25232 tablet_bootstrap.cc:654] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.156325 25230 ts_tablet_manager.cc:1434] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.050s	user 0.013s	sys 0.004s
I20260709 13:22:10.180893 25230 tablet_bootstrap.cc:492] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:10.195829 25230 tablet_bootstrap.cc:654] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.196542 25233 tablet_bootstrap.cc:492] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:10.206717 25230 tablet_bootstrap.cc:492] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:10.206749 25232 tablet_bootstrap.cc:492] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:10.207386 25230 ts_tablet_manager.cc:1403] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.008s
I20260709 13:22:10.207485 25232 ts_tablet_manager.cc:1403] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.008s
I20260709 13:22:10.209692 25230 raft_consensus.cc:359] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.209959 25233 tablet_bootstrap.cc:654] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.210268 25230 raft_consensus.cc:385] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.210637 25230 raft_consensus.cc:740] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.210388 25232 raft_consensus.cc:359] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.211256 25232 raft_consensus.cc:385] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.211594 25232 raft_consensus.cc:740] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.211392 25230 consensus_queue.cc:260] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.213789 25230 ts_tablet_manager.cc:1434] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:22:10.212425 25232 consensus_queue.cc:260] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.214790 25230 tablet_bootstrap.cc:492] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:10.215380 25233 tablet_bootstrap.cc:492] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:10.216039 25233 ts_tablet_manager.cc:1403] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 13:22:10.219600 25233 raft_consensus.cc:359] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.220316 25233 raft_consensus.cc:385] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.220610 25233 raft_consensus.cc:740] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.221315 25233 consensus_queue.cc:260] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.222162 25230 tablet_bootstrap.cc:654] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.224517 25232 ts_tablet_manager.cc:1434] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 13:22:10.225381 25141 heartbeater.cc:499] Master 127.15.90.62:44919 was elected leader, sending a full tablet report...
I20260709 13:22:10.230747 25232 tablet_bootstrap.cc:492] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:10.235101 25230 tablet_bootstrap.cc:492] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:10.235703 25230 ts_tablet_manager.cc:1403] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 13:22:10.237810 25238 raft_consensus.cc:493] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.238368 25238 raft_consensus.cc:515] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.238644 25230 raft_consensus.cc:359] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.239360 25230 raft_consensus.cc:385] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.239701 25230 raft_consensus.cc:740] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.240456 25230 consensus_queue.cc:260] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.244168 25230 ts_tablet_manager.cc:1434] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:10.245467 25230 tablet_bootstrap.cc:492] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:10.245962 25238 leader_election.cc:290] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.248857 25232 tablet_bootstrap.cc:654] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.252777 25230 tablet_bootstrap.cc:654] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.255828 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
W20260709 13:22:10.257402 25079 leader_election.cc:343] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:10.267923 25215 heartbeater.cc:499] Master 127.15.90.62:44919 was elected leader, sending a full tablet report...
I20260709 13:22:10.269711 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:10.270547 25233 ts_tablet_manager.cc:1434] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.054s	user 0.020s	sys 0.004s
W20260709 13:22:10.272105 25082 leader_election.cc:343] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:10.272693 25082 leader_election.cc:304] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a523bed461d94e16b91e8c7bc3eb849b; no voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a
I20260709 13:22:10.273389 25233 tablet_bootstrap.cc:492] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:10.273520 25238 raft_consensus.cc:2749] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:10.274914 25230 tablet_bootstrap.cc:492] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:10.275375 25230 ts_tablet_manager.cc:1403] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.007s
I20260709 13:22:10.277603 25230 raft_consensus.cc:359] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.278146 25230 raft_consensus.cc:385] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.278401 25230 raft_consensus.cc:740] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.279240 25230 consensus_queue.cc:260] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.280496 25232 tablet_bootstrap.cc:492] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:10.280493 25233 tablet_bootstrap.cc:654] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.281337 25232 ts_tablet_manager.cc:1403] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.006s
I20260709 13:22:10.281802 25230 ts_tablet_manager.cc:1434] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:22:10.282850 25230 tablet_bootstrap.cc:492] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:10.284590 25232 raft_consensus.cc:359] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.285337 25232 raft_consensus.cc:385] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.285676 25232 raft_consensus.cc:740] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.286578 25232 consensus_queue.cc:260] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.289927 25230 tablet_bootstrap.cc:654] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.291249 25232 ts_tablet_manager.cc:1434] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:22:10.292342 25232 tablet_bootstrap.cc:492] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:10.301033 25232 tablet_bootstrap.cc:654] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.304448 25233 tablet_bootstrap.cc:492] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:10.305018 25233 ts_tablet_manager.cc:1403] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.032s	user 0.026s	sys 0.004s
I20260709 13:22:10.308157 25233 raft_consensus.cc:359] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.308847 25233 raft_consensus.cc:385] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.309130 25233 raft_consensus.cc:740] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.309952 25233 consensus_queue.cc:260] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.312021 25233 ts_tablet_manager.cc:1434] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:22:10.312950 25233 tablet_bootstrap.cc:492] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:10.319373 25233 tablet_bootstrap.cc:654] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.322923 25232 tablet_bootstrap.cc:492] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:10.323653 25232 ts_tablet_manager.cc:1403] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.013s
I20260709 13:22:10.327657 25232 raft_consensus.cc:359] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.328706 25232 raft_consensus.cc:385] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.329149 25232 raft_consensus.cc:740] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.330292 25232 consensus_queue.cc:260] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.331907 25233 tablet_bootstrap.cc:492] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:10.332341 25233 ts_tablet_manager.cc:1403] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:22:10.332671 25232 ts_tablet_manager.cc:1434] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:10.333714 25232 tablet_bootstrap.cc:492] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:10.334869 25230 tablet_bootstrap.cc:492] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:10.334751 25233 raft_consensus.cc:359] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.335575 25230 ts_tablet_manager.cc:1403] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.041s
I20260709 13:22:10.335623 25233 raft_consensus.cc:385] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.336114 25233 raft_consensus.cc:740] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.336999 25233 consensus_queue.cc:260] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.339128 25233 ts_tablet_manager.cc:1434] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:22:10.338937 25230 raft_consensus.cc:359] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.339903 25230 raft_consensus.cc:385] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.340289 25233 tablet_bootstrap.cc:492] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:10.340248 25230 raft_consensus.cc:740] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.340806 25232 tablet_bootstrap.cc:654] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.341461 25230 consensus_queue.cc:260] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.347046 25230 ts_tablet_manager.cc:1434] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:22:10.348470 25230 tablet_bootstrap.cc:492] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:10.348515 25233 tablet_bootstrap.cc:654] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.352540 25232 tablet_bootstrap.cc:492] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:10.353086 25232 ts_tablet_manager.cc:1403] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:22:10.356407 25230 tablet_bootstrap.cc:654] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.356051 25232 raft_consensus.cc:359] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.356906 25232 raft_consensus.cc:385] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.357185 25232 raft_consensus.cc:740] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.358002 25232 consensus_queue.cc:260] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.365402 25232 ts_tablet_manager.cc:1434] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:10.366761 25232 tablet_bootstrap.cc:492] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:10.370998 25234 raft_consensus.cc:493] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.371517 25234 raft_consensus.cc:515] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.373513 25233 tablet_bootstrap.cc:492] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:10.374105 25233 ts_tablet_manager.cc:1403] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.008s
I20260709 13:22:10.377382 25233 raft_consensus.cc:359] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.378085 25230 tablet_bootstrap.cc:492] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:10.378388 25232 tablet_bootstrap.cc:654] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.378681 25230 ts_tablet_manager.cc:1403] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.015s
I20260709 13:22:10.379489 25234 leader_election.cc:290] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.378165 25233 raft_consensus.cc:385] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.380874 25233 raft_consensus.cc:740] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.382071 25233 consensus_queue.cc:260] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.382107 25230 raft_consensus.cc:359] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.383392 25230 raft_consensus.cc:385] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.383832 25230 raft_consensus.cc:740] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.385133 25233 ts_tablet_manager.cc:1434] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:22:10.384794 25230 consensus_queue.cc:260] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.387205 25238 raft_consensus.cc:493] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.400920 25238 raft_consensus.cc:515] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.402367 25230 ts_tablet_manager.cc:1434] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 13:22:10.403190 25238 leader_election.cc:290] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.403537 25230 tablet_bootstrap.cc:492] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:10.404958 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec99940072a4483ab476881a82c1285" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:10.405223 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec99940072a4483ab476881a82c1285" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:10.405639 25041 raft_consensus.cc:2468] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 0.
I20260709 13:22:10.405915 25190 raft_consensus.cc:2468] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 0.
I20260709 13:22:10.406965 25079 leader_election.cc:304] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:10.408254 25238 raft_consensus.cc:2804] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:10.408630 25238 raft_consensus.cc:493] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:10.408980 25238 raft_consensus.cc:3060] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.409170 25233 tablet_bootstrap.cc:492] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:10.410797 25230 tablet_bootstrap.cc:654] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.412448 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5197a405cd410a9077aaf68df394dd" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
W20260709 13:22:10.414219 25007 leader_election.cc:343] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:10.414356 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5197a405cd410a9077aaf68df394dd" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
W20260709 13:22:10.416080 25004 leader_election.cc:343] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:10.416548 25004 leader_election.cc:304] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cfaba879caa48989267551827a9d729; no voters: 5763209744194094ba5ef8926ff0607a, a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:10.417785 25233 tablet_bootstrap.cc:654] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.417769 25234 raft_consensus.cc:2749] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:10.421509 25238 raft_consensus.cc:515] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.423942 25233 tablet_bootstrap.cc:492] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:10.424569 25233 ts_tablet_manager.cc:1403] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.009s
I20260709 13:22:10.424557 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec99940072a4483ab476881a82c1285" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:10.425046 25232 tablet_bootstrap.cc:492] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:10.425318 25041 raft_consensus.cc:3060] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.425747 25234 raft_consensus.cc:493] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.426255 25234 raft_consensus.cc:515] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.426649 25230 tablet_bootstrap.cc:492] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:10.427142 25230 ts_tablet_manager.cc:1403] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 13:22:10.428335 25233 raft_consensus.cc:359] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.429203 25233 raft_consensus.cc:385] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.429554 25233 raft_consensus.cc:740] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.430159 25230 raft_consensus.cc:359] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.430408 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb8c6a649c14286bc5db194a159cb12" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:10.430954 25230 raft_consensus.cc:385] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.430486 25233 consensus_queue.cc:260] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.431180 25116 raft_consensus.cc:2468] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:10.433374 25004 leader_election.cc:304] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:10.433969 25238 leader_election.cc:290] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.432006 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb8c6a649c14286bc5db194a159cb12" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:10.433372 25041 raft_consensus.cc:2468] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 1.
I20260709 13:22:10.434782 25190 raft_consensus.cc:2468] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:10.435180 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec99940072a4483ab476881a82c1285" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:10.433565 25233 ts_tablet_manager.cc:1434] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:10.435778 25079 leader_election.cc:304] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:10.428382 25234 leader_election.cc:290] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.436844 25233 tablet_bootstrap.cc:492] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:10.436769 25234 raft_consensus.cc:2804] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:10.437487 25234 raft_consensus.cc:493] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:10.437887 25234 raft_consensus.cc:3060] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.435829 25189 raft_consensus.cc:3060] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.441515 25232 ts_tablet_manager.cc:1403] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.016s
I20260709 13:22:10.444808 25233 tablet_bootstrap.cc:654] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.431289 25230 raft_consensus.cc:740] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.447604 25230 consensus_queue.cc:260] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.444720 25232 raft_consensus.cc:359] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.450593 25230 ts_tablet_manager.cc:1434] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:22:10.452020 25238 raft_consensus.cc:2804] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:10.454676 25230 tablet_bootstrap.cc:492] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:10.449410 25232 raft_consensus.cc:385] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.456638 25233 tablet_bootstrap.cc:492] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:10.455572 25189 raft_consensus.cc:2468] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 1.
I20260709 13:22:10.461791 25233 ts_tablet_manager.cc:1403] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.012s
I20260709 13:22:10.461264 25232 raft_consensus.cc:740] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.457863 25234 raft_consensus.cc:515] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.464594 25232 consensus_queue.cc:260] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
W20260709 13:22:10.466111 24987 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:10.465826 25233 raft_consensus.cc:359] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.458794 25256 raft_consensus.cc:493] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.466917 25233 raft_consensus.cc:385] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.467355 25233 raft_consensus.cc:740] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.467212 25256 raft_consensus.cc:515] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.467644 25232 ts_tablet_manager.cc:1434] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 13:22:10.468683 25230 tablet_bootstrap.cc:654] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.469022 25232 tablet_bootstrap.cc:492] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:10.468446 25233 consensus_queue.cc:260] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.459520 25238 raft_consensus.cc:697] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Becoming Leader. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:10.472421 25238 consensus_queue.cc:237] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.475476 25233 ts_tablet_manager.cc:1434] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:22:10.476457 25234 leader_election.cc:290] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.476663 25233 tablet_bootstrap.cc:492] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:10.478029 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb8c6a649c14286bc5db194a159cb12" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:10.478657 25116 raft_consensus.cc:3060] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.479398 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:10.484158 25233 tablet_bootstrap.cc:654] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:10.485177 25004 leader_election.cc:343] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:10.486465 25256 leader_election.cc:290] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.488070 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:10.488811 25190 raft_consensus.cc:2468] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:10.489791 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb8c6a649c14286bc5db194a159cb12" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:10.489992 25007 leader_election.cc:304] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:10.490432 25189 raft_consensus.cc:3060] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.492635 25230 tablet_bootstrap.cc:492] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:10.494200 24939 catalog_manager.cc:5697] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b reported cstate change: term changed from 0 to 1, leader changed from <none> to a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2). New cstate: current_term: 1 leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.493126 25230 ts_tablet_manager.cc:1403] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.002s
I20260709 13:22:10.496158 25233 tablet_bootstrap.cc:492] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:10.496697 25233 ts_tablet_manager.cc:1403] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 13:22:10.497660 25189 raft_consensus.cc:2468] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:10.497877 25256 raft_consensus.cc:2804] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:10.498404 25256 raft_consensus.cc:493] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:10.498112 25230 raft_consensus.cc:359] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.498807 25256 raft_consensus.cc:3060] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.498931 25230 raft_consensus.cc:385] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.498888 25007 leader_election.cc:304] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:10.499481 25230 raft_consensus.cc:740] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.500312 25233 raft_consensus.cc:359] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.500308 25230 consensus_queue.cc:260] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.501379 25233 raft_consensus.cc:385] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.501498 25116 raft_consensus.cc:2468] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:10.501775 25233 raft_consensus.cc:740] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.501832 25258 raft_consensus.cc:2804] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:10.508987 25230 ts_tablet_manager.cc:1434] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:22:10.510311 25230 tablet_bootstrap.cc:492] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:10.510731 25232 tablet_bootstrap.cc:654] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.507149 25233 consensus_queue.cc:260] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.516662 25258 raft_consensus.cc:697] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:10.519306 25258 consensus_queue.cc:237] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.520058 25230 tablet_bootstrap.cc:654] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.519853 25256 raft_consensus.cc:515] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.522725 25256 leader_election.cc:290] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.524739 25233 ts_tablet_manager.cc:1434] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 13:22:10.524626 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:10.524927 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:10.525527 25189 raft_consensus.cc:3060] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.525856 25233 tablet_bootstrap.cc:492] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
W20260709 13:22:10.526047 25004 leader_election.cc:343] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:10.526787 25256 raft_consensus.cc:493] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.527251 25256 raft_consensus.cc:515] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.529948 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcd88aad12d4581bd0777fe9248f56c" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
W20260709 13:22:10.531144 25004 leader_election.cc:343] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:10.532174 25233 tablet_bootstrap.cc:654] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.532713 25256 leader_election.cc:290] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.533365 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcd88aad12d4581bd0777fe9248f56c" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:10.534049 25190 raft_consensus.cc:2468] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:10.535094 25007 leader_election.cc:304] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:10.536173 25264 raft_consensus.cc:2804] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:10.536748 25264 raft_consensus.cc:493] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:10.536434 25189 raft_consensus.cc:2468] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:10.537711 25264 raft_consensus.cc:3060] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.538684 25007 leader_election.cc:304] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:10.540215 25256 raft_consensus.cc:2804] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:10.541500 25256 raft_consensus.cc:697] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:10.542606 25256 consensus_queue.cc:237] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.547309 25234 raft_consensus.cc:493] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.547851 25234 raft_consensus.cc:515] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.549714 25232 tablet_bootstrap.cc:492] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:10.549955 25234 leader_election.cc:290] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.550258 25232 ts_tablet_manager.cc:1403] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.000s
I20260709 13:22:10.552291 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27a94daca084c39904deaf22bf64bc7" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:10.553359 25232 raft_consensus.cc:359] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
W20260709 13:22:10.553725 25004 leader_election.cc:343] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:10.554297 25232 raft_consensus.cc:385] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.553157 24937 catalog_manager.cc:5697] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.554373 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27a94daca084c39904deaf22bf64bc7" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:10.554652 25232 raft_consensus.cc:740] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
W20260709 13:22:10.555642 25007 leader_election.cc:343] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:10.555528 25232 consensus_queue.cc:260] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.556123 25007 leader_election.cc:304] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cfaba879caa48989267551827a9d729; no voters: 5763209744194094ba5ef8926ff0607a, a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:10.557163 25234 raft_consensus.cc:2749] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:10.558265 25232 ts_tablet_manager.cc:1434] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:22:10.559378 25232 tablet_bootstrap.cc:492] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:10.562358 25264 raft_consensus.cc:515] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.567814 25264 leader_election.cc:290] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.568470 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcd88aad12d4581bd0777fe9248f56c" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:10.568838 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcd88aad12d4581bd0777fe9248f56c" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:10.569129 25116 raft_consensus.cc:3060] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.569464 25189 raft_consensus.cc:3060] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.573211 25239 raft_consensus.cc:493] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.573921 25239 raft_consensus.cc:515] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.576648 25189 raft_consensus.cc:2468] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:10.573170 25233 tablet_bootstrap.cc:492] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:10.578641 25233 ts_tablet_manager.cc:1403] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.004s
I20260709 13:22:10.581974 25238 raft_consensus.cc:493] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.582103 25239 leader_election.cc:290] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:10.582717 25238 raft_consensus.cc:515] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.584234 25116 raft_consensus.cc:2468] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:10.586666 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31cf153dd3645e69848b0148bcc7401" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:10.587299 25041 raft_consensus.cc:2468] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 0.
I20260709 13:22:10.587838 25232 tablet_bootstrap.cc:654] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.587102 25004 leader_election.cc:304] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:10.588665 25264 raft_consensus.cc:2804] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:10.588789 25079 leader_election.cc:304] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:10.589171 25264 raft_consensus.cc:697] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:10.589991 25259 raft_consensus.cc:2804] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:10.590453 25259 raft_consensus.cc:493] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:10.590036 25264 consensus_queue.cc:237] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.590759 25259 raft_consensus.cc:3060] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.587036 25230 tablet_bootstrap.cc:492] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:10.592092 25230 ts_tablet_manager.cc:1403] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.007s
I20260709 13:22:10.598922 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31cf153dd3645e69848b0148bcc7401" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:10.596874 25239 raft_consensus.cc:493] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.600351 25189 raft_consensus.cc:2468] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 0.
I20260709 13:22:10.608839 25230 raft_consensus.cc:359] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.609763 25230 raft_consensus.cc:385] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.600036 25238 leader_election.cc:290] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.610085 25230 raft_consensus.cc:740] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.613582 25230 consensus_queue.cc:260] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.616575 25230 ts_tablet_manager.cc:1434] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:22:10.616029 25239 raft_consensus.cc:515] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.626686 25239 leader_election.cc:290] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:10.627965 25239 raft_consensus.cc:493] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.629976 25239 raft_consensus.cc:515] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.627158 25233 raft_consensus.cc:359] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.635202 25233 raft_consensus.cc:385] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.635500 25233 raft_consensus.cc:740] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.636214 25233 consensus_queue.cc:260] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.638204 25233 ts_tablet_manager.cc:1434] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.000s
I20260709 13:22:10.639058 25233 tablet_bootstrap.cc:492] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:10.629127 25259 raft_consensus.cc:515] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.644893 25233 tablet_bootstrap.cc:654] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.648793 25040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:10.649026 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5197a405cd410a9077aaf68df394dd" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:10.649595 25040 raft_consensus.cc:2468] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:10.649657 25041 raft_consensus.cc:2468] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:10.650869 25039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31cf153dd3645e69848b0148bcc7401" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:10.651566 25039 raft_consensus.cc:2468] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:10.654148 25039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31cf153dd3645e69848b0148bcc7401" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:10.654675 25039 raft_consensus.cc:3060] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.656666 25153 leader_election.cc:304] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:10.659271 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31cf153dd3645e69848b0148bcc7401" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:10.665146 25189 raft_consensus.cc:3060] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.667098 25039 raft_consensus.cc:2468] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 1.
I20260709 13:22:10.659888 24937 catalog_manager.cc:5697] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.668295 25079 leader_election.cc:304] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:10.648702 25239 leader_election.cc:290] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:10.669109 25238 raft_consensus.cc:2804] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:10.657828 25259 leader_election.cc:290] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.662833 25232 tablet_bootstrap.cc:492] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:10.672638 25233 tablet_bootstrap.cc:492] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:10.671586 24937 catalog_manager.cc:5697] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.673089 25233 ts_tablet_manager.cc:1403] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.019s
I20260709 13:22:10.673031 25232 ts_tablet_manager.cc:1403] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.114s	user 0.030s	sys 0.018s
I20260709 13:22:10.675580 25239 raft_consensus.cc:2804] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:10.675940 25239 raft_consensus.cc:493] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:10.676301 25239 raft_consensus.cc:3060] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.676047 25233 raft_consensus.cc:359] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.676752 25233 raft_consensus.cc:385] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.676947 25238 raft_consensus.cc:697] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Becoming Leader. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:10.677026 25233 raft_consensus.cc:740] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.677970 25233 consensus_queue.cc:260] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.677997 25238 consensus_queue.cc:237] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.680369 25233 ts_tablet_manager.cc:1434] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:22:10.684203 25153 leader_election.cc:304] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:10.685397 25189 raft_consensus.cc:2468] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 1.
I20260709 13:22:10.686661 25274 raft_consensus.cc:2804] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:10.687052 25274 raft_consensus.cc:493] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:10.685675 25239 raft_consensus.cc:515] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.687397 25274 raft_consensus.cc:3060] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.689051 25239 leader_election.cc:290] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:10.692093 25232 raft_consensus.cc:359] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.693380 25232 raft_consensus.cc:385] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.693692 25232 raft_consensus.cc:740] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.693637 25274 raft_consensus.cc:515] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.692006 24937 catalog_manager.cc:5697] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b reported cstate change: term changed from 0 to 1, leader changed from <none> to a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2). New cstate: current_term: 1 leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.686697 25153 leader_election.cc:304] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:10.695188 25232 consensus_queue.cc:260] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.695742 25274 leader_election.cc:290] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:10.696267 25239 raft_consensus.cc:2764] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:22:10.696342 25039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:10.697086 25039 raft_consensus.cc:3060] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.697464 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5197a405cd410a9077aaf68df394dd" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:10.698040 25041 raft_consensus.cc:3060] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.698761 25232 ts_tablet_manager.cc:1434] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:22:10.699788 25232 tablet_bootstrap.cc:492] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:10.704125 25039 raft_consensus.cc:2468] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:10.705634 25041 raft_consensus.cc:2468] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:10.706327 25232 tablet_bootstrap.cc:654] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.708273 25115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:10.708966 25115 raft_consensus.cc:2468] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:10.709268 25116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5197a405cd410a9077aaf68df394dd" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:10.709988 25116 raft_consensus.cc:2468] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:10.707787 25153 leader_election.cc:304] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:10.711161 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31cf153dd3645e69848b0148bcc7401" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:10.711374 25153 leader_election.cc:304] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:10.712442 25239 raft_consensus.cc:2804] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:10.712646 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:10.713073 25274 raft_consensus.cc:2804] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:10.713362 25113 raft_consensus.cc:3060] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.717176 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5197a405cd410a9077aaf68df394dd" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:10.717811 25112 raft_consensus.cc:3060] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.718758 25239 raft_consensus.cc:697] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:10.719650 25274 raft_consensus.cc:697] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:10.721767 25232 tablet_bootstrap.cc:492] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:10.722265 25232 ts_tablet_manager.cc:1403] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 13:22:10.719910 25239 consensus_queue.cc:237] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.724968 25232 raft_consensus.cc:359] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.725625 25232 raft_consensus.cc:385] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.725951 25232 raft_consensus.cc:740] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.725793 25274 consensus_queue.cc:237] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.726866 25112 raft_consensus.cc:2468] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:10.725646 25113 raft_consensus.cc:2468] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:10.726997 25232 consensus_queue.cc:260] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.730036 25232 ts_tablet_manager.cc:1434] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:22:10.731256 25232 tablet_bootstrap.cc:492] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:10.737111 25232 tablet_bootstrap.cc:654] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:10.736809 24936 catalog_manager.cc:5697] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 1 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:10.738860 24936 catalog_manager.cc:5697] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 1 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:10.741843 25232 tablet_bootstrap.cc:492] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:10.742293 25232 ts_tablet_manager.cc:1403] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:22:10.744195 25232 raft_consensus.cc:359] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.744644 25232 raft_consensus.cc:385] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:10.744858 25232 raft_consensus.cc:740] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:10.745493 25232 consensus_queue.cc:260] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.748452 25232 ts_tablet_manager.cc:1434] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:22:10.851356 25238 raft_consensus.cc:493] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.852039 25238 raft_consensus.cc:515] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.853857 25238 leader_election.cc:290] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.854619 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4a4522a24a41409d25f48aff64a620" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:10.854866 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4a4522a24a41409d25f48aff64a620" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:10.855190 25041 raft_consensus.cc:2468] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 0.
I20260709 13:22:10.855557 25189 raft_consensus.cc:2468] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 0.
I20260709 13:22:10.856215 25079 leader_election.cc:304] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:10.856976 25238 raft_consensus.cc:2804] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:10.857391 25238 raft_consensus.cc:493] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:10.857687 25238 raft_consensus.cc:3060] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.862435 25238 raft_consensus.cc:515] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.864034 25238 leader_election.cc:290] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.864689 25238 raft_consensus.cc:493] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:10.864825 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4a4522a24a41409d25f48aff64a620" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:10.865288 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4a4522a24a41409d25f48aff64a620" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:10.865142 25238 raft_consensus.cc:515] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.865588 25041 raft_consensus.cc:3060] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.865906 25189 raft_consensus.cc:3060] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.868062 25039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27a94daca084c39904deaf22bf64bc7" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:10.868728 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27a94daca084c39904deaf22bf64bc7" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:10.868854 25039 raft_consensus.cc:2468] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 0.
I20260709 13:22:10.869366 25190 raft_consensus.cc:2468] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 0.
I20260709 13:22:10.868116 25238 leader_election.cc:290] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.870196 25079 leader_election.cc:304] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:10.871063 25238 raft_consensus.cc:2804] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:10.871462 25238 raft_consensus.cc:493] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:10.871966 25238 raft_consensus.cc:3060] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.873628 25041 raft_consensus.cc:2468] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 1.
I20260709 13:22:10.874814 25079 leader_election.cc:304] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:10.875589 25189 raft_consensus.cc:2468] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 1.
I20260709 13:22:10.875824 25277 raft_consensus.cc:2804] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:10.876420 25277 raft_consensus.cc:697] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Becoming Leader. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:10.877302 25277 consensus_queue.cc:237] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.878165 25238 raft_consensus.cc:515] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.880218 25238 leader_election.cc:290] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:10.881192 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27a94daca084c39904deaf22bf64bc7" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:10.881326 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27a94daca084c39904deaf22bf64bc7" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:10.881883 25041 raft_consensus.cc:3060] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.882145 25189 raft_consensus.cc:3060] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:10.886372 24939 catalog_manager.cc:5697] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b reported cstate change: term changed from 0 to 1, leader changed from <none> to a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2). New cstate: current_term: 1 leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.887926 25189 raft_consensus.cc:2468] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 1.
I20260709 13:22:10.888893 25041 raft_consensus.cc:2468] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 1.
I20260709 13:22:10.889011 25082 leader_election.cc:304] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5763209744194094ba5ef8926ff0607a, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:10.889973 25277 raft_consensus.cc:2804] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:10.890487 25277 raft_consensus.cc:697] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Becoming Leader. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:10.891175 25277 consensus_queue.cc:237] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:10.900061 24939 catalog_manager.cc:5697] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b reported cstate change: term changed from 0 to 1, leader changed from <none> to a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2). New cstate: current_term: 1 leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:10.931463 25264 consensus_queue.cc:1048] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:10.937529 25112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31cf153dd3645e69848b0148bcc7401"
dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
mode: GRACEFUL
new_leader_uuid: "0cfaba879caa48989267551827a9d729"
 from {username='slave'} at 127.0.0.1:36978
I20260709 13:22:10.938119 25112 raft_consensus.cc:606] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Received request to transfer leadership to TS 0cfaba879caa48989267551827a9d729
I20260709 13:22:10.945528 25113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27a94daca084c39904deaf22bf64bc7"
dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
mode: GRACEFUL
new_leader_uuid: "0cfaba879caa48989267551827a9d729"
 from {username='slave'} at 127.0.0.1:36978
I20260709 13:22:10.946108 25113 raft_consensus.cc:606] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Received request to transfer leadership to TS 0cfaba879caa48989267551827a9d729
I20260709 13:22:10.950966 25256 consensus_queue.cc:1048] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:10.964368 25189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
mode: GRACEFUL
new_leader_uuid: "0cfaba879caa48989267551827a9d729"
 from {username='slave'} at 127.0.0.1:33470
I20260709 13:22:10.964996 25189 raft_consensus.cc:606] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Received request to transfer leadership to TS 0cfaba879caa48989267551827a9d729
I20260709 13:22:10.972612 25277 consensus_queue.cc:1048] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:10.985785 25238 consensus_queue.cc:1048] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:10.986841 25041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfcd88aad12d4581bd0777fe9248f56c"
dest_uuid: "0cfaba879caa48989267551827a9d729"
mode: GRACEFUL
new_leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:34150
I20260709 13:22:10.987483 25041 raft_consensus.cc:606] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Received request to transfer leadership to TS a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:10.996050 25039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60"
dest_uuid: "0cfaba879caa48989267551827a9d729"
mode: GRACEFUL
new_leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:34150
I20260709 13:22:10.996626 25039 raft_consensus.cc:606] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Received request to transfer leadership to TS a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:11.002408 25189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f5197a405cd410a9077aaf68df394dd"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
mode: GRACEFUL
new_leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:33470
I20260709 13:22:11.003010 25189 raft_consensus.cc:606] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Received request to transfer leadership to TS a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:11.007504 25113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c4a4522a24a41409d25f48aff64a620"
dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
mode: GRACEFUL
new_leader_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:36978
I20260709 13:22:11.007988 25113 raft_consensus.cc:606] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Received request to transfer leadership to TS 5763209744194094ba5ef8926ff0607a
I20260709 13:22:11.033259 25113 raft_consensus.cc:3060] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:11.039132 25256 consensus_queue.cc:1048] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:11.045063 25258 raft_consensus.cc:993] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729: : Instructing follower a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:11.045607 25264 raft_consensus.cc:1081] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Signalling peer a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:11.050261 25113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60"
dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:36958
I20260709 13:22:11.050879 25113 raft_consensus.cc:493] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:11.051227 25264 consensus_queue.cc:1048] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:11.051301 25113 raft_consensus.cc:3060] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.059649 25256 consensus_queue.cc:1048] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:11.060228 25113 raft_consensus.cc:515] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.063066 25113 leader_election.cc:290] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:11.063783 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:11.064529 25189 raft_consensus.cc:3060] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.064831 25039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:11.065485 25039 raft_consensus.cc:3055] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:11.065848 25039 raft_consensus.cc:740] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:11.066699 25039 consensus_queue.cc:260] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.068140 25039 raft_consensus.cc:3060] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.072923 25189 raft_consensus.cc:2468] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:11.074038 25082 leader_election.cc:304] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5763209744194094ba5ef8926ff0607a, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:11.075009 25238 raft_consensus.cc:2804] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:11.075608 25238 raft_consensus.cc:697] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Becoming Leader. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:11.076537 25238 consensus_queue.cc:237] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.078648 25039 raft_consensus.cc:2468] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:11.081327 25256 consensus_queue.cc:1048] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:11.089879 25258 raft_consensus.cc:993] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729: : Instructing follower a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:11.089270 24939 catalog_manager.cc:5697] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b reported cstate change: term changed from 1 to 2, leader changed from 0cfaba879caa48989267551827a9d729 (127.15.90.1) to a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2). New cstate: current_term: 2 leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:11.090407 25299 raft_consensus.cc:1081] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Signalling peer a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:11.092042 25113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfcd88aad12d4581bd0777fe9248f56c"
dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:36958
I20260709 13:22:11.092586 25113 raft_consensus.cc:493] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:11.092948 25113 raft_consensus.cc:3060] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.101068 25113 raft_consensus.cc:515] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.102857 25113 leader_election.cc:290] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:11.103408 25039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcd88aad12d4581bd0777fe9248f56c" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:11.104039 25039 raft_consensus.cc:3055] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:11.104398 25039 raft_consensus.cc:740] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:11.104683 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfcd88aad12d4581bd0777fe9248f56c" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:11.105265 25190 raft_consensus.cc:3060] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.105064 25039 consensus_queue.cc:260] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.106182 25039 raft_consensus.cc:3060] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.110725 25039 raft_consensus.cc:2468] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:11.110920 25190 raft_consensus.cc:2468] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:11.111667 25079 leader_election.cc:304] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:11.112489 25238 raft_consensus.cc:2804] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:11.112908 25238 raft_consensus.cc:697] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Becoming Leader. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:11.113644 25238 consensus_queue.cc:237] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.119151 24939 catalog_manager.cc:5697] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b reported cstate change: term changed from 1 to 2, leader changed from 0cfaba879caa48989267551827a9d729 (127.15.90.1) to a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2). New cstate: current_term: 2 leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:11.189477 25238 consensus_queue.cc:1048] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:11.189610 25239 consensus_queue.cc:1048] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:11.192107 25239 consensus_queue.cc:1048] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:11.211143 25259 consensus_queue.cc:1048] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:11.220284 25238 raft_consensus.cc:993] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b: : Instructing follower 0cfaba879caa48989267551827a9d729 to start an election
I20260709 13:22:11.220741 25238 raft_consensus.cc:1081] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Signalling peer 0cfaba879caa48989267551827a9d729 to start an election
I20260709 13:22:11.222390 25041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f31cf153dd3645e69848b0148bcc7401"
dest_uuid: "0cfaba879caa48989267551827a9d729"
 from {username='slave'} at 127.0.0.1:34144
I20260709 13:22:11.222273 25280 consensus_queue.cc:1048] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:11.223062 25041 raft_consensus.cc:493] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:11.223466 25041 raft_consensus.cc:3060] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.223800 25280 consensus_queue.cc:1048] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:11.232942 25041 raft_consensus.cc:515] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.237596 25112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31cf153dd3645e69848b0148bcc7401" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:11.238349 25112 raft_consensus.cc:3055] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:11.238569 25304 raft_consensus.cc:993] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a: : Instructing follower 0cfaba879caa48989267551827a9d729 to start an election
I20260709 13:22:11.238806 25112 raft_consensus.cc:740] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:11.239135 25304 raft_consensus.cc:1081] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Signalling peer 0cfaba879caa48989267551827a9d729 to start an election
I20260709 13:22:11.239984 25112 consensus_queue.cc:260] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.241083 25040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e"
dest_uuid: "0cfaba879caa48989267551827a9d729"
 from {username='slave'} at 127.0.0.1:34148
I20260709 13:22:11.241770 25040 raft_consensus.cc:493] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:11.242269 25040 raft_consensus.cc:3060] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.248270 25112 raft_consensus.cc:3060] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.251009 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31cf153dd3645e69848b0148bcc7401" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:11.251636 25190 raft_consensus.cc:3060] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.253042 25040 raft_consensus.cc:515] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.255646 25040 leader_election.cc:290] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 2 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:11.256407 25112 raft_consensus.cc:2468] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 2.
I20260709 13:22:11.257311 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:11.257897 25114 raft_consensus.cc:3060] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.259909 25004 leader_election.cc:304] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:11.260835 25299 raft_consensus.cc:2804] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:11.261319 25299 raft_consensus.cc:697] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:11.262149 25299 consensus_queue.cc:237] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.264724 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:11.265358 25189 raft_consensus.cc:3055] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:11.265676 25189 raft_consensus.cc:740] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:11.266340 25189 consensus_queue.cc:260] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.267266 25189 raft_consensus.cc:3060] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.269867 24937 catalog_manager.cc:5697] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 1 to 2, leader changed from a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2) to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:11.271786 25190 raft_consensus.cc:2468] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 2.
I20260709 13:22:11.273103 25274 raft_consensus.cc:993] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a: : Instructing follower a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:11.273572 25114 raft_consensus.cc:2468] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 2.
I20260709 13:22:11.274191 25041 leader_election.cc:290] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 2 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:11.274426 25274 raft_consensus.cc:1081] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Signalling peer a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:11.275151 25004 leader_election.cc:304] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:11.276300 25258 raft_consensus.cc:2804] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:11.276551 25114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f5197a405cd410a9077aaf68df394dd"
dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:36970
I20260709 13:22:11.276755 25258 raft_consensus.cc:697] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:11.277132 25114 raft_consensus.cc:493] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:11.277522 25114 raft_consensus.cc:3060] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.277675 25258 consensus_queue.cc:237] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.278364 25189 raft_consensus.cc:2468] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 2.
I20260709 13:22:11.284271 25114 raft_consensus.cc:515] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.284806 24937 catalog_manager.cc:5697] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 1 to 2, leader changed from 5763209744194094ba5ef8926ff0607a (127.15.90.3) to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:11.286842 25114 leader_election.cc:290] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:11.287451 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5197a405cd410a9077aaf68df394dd" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:11.288136 25041 raft_consensus.cc:3060] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.287364 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f5197a405cd410a9077aaf68df394dd" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:11.288888 25189 raft_consensus.cc:3055] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:11.289180 25189 raft_consensus.cc:740] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:11.289902 25189 consensus_queue.cc:260] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.291139 25189 raft_consensus.cc:3060] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.294358 25041 raft_consensus.cc:2468] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:11.295578 25079 leader_election.cc:304] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:11.296308 25259 raft_consensus.cc:2804] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:11.296782 25259 raft_consensus.cc:697] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Becoming Leader. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:11.297293 25189 raft_consensus.cc:2468] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:11.297637 25259 consensus_queue.cc:237] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.303785 24937 catalog_manager.cc:5697] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b reported cstate change: term changed from 1 to 2, leader changed from 5763209744194094ba5ef8926ff0607a (127.15.90.3) to a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2). New cstate: current_term: 2 leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:11.360301 25259 consensus_queue.cc:1048] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:11.366842 25238 raft_consensus.cc:993] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b: : Instructing follower 0cfaba879caa48989267551827a9d729 to start an election
I20260709 13:22:11.367327 25277 raft_consensus.cc:1081] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Signalling peer 0cfaba879caa48989267551827a9d729 to start an election
I20260709 13:22:11.371969 25040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e27a94daca084c39904deaf22bf64bc7"
dest_uuid: "0cfaba879caa48989267551827a9d729"
 from {username='slave'} at 127.0.0.1:34144
I20260709 13:22:11.372748 25040 raft_consensus.cc:493] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:11.372185 25259 consensus_queue.cc:1048] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:22:11.373126 25040 raft_consensus.cc:3060] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.383005 25040 raft_consensus.cc:515] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.383949 25041 raft_consensus.cc:1240] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Rejecting Update request from peer a523bed461d94e16b91e8c7bc3eb849b for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:11.385753 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27a94daca084c39904deaf22bf64bc7" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:11.385857 25040 leader_election.cc:290] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 2 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:11.386014 25259 consensus_queue.cc:1059] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:11.386951 25189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27a94daca084c39904deaf22bf64bc7" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:11.387609 25189 raft_consensus.cc:3060] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.386979 25114 raft_consensus.cc:3055] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:11.388254 25114 raft_consensus.cc:740] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:11.389106 25114 consensus_queue.cc:260] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.390259 25114 raft_consensus.cc:3060] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.393191 25189 raft_consensus.cc:2468] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 2.
I20260709 13:22:11.394372 25007 leader_election.cc:304] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:11.395188 25299 raft_consensus.cc:2804] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:11.395493 25114 raft_consensus.cc:2468] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 2.
I20260709 13:22:11.395710 25299 raft_consensus.cc:697] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
W20260709 13:22:11.396037 25277 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:22:11.396629 25299 consensus_queue.cc:237] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.402992 24939 catalog_manager.cc:5697] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 1 to 2, leader changed from a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2) to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:11.424342 25277 consensus_queue.cc:1048] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:11.430797 25259 raft_consensus.cc:993] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b: : Instructing follower 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:11.431277 25238 raft_consensus.cc:1081] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Signalling peer 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:11.432996 25190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c4a4522a24a41409d25f48aff64a620"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:33442
I20260709 13:22:11.433612 25190 raft_consensus.cc:493] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:11.433992 25190 raft_consensus.cc:3060] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.437098 25277 consensus_queue.cc:1048] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:11.442207 25190 raft_consensus.cc:515] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.445681 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4a4522a24a41409d25f48aff64a620" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:11.447115 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4a4522a24a41409d25f48aff64a620" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:11.450453 25114 raft_consensus.cc:3055] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:11.450778 25114 raft_consensus.cc:740] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:11.451792 25190 leader_election.cc:290] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 2 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:11.451617 25114 consensus_queue.cc:260] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.452807 25114 raft_consensus.cc:3060] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.458629 25114 raft_consensus.cc:2468] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 2.
I20260709 13:22:11.459798 25153 leader_election.cc:304] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5763209744194094ba5ef8926ff0607a, a523bed461d94e16b91e8c7bc3eb849b; no voters: 0cfaba879caa48989267551827a9d729
I20260709 13:22:11.460613 25280 raft_consensus.cc:2804] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:11.461151 25280 raft_consensus.cc:697] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 2 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:11.462112 25280 consensus_queue.cc:237] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:11.469381 24937 catalog_manager.cc:5697] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 1 to 2, leader changed from a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2) to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 2 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:11.511605 25190 raft_consensus.cc:1275] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.512995 25277 consensus_queue.cc:1048] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.516644 25041 raft_consensus.cc:1275] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.518622 25259 consensus_queue.cc:1048] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.677141 25041 raft_consensus.cc:1275] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.678229 25238 consensus_queue.cc:1048] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.685649 25190 raft_consensus.cc:1275] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.687434 25238 consensus_queue.cc:1048] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.718698 25041 raft_consensus.cc:1275] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.719910 25238 consensus_queue.cc:1048] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.724357 25190 raft_consensus.cc:1275] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.725865 25313 consensus_queue.cc:1048] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.728866 25114 raft_consensus.cc:1275] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Refusing update from remote peer 0cfaba879caa48989267551827a9d729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.730623 25299 consensus_queue.cc:1048] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.739859 25189 raft_consensus.cc:1275] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Refusing update from remote peer 0cfaba879caa48989267551827a9d729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.741298 25299 consensus_queue.cc:1048] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.809230 25114 raft_consensus.cc:1275] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Refusing update from remote peer 0cfaba879caa48989267551827a9d729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.810460 25299 consensus_queue.cc:1048] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.818274 25113 raft_consensus.cc:1275] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Refusing update from remote peer 0cfaba879caa48989267551827a9d729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.818274 25189 raft_consensus.cc:1275] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Refusing update from remote peer 0cfaba879caa48989267551827a9d729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.820180 25299 consensus_queue.cc:1048] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.820353 25314 consensus_queue.cc:1048] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.829000 25190 raft_consensus.cc:1275] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Refusing update from remote peer 0cfaba879caa48989267551827a9d729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.831095 25258 consensus_queue.cc:1048] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:11.927723 25113 raft_consensus.cc:1275] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.928948 25280 consensus_queue.cc:1048] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:11.936235 25041 raft_consensus.cc:3060] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:11.944161 25041 raft_consensus.cc:1275] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:11.945469 25280 consensus_queue.cc:1048] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:14.030491 24936 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33204:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:14.032883 24936 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:14.081844 25031 tablet_service.cc:1511] Processing CreateTablet for tablet 92105f5a7ca64ef687c84af4b6472a7b (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:14.083031 25031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92105f5a7ca64ef687c84af4b6472a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.082849 25105 tablet_service.cc:1511] Processing CreateTablet for tablet 92105f5a7ca64ef687c84af4b6472a7b (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:14.084125 25105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92105f5a7ca64ef687c84af4b6472a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.084007 25174 tablet_service.cc:1511] Processing CreateTablet for tablet 92105f5a7ca64ef687c84af4b6472a7b (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:14.085235 25174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92105f5a7ca64ef687c84af4b6472a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.085511 25026 tablet_service.cc:1511] Processing CreateTablet for tablet e9512d333df0479f8a54b7ca5b21be2a (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:14.086695 25026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9512d333df0479f8a54b7ca5b21be2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.101744 25098 tablet_service.cc:1511] Processing CreateTablet for tablet e9512d333df0479f8a54b7ca5b21be2a (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:14.103513 25098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9512d333df0479f8a54b7ca5b21be2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.106143 25331 tablet_bootstrap.cc:492] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:14.109926 25179 tablet_service.cc:1511] Processing CreateTablet for tablet e9512d333df0479f8a54b7ca5b21be2a (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:14.111217 25179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9512d333df0479f8a54b7ca5b21be2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.112030 25030 tablet_service.cc:1511] Processing CreateTablet for tablet 26c407aadc8b47d986d126915392b5d8 (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:14.113309 25030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c407aadc8b47d986d126915392b5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.116652 25100 tablet_service.cc:1511] Processing CreateTablet for tablet 26c407aadc8b47d986d126915392b5d8 (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:14.118162 25100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c407aadc8b47d986d126915392b5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.122624 25180 tablet_service.cc:1511] Processing CreateTablet for tablet 26c407aadc8b47d986d126915392b5d8 (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:14.124241 25180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26c407aadc8b47d986d126915392b5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.124437 25025 tablet_service.cc:1511] Processing CreateTablet for tablet af63cabab3cc4736a1cd259a3b402f1e (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:14.125658 25025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af63cabab3cc4736a1cd259a3b402f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.126735 25105 tablet_service.cc:1511] Processing CreateTablet for tablet af63cabab3cc4736a1cd259a3b402f1e (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:14.127967 25105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af63cabab3cc4736a1cd259a3b402f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.131033 25177 tablet_service.cc:1511] Processing CreateTablet for tablet af63cabab3cc4736a1cd259a3b402f1e (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:14.132241 25177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af63cabab3cc4736a1cd259a3b402f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.132946 25027 tablet_service.cc:1511] Processing CreateTablet for tablet fee98cf387494e67a0c98ecdbf29fadc (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:14.134138 25027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee98cf387494e67a0c98ecdbf29fadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.138743 25101 tablet_service.cc:1511] Processing CreateTablet for tablet fee98cf387494e67a0c98ecdbf29fadc (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:14.140027 25101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee98cf387494e67a0c98ecdbf29fadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.144865 25178 tablet_service.cc:1511] Processing CreateTablet for tablet fee98cf387494e67a0c98ecdbf29fadc (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:14.146114 25178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee98cf387494e67a0c98ecdbf29fadc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.147533 25026 tablet_service.cc:1511] Processing CreateTablet for tablet 7f50b6733af5410b9d4681f1cb3c862d (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:14.148847 25026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f50b6733af5410b9d4681f1cb3c862d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.139117 25331 tablet_bootstrap.cc:654] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.164971 25104 tablet_service.cc:1511] Processing CreateTablet for tablet 7f50b6733af5410b9d4681f1cb3c862d (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:14.166736 25104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f50b6733af5410b9d4681f1cb3c862d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.167426 25332 tablet_bootstrap.cc:492] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:14.190054 25174 tablet_service.cc:1511] Processing CreateTablet for tablet 7f50b6733af5410b9d4681f1cb3c862d (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:14.191460 25174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f50b6733af5410b9d4681f1cb3c862d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.210107 25333 tablet_bootstrap.cc:492] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:14.211344 25027 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7062b131354662b5ba735ab96bfac3 (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:14.214715 25027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7062b131354662b5ba735ab96bfac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.213354 25101 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7062b131354662b5ba735ab96bfac3 (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:14.220456 25101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7062b131354662b5ba735ab96bfac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.225603 25030 tablet_service.cc:1511] Processing CreateTablet for tablet f1a63513da2e465499fd703ac7f6b6de (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:14.227155 25030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a63513da2e465499fd703ac7f6b6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.226966 25179 tablet_service.cc:1511] Processing CreateTablet for tablet f1a63513da2e465499fd703ac7f6b6de (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:14.228222 25179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a63513da2e465499fd703ac7f6b6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.228277 25332 tablet_bootstrap.cc:654] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.235755 25333 tablet_bootstrap.cc:654] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.237216 25105 tablet_service.cc:1511] Processing CreateTablet for tablet f1a63513da2e465499fd703ac7f6b6de (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:14.247390 25031 tablet_service.cc:1511] Processing CreateTablet for tablet 3a10c8e90a8b4efaa3f5b75a70e4f0dc (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:14.249080 25031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a10c8e90a8b4efaa3f5b75a70e4f0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.251026 25105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a63513da2e465499fd703ac7f6b6de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.251314 25177 tablet_service.cc:1511] Processing CreateTablet for tablet 3a10c8e90a8b4efaa3f5b75a70e4f0dc (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:14.252583 25177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a10c8e90a8b4efaa3f5b75a70e4f0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.252954 25100 tablet_service.cc:1511] Processing CreateTablet for tablet 3a10c8e90a8b4efaa3f5b75a70e4f0dc (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:14.255345 25100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a10c8e90a8b4efaa3f5b75a70e4f0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.256847 25180 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7062b131354662b5ba735ab96bfac3 (DEFAULT_TABLE table=soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:14.265061 25180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7062b131354662b5ba735ab96bfac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:14.265537 25331 tablet_bootstrap.cc:492] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:14.266057 25331 ts_tablet_manager.cc:1403] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.160s	user 0.024s	sys 0.037s
I20260709 13:22:14.269207 25331 raft_consensus.cc:359] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.270190 25331 raft_consensus.cc:385] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.270527 25331 raft_consensus.cc:740] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.271319 25331 consensus_queue.cc:260] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.276518 25331 ts_tablet_manager.cc:1434] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:22:14.278235 25331 tablet_bootstrap.cc:492] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:14.282271 25332 tablet_bootstrap.cc:492] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:14.282821 25332 ts_tablet_manager.cc:1403] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.006s
I20260709 13:22:14.285722 25332 raft_consensus.cc:359] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.286392 25332 raft_consensus.cc:385] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.286672 25332 raft_consensus.cc:740] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.287328 25332 consensus_queue.cc:260] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.300607 25332 ts_tablet_manager.cc:1434] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:22:14.301679 25332 tablet_bootstrap.cc:492] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:14.305243 25333 tablet_bootstrap.cc:492] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:14.305827 25333 ts_tablet_manager.cc:1403] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.096s	user 0.026s	sys 0.018s
I20260709 13:22:14.308212 25332 tablet_bootstrap.cc:654] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.308178 25333 raft_consensus.cc:359] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.308848 25333 raft_consensus.cc:385] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.309049 25331 tablet_bootstrap.cc:654] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.309098 25333 raft_consensus.cc:740] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.310046 25333 consensus_queue.cc:260] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.312254 25333 ts_tablet_manager.cc:1434] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:22:14.313227 25333 tablet_bootstrap.cc:492] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:14.319585 25333 tablet_bootstrap.cc:654] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.327085 25331 tablet_bootstrap.cc:492] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:14.327633 25331 ts_tablet_manager.cc:1403] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.005s
I20260709 13:22:14.327901 25333 tablet_bootstrap.cc:492] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:14.328629 25333 ts_tablet_manager.cc:1403] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:22:14.330550 25331 raft_consensus.cc:359] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.331300 25331 raft_consensus.cc:385] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.331636 25331 raft_consensus.cc:740] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.332449 25331 consensus_queue.cc:260] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.332592 25333 raft_consensus.cc:359] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.333628 25333 raft_consensus.cc:385] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.334038 25333 raft_consensus.cc:740] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.334900 25333 consensus_queue.cc:260] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.337633 25333 ts_tablet_manager.cc:1434] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:22:14.338861 25333 tablet_bootstrap.cc:492] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:14.344102 25332 tablet_bootstrap.cc:492] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:14.344470 25331 ts_tablet_manager.cc:1434] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:22:14.344674 25332 ts_tablet_manager.cc:1403] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.022s
I20260709 13:22:14.345556 25331 tablet_bootstrap.cc:492] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:14.345693 25333 tablet_bootstrap.cc:654] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.347975 25332 raft_consensus.cc:359] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.348786 25332 raft_consensus.cc:385] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.349246 25332 raft_consensus.cc:740] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.350420 25332 consensus_queue.cc:260] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.353009 25331 tablet_bootstrap.cc:654] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.353714 25332 ts_tablet_manager.cc:1434] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:22:14.355089 25332 tablet_bootstrap.cc:492] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:14.356007 25319 raft_consensus.cc:493] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:14.356470 25319 raft_consensus.cc:515] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.358264 25333 tablet_bootstrap.cc:492] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:14.358621 25319 leader_election.cc:290] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:14.358755 25333 ts_tablet_manager.cc:1403] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:22:14.361208 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92105f5a7ca64ef687c84af4b6472a7b" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:14.361874 25041 raft_consensus.cc:2468] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:14.362020 25333 raft_consensus.cc:359] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.362685 25332 tablet_bootstrap.cc:654] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.362790 25333 raft_consensus.cc:385] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.362993 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92105f5a7ca64ef687c84af4b6472a7b" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:14.363260 25333 raft_consensus.cc:740] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.363703 25113 raft_consensus.cc:2468] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:14.364038 25333 consensus_queue.cc:260] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.365504 25153 leader_election.cc:304] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:14.366564 25333 ts_tablet_manager.cc:1434] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:14.367274 25319 raft_consensus.cc:2804] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:14.367743 25333 tablet_bootstrap.cc:492] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:14.367972 25319 raft_consensus.cc:493] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:14.368582 25319 raft_consensus.cc:3060] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.374228 25333 tablet_bootstrap.cc:654] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.380107 25319 raft_consensus.cc:515] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.393193 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92105f5a7ca64ef687c84af4b6472a7b" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:14.394016 25041 raft_consensus.cc:3060] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.405642 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92105f5a7ca64ef687c84af4b6472a7b" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:14.406548 25113 raft_consensus.cc:3060] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.415804 25319 leader_election.cc:290] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:14.419921 25041 raft_consensus.cc:2468] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:14.420468 25113 raft_consensus.cc:2468] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:14.421267 25331 tablet_bootstrap.cc:492] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:14.421483 25153 leader_election.cc:304] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:14.421804 25331 ts_tablet_manager.cc:1403] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.076s	user 0.005s	sys 0.005s
I20260709 13:22:14.422034 25332 tablet_bootstrap.cc:492] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:14.422392 25319 raft_consensus.cc:2804] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:14.422616 25332 ts_tablet_manager.cc:1403] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.068s	user 0.032s	sys 0.032s
I20260709 13:22:14.425915 25331 raft_consensus.cc:359] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.426162 25332 raft_consensus.cc:359] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.427037 25331 raft_consensus.cc:385] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.427798 25331 raft_consensus.cc:740] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.427963 25314 raft_consensus.cc:493] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:14.428548 25314 raft_consensus.cc:515] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.428786 25331 consensus_queue.cc:260] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.429932 25333 tablet_bootstrap.cc:492] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:14.430435 25314 leader_election.cc:290] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:14.431133 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9512d333df0479f8a54b7ca5b21be2a" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:14.432523 25113 raft_consensus.cc:2468] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:14.433105 25331 ts_tablet_manager.cc:1434] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:22:14.433604 25004 leader_election.cc:304] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:14.434108 25331 tablet_bootstrap.cc:492] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:14.434695 25314 raft_consensus.cc:2804] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:14.435060 25314 raft_consensus.cc:493] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:14.435355 25314 raft_consensus.cc:3060] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.440867 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9512d333df0479f8a54b7ca5b21be2a" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:14.441177 25331 tablet_bootstrap.cc:654] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.441551 25190 raft_consensus.cc:2468] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:14.427237 25332 raft_consensus.cc:385] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.443804 25332 raft_consensus.cc:740] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.444805 25332 consensus_queue.cc:260] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.447077 25332 ts_tablet_manager.cc:1434] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.005s
I20260709 13:22:14.448144 25332 tablet_bootstrap.cc:492] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:14.448814 25333 ts_tablet_manager.cc:1403] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.081s	user 0.031s	sys 0.022s
I20260709 13:22:14.452085 25333 raft_consensus.cc:359] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.452380 25314 raft_consensus.cc:515] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.453397 25319 raft_consensus.cc:697] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:14.454475 25332 tablet_bootstrap.cc:654] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.454403 25319 consensus_queue.cc:237] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.455202 25314 leader_election.cc:290] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:14.453079 25333 raft_consensus.cc:385] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.456635 25333 raft_consensus.cc:740] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.456351 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9512d333df0479f8a54b7ca5b21be2a" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:14.457531 25113 raft_consensus.cc:3060] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.457881 25333 consensus_queue.cc:260] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.458789 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9512d333df0479f8a54b7ca5b21be2a" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:14.459352 25190 raft_consensus.cc:3060] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.462715 25333 ts_tablet_manager.cc:1434] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 13:22:14.463907 25333 tablet_bootstrap.cc:492] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:14.470220 25331 tablet_bootstrap.cc:492] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:14.470762 25333 tablet_bootstrap.cc:654] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.470948 25331 ts_tablet_manager.cc:1403] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 13:22:14.475294 25331 raft_consensus.cc:359] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.477017 25331 raft_consensus.cc:385] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.480105 25331 raft_consensus.cc:740] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.482453 25333 tablet_bootstrap.cc:492] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:14.483040 25333 ts_tablet_manager.cc:1403] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.012s
I20260709 13:22:14.483074 25113 raft_consensus.cc:2468] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:14.480633 25190 raft_consensus.cc:2468] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:14.484428 25004 leader_election.cc:304] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:14.485659 25346 raft_consensus.cc:2804] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:14.486143 25346 raft_consensus.cc:697] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:14.487731 25332 tablet_bootstrap.cc:492] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:14.486969 25346 consensus_queue.cc:237] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.488243 25332 ts_tablet_manager.cc:1403] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.012s
I20260709 13:22:14.489424 25333 raft_consensus.cc:359] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.490170 25333 raft_consensus.cc:385] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.490460 25333 raft_consensus.cc:740] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.491146 25333 consensus_queue.cc:260] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.491269 25332 raft_consensus.cc:359] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.493947 25332 raft_consensus.cc:385] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.494275 25332 raft_consensus.cc:740] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.495442 25333 ts_tablet_manager.cc:1434] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:22:14.495042 25332 consensus_queue.cc:260] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.496553 25333 tablet_bootstrap.cc:492] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:14.497394 25332 ts_tablet_manager.cc:1434] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:22:14.497148 24936 catalog_manager.cc:5697] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:14.481933 25331 consensus_queue.cc:260] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.500909 25331 ts_tablet_manager.cc:1434] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:22:14.498385 25332 tablet_bootstrap.cc:492] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:14.502076 25331 tablet_bootstrap.cc:492] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:14.505290 25333 tablet_bootstrap.cc:654] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.505290 24938 catalog_manager.cc:5697] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 1 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
W20260709 13:22:14.506878 24987 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:14.509250 25331 tablet_bootstrap.cc:654] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.509907 25332 tablet_bootstrap.cc:654] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.512967 25333 tablet_bootstrap.cc:492] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:14.513437 25333 ts_tablet_manager.cc:1403] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:22:14.516338 25333 raft_consensus.cc:359] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.517055 25333 raft_consensus.cc:385] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.517382 25333 raft_consensus.cc:740] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.519616 25333 consensus_queue.cc:260] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.522899 25332 tablet_bootstrap.cc:492] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:14.525496 25332 ts_tablet_manager.cc:1403] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.005s
I20260709 13:22:14.527474 25331 tablet_bootstrap.cc:492] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:14.528352 25331 ts_tablet_manager.cc:1403] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.006s
I20260709 13:22:14.528203 25332 raft_consensus.cc:359] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.528988 25332 raft_consensus.cc:385] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.529340 25332 raft_consensus.cc:740] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.530118 25332 consensus_queue.cc:260] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.530649 25333 ts_tablet_manager.cc:1434] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.007s
I20260709 13:22:14.531776 25333 tablet_bootstrap.cc:492] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:14.532583 25332 ts_tablet_manager.cc:1434] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:22:14.533655 25332 tablet_bootstrap.cc:492] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:14.534490 25331 raft_consensus.cc:359] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.535245 25331 raft_consensus.cc:385] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.535593 25331 raft_consensus.cc:740] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.536494 25331 consensus_queue.cc:260] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.538415 25333 tablet_bootstrap.cc:654] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.540961 25332 tablet_bootstrap.cc:654] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.543421 25331 ts_tablet_manager.cc:1434] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 13:22:14.544492 25331 tablet_bootstrap.cc:492] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:14.550727 25331 tablet_bootstrap.cc:654] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.552363 25333 tablet_bootstrap.cc:492] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:14.552529 25332 tablet_bootstrap.cc:492] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:14.552935 25333 ts_tablet_manager.cc:1403] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.006s
I20260709 13:22:14.553035 25332 ts_tablet_manager.cc:1403] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:22:14.556099 25333 raft_consensus.cc:359] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.556313 25332 raft_consensus.cc:359] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.556885 25333 raft_consensus.cc:385] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.557044 25332 raft_consensus.cc:385] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.557266 25333 raft_consensus.cc:740] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.557489 25332 raft_consensus.cc:740] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.558080 25333 consensus_queue.cc:260] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.558274 25332 consensus_queue.cc:260] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.562474 25332 ts_tablet_manager.cc:1434] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:22:14.562554 25333 ts_tablet_manager.cc:1434] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:22:14.563539 25333 tablet_bootstrap.cc:492] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:14.563540 25332 tablet_bootstrap.cc:492] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:14.570611 25333 tablet_bootstrap.cc:654] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.570611 25332 tablet_bootstrap.cc:654] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.587417 25332 tablet_bootstrap.cc:492] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:14.587417 25344 raft_consensus.cc:493] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:14.588003 25332 ts_tablet_manager.cc:1403] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.013s
I20260709 13:22:14.588220 25344 raft_consensus.cc:515] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.590224 25344 leader_election.cc:290] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:14.591010 25332 raft_consensus.cc:359] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.591835 25332 raft_consensus.cc:385] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.591969 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c407aadc8b47d986d126915392b5d8" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:14.592190 25332 raft_consensus.cc:740] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.593446 25333 tablet_bootstrap.cc:492] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:14.594120 25332 consensus_queue.cc:260] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.592880 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c407aadc8b47d986d126915392b5d8" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:14.593576 25041 raft_consensus.cc:2468] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:14.606328 25333 ts_tablet_manager.cc:1403] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.012s
I20260709 13:22:14.606530 25113 raft_consensus.cc:2468] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:14.598368 25314 raft_consensus.cc:493] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:14.607537 25153 leader_election.cc:304] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:14.607877 25332 ts_tablet_manager.cc:1434] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:22:14.607942 25314 raft_consensus.cc:515] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.608951 25332 tablet_bootstrap.cc:492] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:14.609392 25344 raft_consensus.cc:2804] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:14.609778 25344 raft_consensus.cc:493] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:14.610096 25344 raft_consensus.cc:3060] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.610422 25314 leader_election.cc:290] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:14.611469 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af63cabab3cc4736a1cd259a3b402f1e" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:14.612090 25190 raft_consensus.cc:2468] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:14.612603 25331 tablet_bootstrap.cc:492] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:14.613176 25331 ts_tablet_manager.cc:1403] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.034s
I20260709 13:22:14.613300 25007 leader_election.cc:304] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:14.614110 25314 raft_consensus.cc:2804] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:14.614530 25314 raft_consensus.cc:493] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:14.614929 25314 raft_consensus.cc:3060] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.615934 25332 tablet_bootstrap.cc:654] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.615968 25319 raft_consensus.cc:493] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:14.616665 25319 raft_consensus.cc:515] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.618690 25319 leader_election.cc:290] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:14.620235 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee98cf387494e67a0c98ecdbf29fadc" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:14.620556 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee98cf387494e67a0c98ecdbf29fadc" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:14.621130 25114 raft_consensus.cc:2468] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:14.622890 25153 leader_election.cc:304] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5763209744194094ba5ef8926ff0607a, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:14.621248 25041 raft_consensus.cc:2468] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:14.624568 25319 raft_consensus.cc:2804] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:14.625074 25319 raft_consensus.cc:493] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:14.625574 25319 raft_consensus.cc:3060] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.627076 25331 raft_consensus.cc:359] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.630237 25331 raft_consensus.cc:385] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.630543 25331 raft_consensus.cc:740] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.631275 25331 consensus_queue.cc:260] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.631479 25314 raft_consensus.cc:515] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.619726 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af63cabab3cc4736a1cd259a3b402f1e" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:14.633894 25331 ts_tablet_manager.cc:1434] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:22:14.635495 25113 raft_consensus.cc:2468] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:14.636114 25331 tablet_bootstrap.cc:492] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:14.636471 25332 tablet_bootstrap.cc:492] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:14.618697 25344 raft_consensus.cc:515] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.637077 25332 ts_tablet_manager.cc:1403] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.016s
I20260709 13:22:14.639053 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c407aadc8b47d986d126915392b5d8" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:14.639643 25041 raft_consensus.cc:3060] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.639972 25332 raft_consensus.cc:359] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.640686 25332 raft_consensus.cc:385] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.641014 25332 raft_consensus.cc:740] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.641690 25332 consensus_queue.cc:260] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.644721 25314 leader_election.cc:290] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:14.645274 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af63cabab3cc4736a1cd259a3b402f1e" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:14.645833 25190 raft_consensus.cc:3060] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.646027 25331 tablet_bootstrap.cc:654] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.646632 25332 ts_tablet_manager.cc:1434] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:22:14.647568 25332 tablet_bootstrap.cc:492] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a: Bootstrap starting.
I20260709 13:22:14.635017 25333 raft_consensus.cc:359] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.655627 25333 raft_consensus.cc:385] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.656104 25333 raft_consensus.cc:740] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.653389 25190 raft_consensus.cc:2468] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:14.654141 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af63cabab3cc4736a1cd259a3b402f1e" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:14.658555 25113 raft_consensus.cc:3060] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.658826 25007 leader_election.cc:304] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:14.659655 25314 raft_consensus.cc:2804] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:14.660429 25331 tablet_bootstrap.cc:492] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:14.660924 25331 ts_tablet_manager.cc:1403] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 13:22:14.661262 25314 raft_consensus.cc:697] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:14.662195 25314 consensus_queue.cc:237] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.658236 25333 consensus_queue.cc:260] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.665118 25333 ts_tablet_manager.cc:1434] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:22:14.665390 25113 raft_consensus.cc:2468] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:14.653532 25332 tablet_bootstrap.cc:654] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.658239 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c407aadc8b47d986d126915392b5d8" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:14.657541 25344 leader_election.cc:290] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:14.657150 25041 raft_consensus.cc:2468] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:14.666280 25114 raft_consensus.cc:3060] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.667275 25153 leader_election.cc:304] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:14.668407 25344 raft_consensus.cc:2804] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:14.668704 25333 tablet_bootstrap.cc:492] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729: Bootstrap starting.
I20260709 13:22:14.669035 25344 raft_consensus.cc:697] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:14.670111 25344 consensus_queue.cc:237] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.674872 25333 tablet_bootstrap.cc:654] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.675180 25114 raft_consensus.cc:2468] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:14.675941 25331 raft_consensus.cc:359] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.676694 25331 raft_consensus.cc:385] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.676996 25331 raft_consensus.cc:740] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.676862 25319 raft_consensus.cc:515] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.677772 25331 consensus_queue.cc:260] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.680409 25331 ts_tablet_manager.cc:1434] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:22:14.681363 25331 tablet_bootstrap.cc:492] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:14.684149 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee98cf387494e67a0c98ecdbf29fadc" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:14.684875 25114 raft_consensus.cc:3060] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.687606 25332 tablet_bootstrap.cc:492] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a: No bootstrap required, opened a new log
I20260709 13:22:14.688078 25332 ts_tablet_manager.cc:1403] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.003s
I20260709 13:22:14.689697 25331 tablet_bootstrap.cc:654] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.690160 25259 raft_consensus.cc:493] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:14.690657 25259 raft_consensus.cc:515] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.692727 25332 raft_consensus.cc:359] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.694288 25332 raft_consensus.cc:385] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.694977 25332 raft_consensus.cc:740] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.694813 25040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7062b131354662b5ba735ab96bfac3" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:14.697261 25040 raft_consensus.cc:2468] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 0.
I20260709 13:22:14.696769 25332 consensus_queue.cc:260] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.698328 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee98cf387494e67a0c98ecdbf29fadc" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:14.698699 25079 leader_election.cc:304] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:14.698989 25041 raft_consensus.cc:3060] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.692973 25259 leader_election.cc:290] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:14.700915 25332 ts_tablet_manager.cc:1434] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:22:14.702059 25259 raft_consensus.cc:2804] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:14.702481 25259 raft_consensus.cc:493] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:14.702804 25259 raft_consensus.cc:3060] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.707886 25041 raft_consensus.cc:2468] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:14.708331 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7062b131354662b5ba735ab96bfac3" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:14.709158 25153 leader_election.cc:304] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:14.709851 25190 raft_consensus.cc:2468] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 0.
I20260709 13:22:14.710091 25345 raft_consensus.cc:2804] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:14.710765 25333 tablet_bootstrap.cc:492] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729: No bootstrap required, opened a new log
I20260709 13:22:14.711230 25333 ts_tablet_manager.cc:1403] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.005s
I20260709 13:22:14.711810 25319 leader_election.cc:290] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:14.713780 25314 raft_consensus.cc:493] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:14.714063 25333 raft_consensus.cc:359] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.714802 25333 raft_consensus.cc:385] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.714485 25314 raft_consensus.cc:515] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.715090 25333 raft_consensus.cc:740] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.715833 25333 consensus_queue.cc:260] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.716301 25259 raft_consensus.cc:515] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.717063 25314 leader_election.cc:290] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:14.717695 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f50b6733af5410b9d4681f1cb3c862d" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:14.718137 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f50b6733af5410b9d4681f1cb3c862d" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:14.718686 25333 ts_tablet_manager.cc:1434] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:22:14.722630 25190 raft_consensus.cc:2468] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:14.723793 25007 leader_election.cc:304] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:14.720193 25345 raft_consensus.cc:697] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:14.724107 25113 raft_consensus.cc:2468] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:14.724925 25314 raft_consensus.cc:2804] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:14.725450 25314 raft_consensus.cc:493] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:14.724215 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7062b131354662b5ba735ab96bfac3" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:14.725899 25314 raft_consensus.cc:3060] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.726254 25041 raft_consensus.cc:3060] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.728500 25259 leader_election.cc:290] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:14.730619 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7062b131354662b5ba735ab96bfac3" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:14.731200 25190 raft_consensus.cc:3060] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.734130 25041 raft_consensus.cc:2468] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 1.
I20260709 13:22:14.735216 25079 leader_election.cc:304] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:14.736050 25259 raft_consensus.cc:2804] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:14.736532 25259 raft_consensus.cc:697] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Becoming Leader. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:14.737283 25259 consensus_queue.cc:237] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.738003 24937 catalog_manager.cc:5697] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 1 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:14.738962 25190 raft_consensus.cc:2468] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 1.
I20260709 13:22:14.725057 25345 consensus_queue.cc:237] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.694442 24938 catalog_manager.cc:5697] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:14.742656 25331 tablet_bootstrap.cc:492] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:14.743125 25331 ts_tablet_manager.cc:1403] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.021s
I20260709 13:22:14.746104 25314 raft_consensus.cc:515] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.745682 25331 raft_consensus.cc:359] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.749133 25331 raft_consensus.cc:385] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.749712 25114 raft_consensus.cc:2468] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:14.749420 25331 raft_consensus.cc:740] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.750571 25331 consensus_queue.cc:260] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.752526 25331 ts_tablet_manager.cc:1434] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:22:14.753432 25331 tablet_bootstrap.cc:492] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b: Bootstrap starting.
I20260709 13:22:14.755465 25314 leader_election.cc:290] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:14.757014 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f50b6733af5410b9d4681f1cb3c862d" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:14.757447 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f50b6733af5410b9d4681f1cb3c862d" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:14.757588 25190 raft_consensus.cc:3060] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.758101 25114 raft_consensus.cc:3060] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.758771 25331 tablet_bootstrap.cc:654] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:14.764005 24939 catalog_manager.cc:5697] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b reported cstate change: term changed from 0 to 1, leader changed from <none> to a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2). New cstate: current_term: 1 leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:14.765254 25114 raft_consensus.cc:2468] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:14.766425 25004 leader_election.cc:304] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:14.767261 25314 raft_consensus.cc:2804] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:14.767791 25314 raft_consensus.cc:697] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:14.768628 25314 consensus_queue.cc:237] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.771209 25331 tablet_bootstrap.cc:492] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b: No bootstrap required, opened a new log
I20260709 13:22:14.771721 25331 ts_tablet_manager.cc:1403] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.005s
I20260709 13:22:14.773928 25190 raft_consensus.cc:2468] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:14.774381 25331 raft_consensus.cc:359] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.775154 25331 raft_consensus.cc:385] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:14.775410 25331 raft_consensus.cc:740] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Initialized, Role: FOLLOWER
I20260709 13:22:14.776047 25331 consensus_queue.cc:260] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.778070 25331 ts_tablet_manager.cc:1434] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:22:14.780701 25346 raft_consensus.cc:493] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:14.781208 25346 raft_consensus.cc:515] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.783255 25346 leader_election.cc:290] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:14.784034 24937 catalog_manager.cc:5697] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 1 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:14.784830 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a10c8e90a8b4efaa3f5b75a70e4f0dc" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a" is_pre_election: true
I20260709 13:22:14.785207 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a10c8e90a8b4efaa3f5b75a70e4f0dc" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:14.785511 25190 raft_consensus.cc:2468] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:14.785857 25114 raft_consensus.cc:2468] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 0.
I20260709 13:22:14.786929 25004 leader_election.cc:304] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:14.787580 25346 raft_consensus.cc:2804] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:14.787952 25346 raft_consensus.cc:493] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:14.787930 24939 catalog_manager.cc:5697] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:14.788868 25346 raft_consensus.cc:3060] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.794909 25346 raft_consensus.cc:515] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.797683 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a10c8e90a8b4efaa3f5b75a70e4f0dc" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:14.798276 25114 raft_consensus.cc:3060] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.799917 25346 leader_election.cc:290] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:14.800737 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a10c8e90a8b4efaa3f5b75a70e4f0dc" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:14.801329 25190 raft_consensus.cc:3060] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.805949 25114 raft_consensus.cc:2468] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:14.807279 25004 leader_election.cc:304] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:14.808570 25314 raft_consensus.cc:2804] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:14.808563 25190 raft_consensus.cc:2468] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 1.
I20260709 13:22:14.809228 25314 raft_consensus.cc:697] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:14.810700 25314 consensus_queue.cc:237] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.819244 24938 catalog_manager.cc:5697] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 1 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:14.821157 25345 raft_consensus.cc:493] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:14.821703 25345 raft_consensus.cc:515] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.823496 25345 leader_election.cc:290] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:14.824144 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729" is_pre_election: true
I20260709 13:22:14.824724 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b" is_pre_election: true
I20260709 13:22:14.824766 25041 raft_consensus.cc:2468] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:14.827503 25153 leader_election.cc:304] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:14.825410 25114 raft_consensus.cc:2468] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 0.
I20260709 13:22:14.828260 25345 raft_consensus.cc:2804] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:14.828670 25345 raft_consensus.cc:493] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:14.828984 25345 raft_consensus.cc:3060] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.833809 25345 raft_consensus.cc:515] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.835280 25345 leader_election.cc:290] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:14.836015 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:14.836202 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:14.836503 25041 raft_consensus.cc:3060] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.836830 25114 raft_consensus.cc:3060] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:14.840590 25041 raft_consensus.cc:2468] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:14.841490 25153 leader_election.cc:304] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:14.841557 25114 raft_consensus.cc:2468] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 1.
I20260709 13:22:14.842175 25345 raft_consensus.cc:2804] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:14.842677 25345 raft_consensus.cc:697] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:14.843444 25345 consensus_queue.cc:237] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:14.851540 24938 catalog_manager.cc:5697] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 1 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:14.997277 25345 consensus_queue.cc:1048] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.001331 25314 consensus_queue.cc:1048] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.008962 25189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92105f5a7ca64ef687c84af4b6472a7b"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
mode: GRACEFUL
new_leader_uuid: "0cfaba879caa48989267551827a9d729"
 from {username='slave'} at 127.0.0.1:33470
I20260709 13:22:15.010432 25189 raft_consensus.cc:606] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Received request to transfer leadership to TS 0cfaba879caa48989267551827a9d729
I20260709 13:22:15.013448 25368 raft_consensus.cc:993] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a: : Instructing follower 0cfaba879caa48989267551827a9d729 to start an election
I20260709 13:22:15.013849 25368 raft_consensus.cc:1081] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Signalling peer 0cfaba879caa48989267551827a9d729 to start an election
I20260709 13:22:15.021860 25368 consensus_queue.cc:1048] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.022179 25314 consensus_queue.cc:1048] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.023633 25041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92105f5a7ca64ef687c84af4b6472a7b"
dest_uuid: "0cfaba879caa48989267551827a9d729"
 from {username='slave'} at 127.0.0.1:34148
I20260709 13:22:15.024456 25041 raft_consensus.cc:493] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.024936 25041 raft_consensus.cc:3060] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.030242 25189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26c407aadc8b47d986d126915392b5d8"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
mode: GRACEFUL
new_leader_uuid: "0cfaba879caa48989267551827a9d729"
 from {username='slave'} at 127.0.0.1:33470
I20260709 13:22:15.030817 25189 raft_consensus.cc:606] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Received request to transfer leadership to TS 0cfaba879caa48989267551827a9d729
I20260709 13:22:15.034663 25041 raft_consensus.cc:515] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.037868 25041 leader_election.cc:290] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 2 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:15.042486 25188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92105f5a7ca64ef687c84af4b6472a7b" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:15.043090 25188 raft_consensus.cc:3055] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:15.043358 25188 raft_consensus.cc:740] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:15.043823 25189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fee98cf387494e67a0c98ecdbf29fadc"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
mode: GRACEFUL
new_leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:33470
I20260709 13:22:15.044486 25189 raft_consensus.cc:606] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Received request to transfer leadership to TS a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:15.044222 25188 consensus_queue.cc:260] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.045424 25188 raft_consensus.cc:3060] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.045759 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92105f5a7ca64ef687c84af4b6472a7b" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:15.053078 25041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f50b6733af5410b9d4681f1cb3c862d"
dest_uuid: "0cfaba879caa48989267551827a9d729"
mode: GRACEFUL
new_leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:34150
I20260709 13:22:15.053597 25041 raft_consensus.cc:606] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Received request to transfer leadership to TS a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:15.056589 25188 raft_consensus.cc:2468] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 2.
I20260709 13:22:15.057649 25007 leader_election.cc:304] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:15.058966 25346 raft_consensus.cc:2804] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:15.060111 25346 raft_consensus.cc:697] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:15.060981 25346 consensus_queue.cc:237] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.065639 25188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
mode: GRACEFUL
new_leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:33470
I20260709 13:22:15.066298 25188 raft_consensus.cc:606] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Received request to transfer leadership to TS a523bed461d94e16b91e8c7bc3eb849b
I20260709 13:22:15.071978 25041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a10c8e90a8b4efaa3f5b75a70e4f0dc"
dest_uuid: "0cfaba879caa48989267551827a9d729"
mode: GRACEFUL
new_leader_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:34150
I20260709 13:22:15.072605 25041 raft_consensus.cc:606] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Received request to transfer leadership to TS 5763209744194094ba5ef8926ff0607a
I20260709 13:22:15.071942 24937 catalog_manager.cc:5697] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 1 to 2, leader changed from 5763209744194094ba5ef8926ff0607a (127.15.90.3) to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:15.081483 25346 consensus_queue.cc:1048] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.091266 25346 consensus_queue.cc:1048] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.134167 25259 consensus_queue.cc:1048] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.145642 25365 consensus_queue.cc:1048] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:15.159778 25368 consensus_queue.cc:1048] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.170131 25345 consensus_queue.cc:1048] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.178663 25368 raft_consensus.cc:993] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a: : Instructing follower a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:15.179270 25345 raft_consensus.cc:1081] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Signalling peer a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:15.180788 25113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fee98cf387494e67a0c98ecdbf29fadc"
dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:36970
I20260709 13:22:15.181340 25113 raft_consensus.cc:493] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.181727 25113 raft_consensus.cc:3060] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.186612 25113 raft_consensus.cc:515] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.188414 25113 leader_election.cc:290] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:15.189146 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee98cf387494e67a0c98ecdbf29fadc" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:15.189536 25188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee98cf387494e67a0c98ecdbf29fadc" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:15.189761 25041 raft_consensus.cc:3060] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.190158 25188 raft_consensus.cc:3055] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:15.190469 25188 raft_consensus.cc:740] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:15.191236 25188 consensus_queue.cc:260] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.192502 25188 raft_consensus.cc:3060] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.194695 25041 raft_consensus.cc:2468] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:15.195566 25079 leader_election.cc:304] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:15.196273 25365 raft_consensus.cc:2804] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:15.196750 25365 raft_consensus.cc:697] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Becoming Leader. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:15.197540 25365 consensus_queue.cc:237] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.198244 25188 raft_consensus.cc:2468] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:15.204460 24939 catalog_manager.cc:5697] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b reported cstate change: term changed from 1 to 2, leader changed from 5763209744194094ba5ef8926ff0607a (127.15.90.3) to a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2). New cstate: current_term: 2 leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:15.230639 25346 consensus_queue.cc:1048] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.232682 25346 consensus_queue.cc:1048] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.232888 25345 consensus_queue.cc:1048] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.238634 25346 raft_consensus.cc:993] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729: : Instructing follower 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:15.239048 25346 raft_consensus.cc:1081] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Signalling peer 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:15.244432 25345 consensus_queue.cc:1048] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:15.246933 25314 consensus_queue.cc:1048] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.252805 25190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a10c8e90a8b4efaa3f5b75a70e4f0dc"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:33456
I20260709 13:22:15.253391 25190 raft_consensus.cc:493] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.253809 25190 raft_consensus.cc:3060] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.256834 25346 consensus_queue.cc:1048] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.268937 25190 raft_consensus.cc:515] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.273454 25040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a10c8e90a8b4efaa3f5b75a70e4f0dc" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:15.274260 25040 raft_consensus.cc:3055] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:15.274392 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a10c8e90a8b4efaa3f5b75a70e4f0dc" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:15.274703 25040 raft_consensus.cc:740] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:15.275295 25114 raft_consensus.cc:3060] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.275724 25040 consensus_queue.cc:260] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.276937 25040 raft_consensus.cc:3060] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.277904 25190 leader_election.cc:290] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 2 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:15.285876 25040 raft_consensus.cc:2468] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 2.
I20260709 13:22:15.287652 25153 leader_election.cc:304] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:15.289525 25368 raft_consensus.cc:2804] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:15.290954 25345 raft_consensus.cc:993] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a: : Instructing follower 0cfaba879caa48989267551827a9d729 to start an election
I20260709 13:22:15.289366 25344 consensus_queue.cc:1048] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.291373 25345 raft_consensus.cc:1081] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Signalling peer 0cfaba879caa48989267551827a9d729 to start an election
I20260709 13:22:15.294755 25368 raft_consensus.cc:697] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 2 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:15.295713 25368 consensus_queue.cc:237] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.297461 25380 raft_consensus.cc:993] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729: : Instructing follower a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:15.297914 25380 raft_consensus.cc:1081] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Signalling peer a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:15.298803 25039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26c407aadc8b47d986d126915392b5d8"
dest_uuid: "0cfaba879caa48989267551827a9d729"
 from {username='slave'} at 127.0.0.1:34148
I20260709 13:22:15.299352 25039 raft_consensus.cc:493] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.299746 25039 raft_consensus.cc:3060] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.303886 25112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f50b6733af5410b9d4681f1cb3c862d"
dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:36958
I20260709 13:22:15.304421 25112 raft_consensus.cc:493] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.304827 25112 raft_consensus.cc:3060] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.309481 25114 raft_consensus.cc:2468] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 2.
I20260709 13:22:15.310954 25319 consensus_queue.cc:1048] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.312071 25112 raft_consensus.cc:515] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.314702 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f50b6733af5410b9d4681f1cb3c862d" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:15.315230 25041 raft_consensus.cc:3055] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:15.315510 25041 raft_consensus.cc:740] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:15.316362 25041 consensus_queue.cc:260] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.316848 25039 raft_consensus.cc:515] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.317376 25041 raft_consensus.cc:3060] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.317921 25040 raft_consensus.cc:1240] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Rejecting Update request from peer 5763209744194094ba5ef8926ff0607a for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:15.321523 25039 leader_election.cc:290] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 2 election: Requested vote from peers a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:15.321650 25396 consensus_queue.cc:1059] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:15.324143 25188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f50b6733af5410b9d4681f1cb3c862d" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:15.324461 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c407aadc8b47d986d126915392b5d8" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:15.324707 25188 raft_consensus.cc:3060] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.324259 24938 catalog_manager.cc:5697] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 1 to 2, leader changed from 0cfaba879caa48989267551827a9d729 (127.15.90.1) to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 2 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:15.328117 25396 raft_consensus.cc:3055] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:15.328507 25396 raft_consensus.cc:740] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:15.333220 25112 leader_election.cc:290] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:15.334913 25188 raft_consensus.cc:2468] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:15.335044 25396 consensus_queue.cc:260] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.336479 25082 leader_election.cc:304] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5763209744194094ba5ef8926ff0607a, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:15.337633 25365 raft_consensus.cc:2804] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:15.338063 25365 raft_consensus.cc:697] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Becoming Leader. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:15.338852 25365 consensus_queue.cc:237] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.340493 25041 raft_consensus.cc:2468] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:15.336419 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26c407aadc8b47d986d126915392b5d8" candidate_uuid: "0cfaba879caa48989267551827a9d729" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:15.342171 25114 raft_consensus.cc:3060] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.343966 25396 raft_consensus.cc:3060] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.349642 25319 raft_consensus.cc:993] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a: : Instructing follower a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:15.350136 25368 raft_consensus.cc:1081] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Signalling peer a523bed461d94e16b91e8c7bc3eb849b to start an election
I20260709 13:22:15.350251 25114 raft_consensus.cc:2468] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 2.
I20260709 13:22:15.351305 25004 leader_election.cc:304] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:15.351923 25114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de"
dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
 from {username='slave'} at 127.0.0.1:36970
I20260709 13:22:15.352418 25314 raft_consensus.cc:2804] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:15.352519 25114 raft_consensus.cc:493] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:15.353089 25314 raft_consensus.cc:697] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Becoming Leader. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:15.353065 25114 raft_consensus.cc:3060] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.353994 25314 consensus_queue.cc:237] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.360484 25114 raft_consensus.cc:515] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.360903 25190 raft_consensus.cc:2468] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cfaba879caa48989267551827a9d729 in term 2.
I20260709 13:22:15.361485 24939 catalog_manager.cc:5697] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 reported cstate change: term changed from 1 to 2, leader changed from 5763209744194094ba5ef8926ff0607a (127.15.90.3) to 0cfaba879caa48989267551827a9d729 (127.15.90.1). New cstate: current_term: 2 leader_uuid: "0cfaba879caa48989267551827a9d729" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:15.363281 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:15.363859 25041 raft_consensus.cc:3060] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.364316 25114 leader_election.cc:290] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), 5763209744194094ba5ef8926ff0607a (127.15.90.3:41241)
I20260709 13:22:15.366070 25190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de" candidate_uuid: "a523bed461d94e16b91e8c7bc3eb849b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5763209744194094ba5ef8926ff0607a"
I20260709 13:22:15.366611 25190 raft_consensus.cc:3055] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:15.366895 25190 raft_consensus.cc:740] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:15.367643 25190 consensus_queue.cc:260] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.368875 25190 raft_consensus.cc:3060] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.369905 24938 catalog_manager.cc:5697] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b reported cstate change: term changed from 1 to 2, leader changed from 0cfaba879caa48989267551827a9d729 (127.15.90.1) to a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2). New cstate: current_term: 2 leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:15.370899 25041 raft_consensus.cc:2468] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:15.372226 25079 leader_election.cc:304] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:15.373085 25365 raft_consensus.cc:2804] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:15.373540 25365 raft_consensus.cc:697] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Becoming Leader. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:15.374522 25365 consensus_queue.cc:237] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:15.376597 25190 raft_consensus.cc:2468] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a523bed461d94e16b91e8c7bc3eb849b in term 2.
I20260709 13:22:15.382915 24938 catalog_manager.cc:5697] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b reported cstate change: term changed from 1 to 2, leader changed from 5763209744194094ba5ef8926ff0607a (127.15.90.3) to a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2). New cstate: current_term: 2 leader_uuid: "a523bed461d94e16b91e8c7bc3eb849b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:15.576140 25113 raft_consensus.cc:3060] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:15.578629 25190 raft_consensus.cc:1275] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Refusing update from remote peer 0cfaba879caa48989267551827a9d729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.579980 25380 consensus_queue.cc:1048] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.580314 25041 raft_consensus.cc:1275] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.581583 25365 consensus_queue.cc:1048] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.582764 25113 raft_consensus.cc:1275] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Refusing update from remote peer 0cfaba879caa48989267551827a9d729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.584853 25346 consensus_queue.cc:1048] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.597479 25188 raft_consensus.cc:1275] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.599745 25259 consensus_queue.cc:1048] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.683383 25041 raft_consensus.cc:1275] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.684616 25396 consensus_queue.cc:1048] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.691498 25113 raft_consensus.cc:1275] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.693005 25368 consensus_queue.cc:1048] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.746548 25188 raft_consensus.cc:1275] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.747665 25259 consensus_queue.cc:1048] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.754878 25041 raft_consensus.cc:1275] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.756304 25367 consensus_queue.cc:1048] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.785050 25041 raft_consensus.cc:1275] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.786212 25400 consensus_queue.cc:1048] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.792840 25188 raft_consensus.cc:1275] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Refusing update from remote peer a523bed461d94e16b91e8c7bc3eb849b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.794304 25400 consensus_queue.cc:1048] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.970790 25113 raft_consensus.cc:1275] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Refusing update from remote peer 0cfaba879caa48989267551827a9d729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.972252 25190 raft_consensus.cc:1275] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Refusing update from remote peer 0cfaba879caa48989267551827a9d729: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:15.972105 25380 consensus_queue.cc:1048] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:15.973562 25380 consensus_queue.cc:1048] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:18.075577 24937 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33204:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:18.095594 24937 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33204:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:18.120901 15720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:22:18.297319 25439 log.cc:927] Time spent T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:22:18.312449 25004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:35839, user_credentials={real_user=slave}} blocked reactor thread for 86313.7us
W20260709 13:22:18.366454 25441 log.cc:927] Time spent T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:22:18.377386 25039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af63cabab3cc4736a1cd259a3b402f1e"
dest_uuid: "0cfaba879caa48989267551827a9d729"
mode: GRACEFUL
new_leader_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:45192
I20260709 13:22:18.387033 25467 tablet.cc:1724] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:18.393843 25082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.3:41241, user_credentials={real_user=slave}} blocked reactor thread for 62428us
I20260709 13:22:18.397375 25468 tablet.cc:1724] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.401716 25467 tablet.cc:1724] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.410624 25461 tablet.cc:1724] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.414542 25460 tablet.cc:1724] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.416095 25039 raft_consensus.cc:606] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Received request to transfer leadership to TS 5763209744194094ba5ef8926ff0607a
I20260709 13:22:18.417184 25463 tablet.cc:1724] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.410241 25459 tablet.cc:1724] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:18.440557 25079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:42129, user_credentials={real_user=slave}} blocked reactor thread for 119078us
I20260709 13:22:18.444216 25467 tablet.cc:1724] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.448899 25466 tablet.cc:1724] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.445322 25473 tablet.cc:1724] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.453585 25465 tablet.cc:1724] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.455005 25472 tablet.cc:1724] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.456221 25469 tablet.cc:1724] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.465801 25399 raft_consensus.cc:993] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729: : Instructing follower 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:18.466323 25399 raft_consensus.cc:1081] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Signalling peer 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:18.468071 25185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af63cabab3cc4736a1cd259a3b402f1e"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:33456
I20260709 13:22:18.468619 25185 raft_consensus.cc:493] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.469532 25185 raft_consensus.cc:3060] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.501400 25476 tablet.cc:1724] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:18.516024 25216 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:26c407aadc8b47d986d126915392b5d8)
I20260709 13:22:18.516440 25465 tablet.cc:1724] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:18.523397 25216 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:26c407aadc8b47d986d126915392b5d8)
W20260709 13:22:18.528347 25216 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:26c407aadc8b47d986d126915392b5d8)
I20260709 13:22:18.536361 25466 tablet.cc:1724] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.532755 25459 tablet.cc:1724] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.551165 25465 tablet.cc:1724] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.557013 25467 tablet.cc:1724] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.551110 25473 tablet.cc:1724] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.561623 25463 tablet.cc:1724] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.563301 25460 tablet.cc:1724] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.572932 25472 tablet.cc:1724] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.580684 25461 tablet.cc:1724] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.583057 25476 tablet.cc:1724] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.583460 25185 raft_consensus.cc:515] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:18.586302 25041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af63cabab3cc4736a1cd259a3b402f1e" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:18.586822 25041 raft_consensus.cc:3055] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:18.587133 25041 raft_consensus.cc:740] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:18.587880 25041 consensus_queue.cc:260] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:18.588923 25041 raft_consensus.cc:3060] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.606678 25114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de"
dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
mode: GRACEFUL
new_leader_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:51728
I20260709 13:22:18.607275 25114 raft_consensus.cc:606] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Received request to transfer leadership to TS 5763209744194094ba5ef8926ff0607a
I20260709 13:22:18.607447 25113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af63cabab3cc4736a1cd259a3b402f1e" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:18.608095 25113 raft_consensus.cc:3060] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:18.610710 25041 raft_consensus.cc:2468] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 2.
I20260709 13:22:18.611989 25153 leader_election.cc:304] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:18.615010 25440 raft_consensus.cc:2804] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:18.615520 25440 raft_consensus.cc:697] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 2 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:18.618393 15720 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:22:18.607836 25185 leader_election.cc:290] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 2 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:18.619123 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:18.604226 25461 tablet.cc:1724] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.621368 25113 raft_consensus.cc:2468] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 2.
I20260709 13:22:18.618398 25440 consensus_queue.cc:237] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:18.630962 25114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60"
dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
mode: GRACEFUL
new_leader_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:51728
I20260709 13:22:18.631527 25114 raft_consensus.cc:606] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Received request to transfer leadership to TS 5763209744194094ba5ef8926ff0607a
I20260709 13:22:18.612869 25463 tablet.cc:1724] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:18.632375 24936 catalog_manager.cc:5697] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 1 to 2, leader changed from 0cfaba879caa48989267551827a9d729 (127.15.90.1) to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 2 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:18.635720 25041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e"
dest_uuid: "0cfaba879caa48989267551827a9d729"
mode: GRACEFUL
new_leader_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:45192
I20260709 13:22:18.636307 25041 raft_consensus.cc:606] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Received request to transfer leadership to TS 5763209744194094ba5ef8926ff0607a
I20260709 13:22:18.642918 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:18.643534 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:18.645153 25399 raft_consensus.cc:993] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729: : Instructing follower 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:18.645797 25404 raft_consensus.cc:1081] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Signalling peer 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:18.648571 25185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:33456
I20260709 13:22:18.649034 25185 raft_consensus.cc:493] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.649340 25185 raft_consensus.cc:3060] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.655789 25185 raft_consensus.cc:515] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:18.655145 24937 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01: soft_deleted_table [id=e21f7f3a866448f59a4cddd6ce70859d] alter complete (version 1)
I20260709 13:22:18.658672 25185 leader_election.cc:290] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 3 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:18.658636 25040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:18.660662 25040 raft_consensus.cc:3055] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:18.660861 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e759d2753f6b4ddda48a010f9485698e" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:18.661480 25114 raft_consensus.cc:3060] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.661001 25040 raft_consensus.cc:740] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cfaba879caa48989267551827a9d729, State: Running, Role: LEADER
I20260709 13:22:18.665297 25040 consensus_queue.cc:260] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:18.666543 25040 raft_consensus.cc:3060] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.669801 25114 raft_consensus.cc:2468] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 3.
I20260709 13:22:18.671147 25153 leader_election.cc:304] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5763209744194094ba5ef8926ff0607a, a523bed461d94e16b91e8c7bc3eb849b; no voters: 
I20260709 13:22:18.671872 25440 raft_consensus.cc:2804] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:18.672355 25440 raft_consensus.cc:697] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 3 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:18.672959 25440 consensus_queue.cc:237] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:18.678215 25040 raft_consensus.cc:2468] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 3.
I20260709 13:22:18.680858 24937 catalog_manager.cc:5697] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 2 to 3, leader changed from 0cfaba879caa48989267551827a9d729 (127.15.90.1) to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 3 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:18.976081 25458 raft_consensus.cc:993] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b: : Instructing follower 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:18.976853 25444 raft_consensus.cc:1081] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Signalling peer 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:18.978394 25184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:33442
I20260709 13:22:18.979092 25184 raft_consensus.cc:493] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:18.979751 25184 raft_consensus.cc:3060] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.989035 25184 raft_consensus.cc:515] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:18.990945 25184 leader_election.cc:290] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 3 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:18.991843 25040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:18.992246 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a63513da2e465499fd703ac7f6b6de" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:18.992849 25114 raft_consensus.cc:3055] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:18.992935 25040 raft_consensus.cc:3060] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:18.993216 25114 raft_consensus.cc:740] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:18.994341 25114 consensus_queue.cc:260] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:18.996333 25114 raft_consensus.cc:3060] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:19.003221 25040 raft_consensus.cc:2468] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 3.
I20260709 13:22:19.004483 25153 leader_election.cc:304] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:19.005278 25440 raft_consensus.cc:2804] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:19.005453 25114 raft_consensus.cc:2468] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 3.
I20260709 13:22:19.005805 25440 raft_consensus.cc:697] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 3 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:19.007097 25440 consensus_queue.cc:237] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:19.017189 25458 raft_consensus.cc:993] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b: : Instructing follower 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:19.017956 25458 raft_consensus.cc:1081] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Signalling peer 5763209744194094ba5ef8926ff0607a to start an election
I20260709 13:22:19.019810 25184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60"
dest_uuid: "5763209744194094ba5ef8926ff0607a"
 from {username='slave'} at 127.0.0.1:33442
I20260709 13:22:19.020349 25184 raft_consensus.cc:493] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:19.020726 25184 raft_consensus.cc:3060] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:19.021914 24937 catalog_manager.cc:5697] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 2 to 3, leader changed from a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2) to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 3 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:19.027727 25184 raft_consensus.cc:515] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:19.030189 25184 leader_election.cc:290] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 3 election: Requested vote from peers 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129), a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839)
I20260709 13:22:19.030882 25040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cfaba879caa48989267551827a9d729"
I20260709 13:22:19.031845 25040 raft_consensus.cc:3060] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:19.032330 25114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8e79cd172b4c2abce4091a486b3b60" candidate_uuid: "5763209744194094ba5ef8926ff0607a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a523bed461d94e16b91e8c7bc3eb849b"
I20260709 13:22:19.032894 25114 raft_consensus.cc:3055] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:19.033205 25114 raft_consensus.cc:740] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a523bed461d94e16b91e8c7bc3eb849b, State: Running, Role: LEADER
I20260709 13:22:19.034315 25114 consensus_queue.cc:260] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:19.035943 25114 raft_consensus.cc:3060] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:19.039400 25040 raft_consensus.cc:2468] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 3.
I20260709 13:22:19.040685 25153 leader_election.cc:304] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cfaba879caa48989267551827a9d729, 5763209744194094ba5ef8926ff0607a; no voters: 
I20260709 13:22:19.041420 25440 raft_consensus.cc:2804] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:19.041842 25440 raft_consensus.cc:697] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 3 LEADER]: Becoming Leader. State: Replica: 5763209744194094ba5ef8926ff0607a, State: Running, Role: LEADER
I20260709 13:22:19.042259 25114 raft_consensus.cc:2468] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5763209744194094ba5ef8926ff0607a in term 3.
I20260709 13:22:19.042970 25440 consensus_queue.cc:237] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } }
I20260709 13:22:19.050717 24937 catalog_manager.cc:5697] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a reported cstate change: term changed from 2 to 3, leader changed from a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2) to 5763209744194094ba5ef8926ff0607a (127.15.90.3). New cstate: current_term: 3 leader_uuid: "5763209744194094ba5ef8926ff0607a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5763209744194094ba5ef8926ff0607a" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 41241 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:19.120762 25114 raft_consensus.cc:1275] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:19.121877 25440 consensus_queue.cc:1048] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:19.134737 25040 raft_consensus.cc:1275] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:19.139478 25487 consensus_queue.cc:1048] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:19.153405 25114 raft_consensus.cc:1275] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:22:19.154553 25402 consensus_queue.cc:1048] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:19.164016 25040 raft_consensus.cc:1275] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:22:19.165432 25402 consensus_queue.cc:1048] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:19.481088 25114 raft_consensus.cc:1275] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:19.482316 25440 consensus_queue.cc:1048] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:19.490044 25041 raft_consensus.cc:1275] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:22:19.491932 25402 consensus_queue.cc:1048] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:22:19.576103 25113 raft_consensus.cc:1275] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:19.577162 25402 consensus_queue.cc:1048] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a523bed461d94e16b91e8c7bc3eb849b" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 35839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:19.586525 25041 raft_consensus.cc:1275] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Refusing update from remote peer 5763209744194094ba5ef8926ff0607a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:19.588035 25402 consensus_queue.cc:1048] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cfaba879caa48989267551827a9d729" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 42129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:19.698696 15720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:22:19.704464 15720 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:22:19.704824 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:22:19.709435 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:22:19.709735 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:20.736747 15720 tablet_server.cc:179] TabletServer@127.15.90.1:0 shutting down...
I20260709 13:22:20.766088 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:20.766906 15720 tablet_replica.cc:333] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.767884 15720 raft_consensus.cc:2243] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.768492 15720 raft_consensus.cc:2272] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.771072 15720 tablet_replica.cc:333] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.771632 15720 raft_consensus.cc:2243] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.772364 15720 raft_consensus.cc:2272] T 7f50b6733af5410b9d4681f1cb3c862d P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.774732 15720 tablet_replica.cc:333] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.775508 15720 raft_consensus.cc:2243] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.776268 15720 raft_consensus.cc:2272] T fee98cf387494e67a0c98ecdbf29fadc P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:20.777207 25153 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 13:22:20.779268 15720 tablet_replica.cc:333] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.779966 15720 raft_consensus.cc:2243] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.780555 15720 raft_consensus.cc:2272] T af63cabab3cc4736a1cd259a3b402f1e P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:20.780505 25153 consensus_peers.cc:597] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a -> Peer 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129): Couldn't send request to peer 0cfaba879caa48989267551827a9d729. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:20.783092 15720 tablet_replica.cc:333] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.783807 15720 raft_consensus.cc:2243] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.784608 15720 raft_consensus.cc:2272] T e27a94daca084c39904deaf22bf64bc7 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.786855 15720 tablet_replica.cc:333] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.787403 15720 raft_consensus.cc:2243] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.788209 15720 raft_consensus.cc:2272] T e9512d333df0479f8a54b7ca5b21be2a P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.792241 15720 tablet_replica.cc:333] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.792827 15720 raft_consensus.cc:2243] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.793887 15720 raft_consensus.cc:2272] T 92105f5a7ca64ef687c84af4b6472a7b P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.796545 15720 tablet_replica.cc:333] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729: stopping tablet replica
W20260709 13:22:20.796864 25153 consensus_peers.cc:597] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a -> Peer 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129): Couldn't send request to peer 0cfaba879caa48989267551827a9d729. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:20.797204 15720 raft_consensus.cc:2243] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.798276 15720 raft_consensus.cc:2272] T cdb8c6a649c14286bc5db194a159cb12 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.801193 15720 tablet_replica.cc:333] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.801781 15720 raft_consensus.cc:2243] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.802639 15720 raft_consensus.cc:2272] T f31cf153dd3645e69848b0148bcc7401 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.804765 15720 tablet_replica.cc:333] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.805307 15720 raft_consensus.cc:2243] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.805773 15720 raft_consensus.cc:2272] T 0e7062b131354662b5ba735ab96bfac3 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.807771 15720 tablet_replica.cc:333] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.808362 15720 raft_consensus.cc:2243] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.808848 15720 raft_consensus.cc:2272] T f1a63513da2e465499fd703ac7f6b6de P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.810820 15720 tablet_replica.cc:333] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.811422 15720 raft_consensus.cc:2243] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.812235 15720 raft_consensus.cc:2272] T 26c407aadc8b47d986d126915392b5d8 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.814450 15720 tablet_replica.cc:333] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.815035 15720 raft_consensus.cc:2243] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.815577 15720 raft_consensus.cc:2272] T 7f8e79cd172b4c2abce4091a486b3b60 P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.818277 15720 tablet_replica.cc:333] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.818783 15720 raft_consensus.cc:2243] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.819214 15720 raft_consensus.cc:2272] T 2f5197a405cd410a9077aaf68df394dd P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.822125 15720 tablet_replica.cc:333] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.822873 15720 raft_consensus.cc:2243] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.823601 15720 raft_consensus.cc:2272] T 0c4a4522a24a41409d25f48aff64a620 P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:20.825083 25079 consensus_peers.cc:597] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b -> Peer 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129): Couldn't send request to peer 0cfaba879caa48989267551827a9d729. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:20.826851 15720 tablet_replica.cc:333] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.827562 15720 raft_consensus.cc:2243] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.828088 15720 raft_consensus.cc:2272] T e759d2753f6b4ddda48a010f9485698e P 0cfaba879caa48989267551827a9d729 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:20.829610 25079 consensus_peers.cc:597] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b -> Peer 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129): Couldn't send request to peer 0cfaba879caa48989267551827a9d729. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:20.830739 15720 tablet_replica.cc:333] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.831333 15720 raft_consensus.cc:2243] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.831838 15720 raft_consensus.cc:2272] T bec99940072a4483ab476881a82c1285 P 0cfaba879caa48989267551827a9d729 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.833946 15720 tablet_replica.cc:333] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729: stopping tablet replica
I20260709 13:22:20.834424 15720 raft_consensus.cc:2243] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.834919 15720 raft_consensus.cc:2272] T cfcd88aad12d4581bd0777fe9248f56c P 0cfaba879caa48989267551827a9d729 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.877290 15720 tablet_server.cc:196] TabletServer@127.15.90.1:0 shutdown complete.
I20260709 13:22:20.916378 15720 tablet_server.cc:179] TabletServer@127.15.90.2:0 shutting down...
W20260709 13:22:20.930918 25153 consensus_peers.cc:597] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a -> Peer 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129): Couldn't send request to peer 0cfaba879caa48989267551827a9d729. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:42129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:20.950145 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:20.950882 15720 tablet_replica.cc:333] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.951768 15720 raft_consensus.cc:2243] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.952410 15720 raft_consensus.cc:2272] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.954579 15720 tablet_replica.cc:333] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.955179 15720 raft_consensus.cc:2243] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.956065 15720 raft_consensus.cc:2272] T 7f50b6733af5410b9d4681f1cb3c862d P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.958271 15720 tablet_replica.cc:333] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.958822 15720 raft_consensus.cc:2243] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.959281 15720 raft_consensus.cc:2272] T af63cabab3cc4736a1cd259a3b402f1e P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.961395 15720 tablet_replica.cc:333] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.962013 15720 raft_consensus.cc:2243] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.962800 15720 raft_consensus.cc:2272] T fee98cf387494e67a0c98ecdbf29fadc P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.964931 15720 tablet_replica.cc:333] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.965533 15720 raft_consensus.cc:2243] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.966092 15720 raft_consensus.cc:2272] T e27a94daca084c39904deaf22bf64bc7 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.968297 15720 tablet_replica.cc:333] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.968880 15720 raft_consensus.cc:2243] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.969416 15720 raft_consensus.cc:2272] T e9512d333df0479f8a54b7ca5b21be2a P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.971393 15720 tablet_replica.cc:333] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.971997 15720 raft_consensus.cc:2243] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.972509 15720 raft_consensus.cc:2272] T 92105f5a7ca64ef687c84af4b6472a7b P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.974694 15720 tablet_replica.cc:333] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.975246 15720 raft_consensus.cc:2243] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.976066 15720 raft_consensus.cc:2272] T cfcd88aad12d4581bd0777fe9248f56c P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.978780 15720 tablet_replica.cc:333] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.979493 15720 raft_consensus.cc:2243] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.980551 15720 raft_consensus.cc:2272] T bec99940072a4483ab476881a82c1285 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:20.981559 25153 consensus_peers.cc:597] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a -> Peer 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129): Couldn't send request to peer 0cfaba879caa48989267551827a9d729. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:42129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:20.983467 15720 tablet_replica.cc:333] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.984290 15720 raft_consensus.cc:2243] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:20.984791 25079 consensus_peers.cc:597] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b -> Peer 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129): Couldn't send request to peer 0cfaba879caa48989267551827a9d729. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:42129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:20.984784 15720 raft_consensus.cc:2272] T f1a63513da2e465499fd703ac7f6b6de P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.987160 15720 tablet_replica.cc:333] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.987787 15720 raft_consensus.cc:2243] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.988549 15720 raft_consensus.cc:2272] T 0e7062b131354662b5ba735ab96bfac3 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.990684 15720 tablet_replica.cc:333] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.991178 15720 raft_consensus.cc:2243] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.991734 15720 raft_consensus.cc:2272] T 26c407aadc8b47d986d126915392b5d8 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.993799 15720 tablet_replica.cc:333] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.994393 15720 raft_consensus.cc:2243] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:20.994781 15720 raft_consensus.cc:2272] T 7f8e79cd172b4c2abce4091a486b3b60 P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:20.997155 15720 tablet_replica.cc:333] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:20.997974 15720 raft_consensus.cc:2243] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:20.998868 15720 raft_consensus.cc:2272] T 2f5197a405cd410a9077aaf68df394dd P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:20.998878 25153 consensus_peers.cc:597] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a -> Peer a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839): Couldn't send request to peer a523bed461d94e16b91e8c7bc3eb849b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:21.001169 25153 consensus_peers.cc:597] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a -> Peer a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839): Couldn't send request to peer a523bed461d94e16b91e8c7bc3eb849b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.001672 15720 tablet_replica.cc:333] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:21.002270 15720 raft_consensus.cc:2243] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.002691 15720 raft_consensus.cc:2272] T cdb8c6a649c14286bc5db194a159cb12 P a523bed461d94e16b91e8c7bc3eb849b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.004869 15720 tablet_replica.cc:333] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:21.005360 15720 raft_consensus.cc:2243] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.005826 15720 raft_consensus.cc:2272] T f31cf153dd3645e69848b0148bcc7401 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.007937 15720 tablet_replica.cc:333] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:21.008406 15720 raft_consensus.cc:2243] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.008872 15720 raft_consensus.cc:2272] T 0c4a4522a24a41409d25f48aff64a620 P a523bed461d94e16b91e8c7bc3eb849b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.011461 15720 tablet_replica.cc:333] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b: stopping tablet replica
I20260709 13:22:21.012104 15720 raft_consensus.cc:2243] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.012590 15720 raft_consensus.cc:2272] T e759d2753f6b4ddda48a010f9485698e P a523bed461d94e16b91e8c7bc3eb849b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:21.014221 25153 consensus_peers.cc:597] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a -> Peer 0cfaba879caa48989267551827a9d729 (127.15.90.1:42129): Couldn't send request to peer 0cfaba879caa48989267551827a9d729. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:42129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.055954 15720 tablet_server.cc:196] TabletServer@127.15.90.2:0 shutdown complete.
I20260709 13:22:21.094031 15720 tablet_server.cc:179] TabletServer@127.15.90.3:0 shutting down...
W20260709 13:22:21.107911 25153 consensus_peers.cc:597] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a -> Peer a523bed461d94e16b91e8c7bc3eb849b (127.15.90.2:35839): Couldn't send request to peer a523bed461d94e16b91e8c7bc3eb849b. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:35839: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:21.126175 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:21.126992 15720 tablet_replica.cc:333] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.128206 15720 raft_consensus.cc:2243] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.129004 15720 raft_consensus.cc:2272] T 3a10c8e90a8b4efaa3f5b75a70e4f0dc P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.130950 15720 tablet_replica.cc:333] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.131433 15720 raft_consensus.cc:2243] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.131873 15720 raft_consensus.cc:2272] T 7f50b6733af5410b9d4681f1cb3c862d P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.133700 15720 tablet_replica.cc:333] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.134212 15720 raft_consensus.cc:2243] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.134859 15720 raft_consensus.cc:2272] T af63cabab3cc4736a1cd259a3b402f1e P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.136646 15720 tablet_replica.cc:333] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.137149 15720 raft_consensus.cc:2243] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.137553 15720 raft_consensus.cc:2272] T fee98cf387494e67a0c98ecdbf29fadc P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.139333 15720 tablet_replica.cc:333] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.139866 15720 raft_consensus.cc:2243] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.140241 15720 raft_consensus.cc:2272] T e27a94daca084c39904deaf22bf64bc7 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.142184 15720 tablet_replica.cc:333] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.142670 15720 raft_consensus.cc:2243] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.143069 15720 raft_consensus.cc:2272] T e9512d333df0479f8a54b7ca5b21be2a P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.144898 15720 tablet_replica.cc:333] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.145383 15720 raft_consensus.cc:2243] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.145829 15720 raft_consensus.cc:2272] T 92105f5a7ca64ef687c84af4b6472a7b P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.147785 15720 tablet_replica.cc:333] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.148269 15720 raft_consensus.cc:2243] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.148664 15720 raft_consensus.cc:2272] T cdb8c6a649c14286bc5db194a159cb12 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.150525 15720 tablet_replica.cc:333] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.151038 15720 raft_consensus.cc:2243] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.151491 15720 raft_consensus.cc:2272] T f31cf153dd3645e69848b0148bcc7401 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.153715 15720 tablet_replica.cc:333] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.154239 15720 raft_consensus.cc:2243] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.154981 15720 raft_consensus.cc:2272] T e759d2753f6b4ddda48a010f9485698e P 5763209744194094ba5ef8926ff0607a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.156883 15720 tablet_replica.cc:333] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.157392 15720 raft_consensus.cc:2243] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.157912 15720 raft_consensus.cc:2272] T 2f5197a405cd410a9077aaf68df394dd P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.159972 15720 tablet_replica.cc:333] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.160454 15720 raft_consensus.cc:2243] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.160913 15720 raft_consensus.cc:2272] T 0e7062b131354662b5ba735ab96bfac3 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.162701 15720 tablet_replica.cc:333] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.163195 15720 raft_consensus.cc:2243] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.163910 15720 raft_consensus.cc:2272] T f1a63513da2e465499fd703ac7f6b6de P 5763209744194094ba5ef8926ff0607a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.165689 15720 tablet_replica.cc:333] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.166168 15720 raft_consensus.cc:2243] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.166656 15720 raft_consensus.cc:2272] T 26c407aadc8b47d986d126915392b5d8 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.168574 15720 tablet_replica.cc:333] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.169107 15720 raft_consensus.cc:2243] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.169853 15720 raft_consensus.cc:2272] T 7f8e79cd172b4c2abce4091a486b3b60 P 5763209744194094ba5ef8926ff0607a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.171864 15720 tablet_replica.cc:333] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.172379 15720 raft_consensus.cc:2243] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.172786 15720 raft_consensus.cc:2272] T cfcd88aad12d4581bd0777fe9248f56c P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.174679 15720 tablet_replica.cc:333] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.175153 15720 raft_consensus.cc:2243] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:21.175557 15720 raft_consensus.cc:2272] T bec99940072a4483ab476881a82c1285 P 5763209744194094ba5ef8926ff0607a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.177484 15720 tablet_replica.cc:333] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a: stopping tablet replica
I20260709 13:22:21.177959 15720 raft_consensus.cc:2243] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.178682 15720 raft_consensus.cc:2272] T 0c4a4522a24a41409d25f48aff64a620 P 5763209744194094ba5ef8926ff0607a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.221002 15720 tablet_server.cc:196] TabletServer@127.15.90.3:0 shutdown complete.
I20260709 13:22:21.254906 15720 master.cc:562] Master@127.15.90.62:44919 shutting down...
I20260709 13:22:21.276239 15720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:21.276733 15720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:21.277031 15720 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4b865eaee08c4ad6bc458e9170eeca01: stopping tablet replica
I20260709 13:22:21.297071 15720 master.cc:584] Master@127.15.90.62:44919 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12002 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:22:21.346367 15720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.15.90.62:37389
I20260709 13:22:21.347396 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:21.352526 25500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.353221 25501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.353916 25503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.354715 15720 server_base.cc:1061] running on GCE node
I20260709 13:22:21.355582 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:21.355835 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:21.355997 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603341355980 us; error 0 us; skew 500 ppm
I20260709 13:22:21.356494 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:21.358665 15720 webserver.cc:533] Webserver started at http://127.15.90.62:33743/ using document root <none> and password file <none>
I20260709 13:22:21.359140 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:21.359346 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:21.359614 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:21.360740 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/master-0-root/instance:
uuid: "e13c2f78cc724772bc1aaa79b9fbcf2f"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-fpp7"
I20260709 13:22:21.364807 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:22:21.368062 25508 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.368808 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:22:21.369095 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/master-0-root
uuid: "e13c2f78cc724772bc1aaa79b9fbcf2f"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-fpp7"
I20260709 13:22:21.369385 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:21.384619 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:21.385869 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:21.422279 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.62:37389
I20260709 13:22:21.422379 25559 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.62:37389 every 8 connection(s)
I20260709 13:22:21.426070 25560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.436738 25560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f: Bootstrap starting.
I20260709 13:22:21.441489 25560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:21.445489 25560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f: No bootstrap required, opened a new log
I20260709 13:22:21.447614 25560 raft_consensus.cc:359] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13c2f78cc724772bc1aaa79b9fbcf2f" member_type: VOTER }
I20260709 13:22:21.448055 25560 raft_consensus.cc:385] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:21.448280 25560 raft_consensus.cc:740] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e13c2f78cc724772bc1aaa79b9fbcf2f, State: Initialized, Role: FOLLOWER
I20260709 13:22:21.448835 25560 consensus_queue.cc:260] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13c2f78cc724772bc1aaa79b9fbcf2f" member_type: VOTER }
I20260709 13:22:21.449301 25560 raft_consensus.cc:399] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:22:21.449816 25560 raft_consensus.cc:493] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:22:21.450129 25560 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:21.454735 25560 raft_consensus.cc:515] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13c2f78cc724772bc1aaa79b9fbcf2f" member_type: VOTER }
I20260709 13:22:21.455230 25560 leader_election.cc:304] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e13c2f78cc724772bc1aaa79b9fbcf2f; no voters: 
I20260709 13:22:21.456362 25560 leader_election.cc:290] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:22:21.456795 25563 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:21.458138 25563 raft_consensus.cc:697] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [term 1 LEADER]: Becoming Leader. State: Replica: e13c2f78cc724772bc1aaa79b9fbcf2f, State: Running, Role: LEADER
I20260709 13:22:21.458894 25563 consensus_queue.cc:237] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13c2f78cc724772bc1aaa79b9fbcf2f" member_type: VOTER }
I20260709 13:22:21.459326 25560 sys_catalog.cc:565] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:22:21.464015 25565 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e13c2f78cc724772bc1aaa79b9fbcf2f. Latest consensus state: current_term: 1 leader_uuid: "e13c2f78cc724772bc1aaa79b9fbcf2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13c2f78cc724772bc1aaa79b9fbcf2f" member_type: VOTER } }
I20260709 13:22:21.464876 25564 sys_catalog.cc:455] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e13c2f78cc724772bc1aaa79b9fbcf2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e13c2f78cc724772bc1aaa79b9fbcf2f" member_type: VOTER } }
I20260709 13:22:21.464895 25565 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:21.465473 25564 sys_catalog.cc:458] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [sys.catalog]: This master's current role is: LEADER
I20260709 13:22:21.467322 25572 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:22:21.473011 25572 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:22:21.474179 15720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:22:21.481670 25572 catalog_manager.cc:1383] Generated new cluster ID: bc48e58cd2534deba5b862b62a720282
I20260709 13:22:21.481964 25572 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:22:21.498241 25572 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:22:21.499536 25572 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:22:21.529191 25572 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f: Generated new TSK 0
I20260709 13:22:21.529866 25572 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:22:21.541107 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:21.550000 25581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.551719 25582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.554219 25584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.557366 15720 server_base.cc:1061] running on GCE node
I20260709 13:22:21.559024 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:21.559197 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:21.559320 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603341559310 us; error 0 us; skew 500 ppm
I20260709 13:22:21.559823 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:21.562168 15720 webserver.cc:533] Webserver started at http://127.15.90.1:39963/ using document root <none> and password file <none>
I20260709 13:22:21.562619 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:21.562767 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:21.562965 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:21.564016 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-0-root/instance:
uuid: "b1a170e0e36e42739a5253a9638242ea"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-fpp7"
I20260709 13:22:21.568172 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:22:21.571290 25589 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.572163 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:22:21.572523 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-0-root
uuid: "b1a170e0e36e42739a5253a9638242ea"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-fpp7"
I20260709 13:22:21.572824 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:21.598047 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:21.599895 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:21.601733 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:21.604579 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:21.604799 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.605050 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:21.605235 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.644565 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.1:38483
I20260709 13:22:21.644680 25651 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.1:38483 every 8 connection(s)
I20260709 13:22:21.649396 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:21.656450 25656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.656921 25657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.660148 15720 server_base.cc:1061] running on GCE node
W20260709 13:22:21.660591 25659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.661610 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:22:21.661854 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:21.662043 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603341662027 us; error 0 us; skew 500 ppm
I20260709 13:22:21.662704 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:21.663699 25652 heartbeater.cc:344] Connected to a master server at 127.15.90.62:37389
I20260709 13:22:21.664129 25652 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:21.664999 25652 heartbeater.cc:507] Master 127.15.90.62:37389 requested a full tablet report, sending...
I20260709 13:22:21.665423 15720 webserver.cc:533] Webserver started at http://127.15.90.2:45833/ using document root <none> and password file <none>
I20260709 13:22:21.666079 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:21.666292 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:21.666575 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:21.667253 25525 ts_manager.cc:194] Registered new tserver with Master: b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483)
I20260709 13:22:21.667924 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-1-root/instance:
uuid: "dd67834e150c49c787fcdda26d893bff"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-fpp7"
I20260709 13:22:21.669157 25525 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50790
I20260709 13:22:21.672740 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:22:21.676226 25664 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.677109 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:22:21.677343 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-1-root
uuid: "dd67834e150c49c787fcdda26d893bff"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-fpp7"
I20260709 13:22:21.677560 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:21.690516 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:21.691574 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:21.692961 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:21.695020 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:21.695241 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.695508 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:21.695672 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.734189 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.2:33105
I20260709 13:22:21.734287 25726 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.2:33105 every 8 connection(s)
I20260709 13:22:21.739032 15720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:22:21.745517 25730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:22:21.745887 25731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.748917 15720 server_base.cc:1061] running on GCE node
W20260709 13:22:21.749809 25734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:22:21.750694 25727 heartbeater.cc:344] Connected to a master server at 127.15.90.62:37389
I20260709 13:22:21.750844 15720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:22:21.751076 25727 heartbeater.cc:461] Registering TS with master...
W20260709 13:22:21.751175 15720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:22:21.751544 15720 hybrid_clock.cc:648] HybridClock initialized: now 1783603341751527 us; error 0 us; skew 500 ppm
I20260709 13:22:21.752091 25727 heartbeater.cc:507] Master 127.15.90.62:37389 requested a full tablet report, sending...
I20260709 13:22:21.752125 15720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:22:21.754491 25525 ts_manager.cc:194] Registered new tserver with Master: dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:21.754941 15720 webserver.cc:533] Webserver started at http://127.15.90.3:34257/ using document root <none> and password file <none>
I20260709 13:22:21.755600 15720 fs_manager.cc:362] Metadata directory not provided
I20260709 13:22:21.755877 15720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:22:21.756172 15720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:22:21.756342 25525 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50806
I20260709 13:22:21.757668 15720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-2-root/instance:
uuid: "269210845488416d80656a41298e309d"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-fpp7"
I20260709 13:22:21.762005 15720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:22:21.765221 25738 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.765906 15720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:22:21.766196 15720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-2-root
uuid: "269210845488416d80656a41298e309d"
format_stamp: "Formatted at 2026-07-09 13:22:21 on dist-test-slave-fpp7"
I20260709 13:22:21.766458 15720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task9Z55Dg/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783603071664575-15720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:22:21.794592 15720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:22:21.795823 15720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:22:21.797248 15720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:22:21.799417 15720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:22:21.799636 15720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.799893 15720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:22:21.800064 15720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:22:21.839529 15720 rpc_server.cc:307] RPC server started. Bound to: 127.15.90.3:39373
I20260709 13:22:21.839617 25800 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.90.3:39373 every 8 connection(s)
I20260709 13:22:21.852872 25801 heartbeater.cc:344] Connected to a master server at 127.15.90.62:37389
I20260709 13:22:21.853402 25801 heartbeater.cc:461] Registering TS with master...
I20260709 13:22:21.854120 25801 heartbeater.cc:507] Master 127.15.90.62:37389 requested a full tablet report, sending...
I20260709 13:22:21.855999 25525 ts_manager.cc:194] Registered new tserver with Master: 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:21.857066 15720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014413497s
I20260709 13:22:21.857234 25525 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50814
I20260709 13:22:21.881584 25525 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50826:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:21.884372 25525 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:21.947613 25692 tablet_service.cc:1511] Processing CreateTablet for tablet c5a94445821d4b0d814d79e60a0907e9 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:21.949118 25692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a94445821d4b0d814d79e60a0907e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.952716 25690 tablet_service.cc:1511] Processing CreateTablet for tablet 54de093d69a04b5b9ee85140a489e6a5 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:21.954155 25690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54de093d69a04b5b9ee85140a489e6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.956986 25691 tablet_service.cc:1511] Processing CreateTablet for tablet 23cb58e5dadb41a98df57c673e2e1e58 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:21.958361 25691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23cb58e5dadb41a98df57c673e2e1e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.964962 25616 tablet_service.cc:1511] Processing CreateTablet for tablet 23cb58e5dadb41a98df57c673e2e1e58 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:21.966470 25616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23cb58e5dadb41a98df57c673e2e1e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.967840 25617 tablet_service.cc:1511] Processing CreateTablet for tablet c5a94445821d4b0d814d79e60a0907e9 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:21.969146 25617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a94445821d4b0d814d79e60a0907e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.964851 25615 tablet_service.cc:1511] Processing CreateTablet for tablet 54de093d69a04b5b9ee85140a489e6a5 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:21.972422 25615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54de093d69a04b5b9ee85140a489e6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.978268 25614 tablet_service.cc:1511] Processing CreateTablet for tablet 7012dc39ac8c4464b6c378ccd62b1d1c (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:21.981834 25766 tablet_service.cc:1511] Processing CreateTablet for tablet c5a94445821d4b0d814d79e60a0907e9 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:21.983215 25766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5a94445821d4b0d814d79e60a0907e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.983655 25689 tablet_service.cc:1511] Processing CreateTablet for tablet 7012dc39ac8c4464b6c378ccd62b1d1c (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:21.985500 25689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7012dc39ac8c4464b6c378ccd62b1d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.988310 25614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7012dc39ac8c4464b6c378ccd62b1d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.988147 25765 tablet_service.cc:1511] Processing CreateTablet for tablet 23cb58e5dadb41a98df57c673e2e1e58 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:21.989567 25765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23cb58e5dadb41a98df57c673e2e1e58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.994676 25764 tablet_service.cc:1511] Processing CreateTablet for tablet 54de093d69a04b5b9ee85140a489e6a5 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:21.996120 25764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54de093d69a04b5b9ee85140a489e6a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.991500 25613 tablet_service.cc:1511] Processing CreateTablet for tablet f07a9badecd84aa2916dd8a6634dc9d5 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:22.000025 25613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07a9badecd84aa2916dd8a6634dc9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.998924 25612 tablet_service.cc:1511] Processing CreateTablet for tablet e57022bbe81346d99427e9761e46c4a2 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:22.002085 25763 tablet_service.cc:1511] Processing CreateTablet for tablet 7012dc39ac8c4464b6c378ccd62b1d1c (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:22.003063 25612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57022bbe81346d99427e9761e46c4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.003418 25763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7012dc39ac8c4464b6c378ccd62b1d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.004163 25761 tablet_service.cc:1511] Processing CreateTablet for tablet e57022bbe81346d99427e9761e46c4a2 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:22.005419 25761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57022bbe81346d99427e9761e46c4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:21.994477 25688 tablet_service.cc:1511] Processing CreateTablet for tablet f07a9badecd84aa2916dd8a6634dc9d5 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:22.008481 25688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07a9badecd84aa2916dd8a6634dc9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.017071 25611 tablet_service.cc:1511] Processing CreateTablet for tablet 654942d43a514fd4b40fd080b5933994 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:22.003067 25762 tablet_service.cc:1511] Processing CreateTablet for tablet f07a9badecd84aa2916dd8a6634dc9d5 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:22.019496 25762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07a9badecd84aa2916dd8a6634dc9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.024670 25690 tablet_service.cc:1511] Processing CreateTablet for tablet e57022bbe81346d99427e9761e46c4a2 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:22.026242 25690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57022bbe81346d99427e9761e46c4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.018483 25611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654942d43a514fd4b40fd080b5933994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.030416 25816 tablet_bootstrap.cc:492] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:22.034339 25760 tablet_service.cc:1511] Processing CreateTablet for tablet 654942d43a514fd4b40fd080b5933994 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:22.034991 25610 tablet_service.cc:1511] Processing CreateTablet for tablet deff8dd285914aa5bfd0ac19f783c492 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:22.036306 25610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deff8dd285914aa5bfd0ac19f783c492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.038546 25687 tablet_service.cc:1511] Processing CreateTablet for tablet deff8dd285914aa5bfd0ac19f783c492 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:22.039880 25687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deff8dd285914aa5bfd0ac19f783c492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.040716 25759 tablet_service.cc:1511] Processing CreateTablet for tablet deff8dd285914aa5bfd0ac19f783c492 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:22.044747 25609 tablet_service.cc:1511] Processing CreateTablet for tablet 663cb94fc0ea4f2980715761c12a0356 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:22.046069 25609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663cb94fc0ea4f2980715761c12a0356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.048583 25759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deff8dd285914aa5bfd0ac19f783c492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.048926 25686 tablet_service.cc:1511] Processing CreateTablet for tablet 663cb94fc0ea4f2980715761c12a0356 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:22.050135 25760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654942d43a514fd4b40fd080b5933994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.051498 25691 tablet_service.cc:1511] Processing CreateTablet for tablet 654942d43a514fd4b40fd080b5933994 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:22.050246 25686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663cb94fc0ea4f2980715761c12a0356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.064065 25691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654942d43a514fd4b40fd080b5933994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.130235 25816 tablet_bootstrap.cc:654] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:22.188030 25509 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.15.90.3:39373, user_credentials={real_user=slave}} blocked reactor thread for 134095us
I20260709 13:22:22.193720 25816 tablet_bootstrap.cc:492] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:22.194288 25816 ts_tablet_manager.cc:1403] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.164s	user 0.008s	sys 0.012s
I20260709 13:22:22.197132 25816 raft_consensus.cc:359] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.197831 25816 raft_consensus.cc:385] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.198117 25816 raft_consensus.cc:740] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.198851 25816 consensus_queue.cc:260] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.213924 25763 tablet_service.cc:1511] Processing CreateTablet for tablet 663cb94fc0ea4f2980715761c12a0356 (DEFAULT_TABLE table=test-workload [id=4a89fb773a3c4bca8576059399746a12]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:22.215304 25763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663cb94fc0ea4f2980715761c12a0356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:22.235052 25817 tablet_bootstrap.cc:492] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:22.236831 25816 ts_tablet_manager.cc:1434] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.042s	user 0.015s	sys 0.013s
I20260709 13:22:22.237725 25801 heartbeater.cc:499] Master 127.15.90.62:37389 was elected leader, sending a full tablet report...
I20260709 13:22:22.237982 25816 tablet_bootstrap.cc:492] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:22.242105 25817 tablet_bootstrap.cc:654] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.248157 25816 tablet_bootstrap.cc:654] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.248432 25815 tablet_bootstrap.cc:492] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:22.268390 25816 tablet_bootstrap.cc:492] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:22.269183 25816 ts_tablet_manager.cc:1403] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.003s
I20260709 13:22:22.272686 25816 raft_consensus.cc:359] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:22.273262 25816 raft_consensus.cc:385] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.273589 25816 raft_consensus.cc:740] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.274128 25817 tablet_bootstrap.cc:492] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:22.274672 25817 ts_tablet_manager.cc:1403] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.005s
I20260709 13:22:22.274516 25816 consensus_queue.cc:260] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:22.276800 25816 ts_tablet_manager.cc:1434] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:22:22.277747 25816 tablet_bootstrap.cc:492] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:22.277796 25817 raft_consensus.cc:359] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.278633 25817 raft_consensus.cc:385] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.278950 25817 raft_consensus.cc:740] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.279785 25817 consensus_queue.cc:260] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.280790 25815 tablet_bootstrap.cc:654] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.284809 25816 tablet_bootstrap.cc:654] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.288605 25652 heartbeater.cc:499] Master 127.15.90.62:37389 was elected leader, sending a full tablet report...
I20260709 13:22:22.289188 25817 ts_tablet_manager.cc:1434] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.004s
I20260709 13:22:22.290156 25815 tablet_bootstrap.cc:492] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:22.290207 25817 tablet_bootstrap.cc:492] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:22.291152 25815 ts_tablet_manager.cc:1403] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.000s
I20260709 13:22:22.294978 25815 raft_consensus.cc:359] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:22.295862 25815 raft_consensus.cc:385] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.296201 25815 raft_consensus.cc:740] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.296705 25816 tablet_bootstrap.cc:492] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:22.297214 25816 ts_tablet_manager.cc:1403] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:22:22.297138 25815 consensus_queue.cc:260] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:22.299857 25727 heartbeater.cc:499] Master 127.15.90.62:37389 was elected leader, sending a full tablet report...
I20260709 13:22:22.300287 25815 ts_tablet_manager.cc:1434] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.008s
I20260709 13:22:22.300655 25816 raft_consensus.cc:359] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.301292 25815 tablet_bootstrap.cc:492] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:22.301388 25816 raft_consensus.cc:385] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.301782 25816 raft_consensus.cc:740] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.302525 25816 consensus_queue.cc:260] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.297273 25817 tablet_bootstrap.cc:654] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.307659 25816 ts_tablet_manager.cc:1434] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:22:22.308138 25815 tablet_bootstrap.cc:654] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.308696 25816 tablet_bootstrap.cc:492] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:22.313938 25815 tablet_bootstrap.cc:492] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:22.314481 25815 ts_tablet_manager.cc:1403] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:22:22.315240 25817 tablet_bootstrap.cc:492] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:22.315766 25817 ts_tablet_manager.cc:1403] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.001s
I20260709 13:22:22.315927 25816 tablet_bootstrap.cc:654] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.317318 25815 raft_consensus.cc:359] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.318068 25815 raft_consensus.cc:385] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.318339 25815 raft_consensus.cc:740] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.318989 25817 raft_consensus.cc:359] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.319298 25815 consensus_queue.cc:260] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.320063 25817 raft_consensus.cc:385] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.320480 25817 raft_consensus.cc:740] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.321568 25817 consensus_queue.cc:260] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.324483 25817 ts_tablet_manager.cc:1434] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:22.325874 25817 tablet_bootstrap.cc:492] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:22.325940 25815 ts_tablet_manager.cc:1434] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:22:22.327137 25815 tablet_bootstrap.cc:492] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:22.335408 25817 tablet_bootstrap.cc:654] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.344422 25815 tablet_bootstrap.cc:654] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.348165 25817 tablet_bootstrap.cc:492] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:22.348771 25817 ts_tablet_manager.cc:1403] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.023s	user 0.022s	sys 0.000s
I20260709 13:22:22.352600 25817 raft_consensus.cc:359] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:22.353382 25817 raft_consensus.cc:385] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.353688 25817 raft_consensus.cc:740] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.354925 25815 tablet_bootstrap.cc:492] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:22.354463 25817 consensus_queue.cc:260] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:22.355419 25815 ts_tablet_manager.cc:1403] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.008s
I20260709 13:22:22.355587 25816 tablet_bootstrap.cc:492] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:22.356587 25817 ts_tablet_manager.cc:1434] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:22:22.357200 25816 ts_tablet_manager.cc:1403] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.017s
I20260709 13:22:22.358530 25817 tablet_bootstrap.cc:492] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:22.359385 25822 raft_consensus.cc:493] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.359611 25815 raft_consensus.cc:359] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.359913 25822 raft_consensus.cc:515] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.360057 25816 raft_consensus.cc:359] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.358536 25825 raft_consensus.cc:493] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.360466 25815 raft_consensus.cc:385] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.361155 25815 raft_consensus.cc:740] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.361220 25825 raft_consensus.cc:515] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.361953 25815 consensus_queue.cc:260] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.364069 25825 leader_election.cc:290] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:22.366001 25817 tablet_bootstrap.cc:654] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.360822 25816 raft_consensus.cc:385] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.368775 25816 raft_consensus.cc:740] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.370070 25816 consensus_queue.cc:260] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.373575 25816 ts_tablet_manager.cc:1434] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:22:22.379438 25816 tablet_bootstrap.cc:492] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:22.380336 25822 leader_election.cc:290] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:22.387787 25816 tablet_bootstrap.cc:654] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.403348 25819 raft_consensus.cc:493] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.404117 25819 raft_consensus.cc:515] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.423225 25819 leader_election.cc:290] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:22.429816 25816 tablet_bootstrap.cc:492] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:22.430528 25816 ts_tablet_manager.cc:1403] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.013s
I20260709 13:22:22.433771 25816 raft_consensus.cc:359] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.440821 25816 raft_consensus.cc:385] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.442543 25816 raft_consensus.cc:740] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.445374 25816 consensus_queue.cc:260] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.446375 25822 raft_consensus.cc:493] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.449317 25822 raft_consensus.cc:515] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.451776 25822 leader_election.cc:290] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:22.460074 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654942d43a514fd4b40fd080b5933994" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:22.461727 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54de093d69a04b5b9ee85140a489e6a5" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
W20260709 13:22:22.463894 25665 leader_election.cc:343] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.467618 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cb94fc0ea4f2980715761c12a0356" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
W20260709 13:22:22.469256 25573 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:22:22.469578 25590 leader_election.cc:343] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 269210845488416d80656a41298e309d (127.15.90.3:39373): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:22.470320 25590 leader_election.cc:343] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 269210845488416d80656a41298e309d (127.15.90.3:39373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.472822 25816 ts_tablet_manager.cc:1434] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 13:22:22.484547 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cb94fc0ea4f2980715761c12a0356" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:22.485731 25816 tablet_bootstrap.cc:492] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d: Bootstrap starting.
W20260709 13:22:22.486205 25593 leader_election.cc:343] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.486670 25593 leader_election.cc:304] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea; no voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff
I20260709 13:22:22.487277 25822 raft_consensus.cc:2749] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:22.482843 25817 tablet_bootstrap.cc:492] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:22.484149 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654942d43a514fd4b40fd080b5933994" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:22.488205 25817 ts_tablet_manager.cc:1403] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.130s	user 0.038s	sys 0.067s
I20260709 13:22:22.487222 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54de093d69a04b5b9ee85140a489e6a5" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:22.488986 25776 raft_consensus.cc:2468] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 0.
I20260709 13:22:22.490250 25665 leader_election.cc:304] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:22.491511 25831 raft_consensus.cc:2804] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.491204 25817 raft_consensus.cc:359] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.491947 25831 raft_consensus.cc:493] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.481392 25815 ts_tablet_manager.cc:1434] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.124s	user 0.027s	sys 0.068s
I20260709 13:22:22.492026 25817 raft_consensus.cc:385] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.492595 25817 raft_consensus.cc:740] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.493320 25815 tablet_bootstrap.cc:492] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:22.493415 25817 consensus_queue.cc:260] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
W20260709 13:22:22.494509 25593 leader_election.cc:343] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.495272 25819 raft_consensus.cc:493] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.496986 25819 raft_consensus.cc:515] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.497675 25817 ts_tablet_manager.cc:1434] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:22:22.498688 25817 tablet_bootstrap.cc:492] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:22.492018 25816 tablet_bootstrap.cc:654] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.492377 25831 raft_consensus.cc:3060] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.499032 25819 leader_election.cc:290] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:22.500252 25593 leader_election.cc:304] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea; no voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff
I20260709 13:22:22.501547 25822 raft_consensus.cc:2749] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:22.502190 25815 tablet_bootstrap.cc:654] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.505750 25817 tablet_bootstrap.cc:654] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.508179 25831 raft_consensus.cc:515] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.510814 25816 tablet_bootstrap.cc:492] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:22.511341 25816 ts_tablet_manager.cc:1403] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.003s
I20260709 13:22:22.511909 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54de093d69a04b5b9ee85140a489e6a5" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:22.512511 25776 raft_consensus.cc:3060] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.514402 25816 raft_consensus.cc:359] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.515121 25816 raft_consensus.cc:385] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.518172 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54de093d69a04b5b9ee85140a489e6a5" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:22.515414 25816 raft_consensus.cc:740] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.520004 25816 consensus_queue.cc:260] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.521360 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a9badecd84aa2916dd8a6634dc9d5" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:22.522225 25816 ts_tablet_manager.cc:1434] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:22:22.523203 25816 tablet_bootstrap.cc:492] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:22.522981 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7012dc39ac8c4464b6c378ccd62b1d1c" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:22.523726 25831 leader_election.cc:290] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
W20260709 13:22:22.525226 25665 leader_election.cc:343] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.523473 25776 raft_consensus.cc:2468] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:22.527213 25665 leader_election.cc:304] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:22.528492 25831 raft_consensus.cc:2804] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.529086 25831 raft_consensus.cc:697] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:22.529392 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7012dc39ac8c4464b6c378ccd62b1d1c" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:22.530114 25831 consensus_queue.cc:237] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.531976 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a9badecd84aa2916dd8a6634dc9d5" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
W20260709 13:22:22.534435 25739 leader_election.cc:343] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:22:22.536657 25739 leader_election.cc:343] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.535053 25819 raft_consensus.cc:493] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.537398 25816 tablet_bootstrap.cc:654] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.537613 25819 raft_consensus.cc:515] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:22.534775 25817 tablet_bootstrap.cc:492] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:22.540226 25817 ts_tablet_manager.cc:1403] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.005s
I20260709 13:22:22.544543 25819 leader_election.cc:290] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483)
I20260709 13:22:22.546766 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:22.547629 25627 raft_consensus.cc:2468] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 0.
I20260709 13:22:22.549489 25739 leader_election.cc:304] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:22.553412 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:22.554183 25701 raft_consensus.cc:2468] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 0.
I20260709 13:22:22.554380 25819 raft_consensus.cc:2804] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.555080 25819 raft_consensus.cc:493] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.553424 25816 tablet_bootstrap.cc:492] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:22.555601 25819 raft_consensus.cc:3060] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.556120 25816 ts_tablet_manager.cc:1403] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.002s
I20260709 13:22:22.556777 25817 raft_consensus.cc:359] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
W20260709 13:22:22.551920 25742 leader_election.cc:343] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.560489 25817 raft_consensus.cc:385] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.560848 25742 leader_election.cc:304] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 269210845488416d80656a41298e309d; no voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff
I20260709 13:22:22.564635 25848 raft_consensus.cc:2749] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:22.561113 25817 raft_consensus.cc:740] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.565659 25816 raft_consensus.cc:359] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.566597 25816 raft_consensus.cc:385] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.567212 25816 raft_consensus.cc:740] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.566424 25817 consensus_queue.cc:260] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
W20260709 13:22:22.568753 25742 leader_election.cc:343] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.569383 25742 leader_election.cc:304] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 269210845488416d80656a41298e309d; no voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff
I20260709 13:22:22.570281 25848 raft_consensus.cc:2749] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:22.572726 25817 ts_tablet_manager.cc:1434] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.004s
I20260709 13:22:22.577015 25817 tablet_bootstrap.cc:492] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:22.577179 25819 raft_consensus.cc:515] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:22.575829 25815 tablet_bootstrap.cc:492] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:22.578213 25815 ts_tablet_manager.cc:1403] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.064s
I20260709 13:22:22.581714 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:22.582321 25627 raft_consensus.cc:3060] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.583734 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:22.584336 25701 raft_consensus.cc:3060] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.588873 25815 raft_consensus.cc:359] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.589674 25815 raft_consensus.cc:385] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.590018 25627 raft_consensus.cc:2468] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:22.591235 25739 leader_election.cc:304] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:22.590144 25815 raft_consensus.cc:740] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.592065 25819 leader_election.cc:290] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483)
I20260709 13:22:22.593389 25817 tablet_bootstrap.cc:654] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.591789 25701 raft_consensus.cc:2468] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:22.592288 25815 consensus_queue.cc:260] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.594642 25524 catalog_manager.cc:5697] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 0 to 1, leader changed from <none> to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 1 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.596637 25815 ts_tablet_manager.cc:1434] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:22:22.592316 25848 raft_consensus.cc:2804] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.597988 25815 tablet_bootstrap.cc:492] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:22.598575 25848 raft_consensus.cc:697] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 1 LEADER]: Becoming Leader. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:22.592700 25816 consensus_queue.cc:260] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.599252 25848 consensus_queue.cc:237] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:22.601269 25817 tablet_bootstrap.cc:492] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:22.601799 25817 ts_tablet_manager.cc:1403] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.003s
I20260709 13:22:22.604936 25817 raft_consensus.cc:359] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.605646 25817 raft_consensus.cc:385] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.605666 25815 tablet_bootstrap.cc:654] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.605734 25831 raft_consensus.cc:493] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.606639 25831 raft_consensus.cc:515] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.606066 25817 raft_consensus.cc:740] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.609071 25831 leader_election.cc:290] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:22.609676 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23cb58e5dadb41a98df57c673e2e1e58" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:22.609447 25817 consensus_queue.cc:260] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.610744 25627 raft_consensus.cc:2468] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 0.
I20260709 13:22:22.612213 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23cb58e5dadb41a98df57c673e2e1e58" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:22.613109 25776 raft_consensus.cc:2468] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 0.
I20260709 13:22:22.614934 25665 leader_election.cc:304] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:22.615540 25817 ts_tablet_manager.cc:1434] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:22:22.616943 25817 tablet_bootstrap.cc:492] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:22.619999 25831 raft_consensus.cc:2804] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.620399 25831 raft_consensus.cc:493] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.620745 25831 raft_consensus.cc:3060] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.621592 25816 ts_tablet_manager.cc:1434] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.065s	user 0.002s	sys 0.009s
I20260709 13:22:22.622992 25816 tablet_bootstrap.cc:492] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:22.631161 25816 tablet_bootstrap.cc:654] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.633713 25831 raft_consensus.cc:515] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.634497 25815 tablet_bootstrap.cc:492] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:22.635109 25815 ts_tablet_manager.cc:1403] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.037s	user 0.024s	sys 0.012s
I20260709 13:22:22.636163 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23cb58e5dadb41a98df57c673e2e1e58" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:22.636780 25627 raft_consensus.cc:3060] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.637156 25817 tablet_bootstrap.cc:654] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.638181 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23cb58e5dadb41a98df57c673e2e1e58" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:22.638837 25776 raft_consensus.cc:3060] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.638407 25815 raft_consensus.cc:359] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.643142 25815 raft_consensus.cc:385] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.643693 25815 raft_consensus.cc:740] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.644124 25627 raft_consensus.cc:2468] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:22.645316 25665 leader_election.cc:304] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:22.644882 25815 consensus_queue.cc:260] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.645720 25776 raft_consensus.cc:2468] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:22.646224 25825 raft_consensus.cc:2804] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.650560 25817 tablet_bootstrap.cc:492] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:22.651064 25817 ts_tablet_manager.cc:1403] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.006s
I20260709 13:22:22.654438 25817 raft_consensus.cc:359] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.655365 25817 raft_consensus.cc:385] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.655757 25817 raft_consensus.cc:740] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.658176 25825 raft_consensus.cc:697] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:22.658993 25816 tablet_bootstrap.cc:492] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:22.658859 25525 catalog_manager.cc:5697] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d reported cstate change: term changed from 0 to 1, leader changed from <none> to 269210845488416d80656a41298e309d (127.15.90.3). New cstate: current_term: 1 leader_uuid: "269210845488416d80656a41298e309d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.659751 25816 ts_tablet_manager.cc:1403] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.007s
I20260709 13:22:22.659163 25825 consensus_queue.cc:237] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.661031 25831 leader_election.cc:290] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:22.661969 25815 ts_tablet_manager.cc:1434] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.027s	user 0.017s	sys 0.000s
I20260709 13:22:22.663142 25815 tablet_bootstrap.cc:492] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:22.664201 25816 raft_consensus.cc:359] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.664893 25816 raft_consensus.cc:385] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.665150 25816 raft_consensus.cc:740] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.665813 25816 consensus_queue.cc:260] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.667886 25816 ts_tablet_manager.cc:1434] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:22:22.668190 25817 consensus_queue.cc:260] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.671475 25815 tablet_bootstrap.cc:654] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.671950 25816 tablet_bootstrap.cc:492] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:22.673134 25817 ts_tablet_manager.cc:1434] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.005s
I20260709 13:22:22.675697 25817 tablet_bootstrap.cc:492] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:22.677481 25816 tablet_bootstrap.cc:654] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.685380 25815 tablet_bootstrap.cc:492] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:22.685958 25815 ts_tablet_manager.cc:1403] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.006s
I20260709 13:22:22.687407 25817 tablet_bootstrap.cc:654] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.688982 25815 raft_consensus.cc:359] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.693547 25816 tablet_bootstrap.cc:492] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:22.693804 25815 raft_consensus.cc:385] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.694186 25815 raft_consensus.cc:740] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.694312 25816 ts_tablet_manager.cc:1403] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.007s
I20260709 13:22:22.695236 25815 consensus_queue.cc:260] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.696404 25522 catalog_manager.cc:5697] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 0 to 1, leader changed from <none> to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 1 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.697842 25815 ts_tablet_manager.cc:1434] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:22:22.698830 25815 tablet_bootstrap.cc:492] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:22.698342 25816 raft_consensus.cc:359] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.699402 25816 raft_consensus.cc:385] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.699837 25816 raft_consensus.cc:740] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.700946 25816 consensus_queue.cc:260] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.705515 25815 tablet_bootstrap.cc:654] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.707752 25816 ts_tablet_manager.cc:1434] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:22:22.720511 25817 tablet_bootstrap.cc:492] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:22.720784 25815 tablet_bootstrap.cc:492] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:22.721124 25817 ts_tablet_manager.cc:1403] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.047s	user 0.027s	sys 0.009s
I20260709 13:22:22.721237 25815 ts_tablet_manager.cc:1403] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 13:22:22.723821 25817 raft_consensus.cc:359] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.724092 25815 raft_consensus.cc:359] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.724505 25817 raft_consensus.cc:385] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.724829 25815 raft_consensus.cc:385] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.724865 25817 raft_consensus.cc:740] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.725232 25815 raft_consensus.cc:740] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.725660 25817 consensus_queue.cc:260] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.725924 25815 consensus_queue.cc:260] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.727762 25817 ts_tablet_manager.cc:1434] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:22:22.728333 25815 ts_tablet_manager.cc:1434] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:22:22.728691 25817 tablet_bootstrap.cc:492] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:22.729286 25815 tablet_bootstrap.cc:492] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:22.734673 25817 tablet_bootstrap.cc:654] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.735826 25815 tablet_bootstrap.cc:654] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.744187 25817 tablet_bootstrap.cc:492] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:22.744215 25815 tablet_bootstrap.cc:492] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:22.744639 25817 ts_tablet_manager.cc:1403] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:22:22.744709 25815 ts_tablet_manager.cc:1403] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 13:22:22.746613 25817 raft_consensus.cc:359] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.746798 25815 raft_consensus.cc:359] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.747113 25817 raft_consensus.cc:385] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.747378 25815 raft_consensus.cc:385] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.747396 25817 raft_consensus.cc:740] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.747674 25815 raft_consensus.cc:740] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.748265 25817 consensus_queue.cc:260] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.748363 25815 consensus_queue.cc:260] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.750106 25817 ts_tablet_manager.cc:1434] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:22:22.750247 25815 ts_tablet_manager.cc:1434] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:22:22.751168 25815 tablet_bootstrap.cc:492] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:22.753093 25848 raft_consensus.cc:493] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.753585 25848 raft_consensus.cc:515] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.755692 25848 leader_election.cc:290] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:22.756472 25815 tablet_bootstrap.cc:654] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:22.756758 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cb94fc0ea4f2980715761c12a0356" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:22.757014 25822 raft_consensus.cc:493] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.757194 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cb94fc0ea4f2980715761c12a0356" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:22.757436 25701 raft_consensus.cc:2468] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 0.
I20260709 13:22:22.757839 25627 raft_consensus.cc:2468] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 0.
I20260709 13:22:22.758780 25742 leader_election.cc:304] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:22.757545 25822 raft_consensus.cc:515] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.759822 25848 raft_consensus.cc:2804] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.760218 25848 raft_consensus.cc:493] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.760546 25848 raft_consensus.cc:3060] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.763011 25822 leader_election.cc:290] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:22.763021 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54de093d69a04b5b9ee85140a489e6a5" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:22.764168 25851 raft_consensus.cc:493] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.764503 25776 raft_consensus.cc:2393] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1a170e0e36e42739a5253a9638242ea in current term 1: Already voted for candidate dd67834e150c49c787fcdda26d893bff in this term.
I20260709 13:22:22.764629 25851 raft_consensus.cc:515] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.766561 25851 leader_election.cc:290] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:22.767280 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654942d43a514fd4b40fd080b5933994" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:22.767980 25627 raft_consensus.cc:2468] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 0.
I20260709 13:22:22.768636 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654942d43a514fd4b40fd080b5933994" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:22.769388 25739 leader_election.cc:304] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
W20260709 13:22:22.770603 25742 leader_election.cc:343] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:22.763021 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54de093d69a04b5b9ee85140a489e6a5" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:22.771582 25851 raft_consensus.cc:2804] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.774261 25851 raft_consensus.cc:493] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.773664 25593 leader_election.cc:304] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea; no voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff
I20260709 13:22:22.774715 25851 raft_consensus.cc:3060] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.775885 25822 raft_consensus.cc:3060] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.782666 25815 tablet_bootstrap.cc:492] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:22.783177 25815 ts_tablet_manager.cc:1403] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.010s
I20260709 13:22:22.783290 25822 raft_consensus.cc:2749] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:22.783561 25848 raft_consensus.cc:515] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.784744 25851 raft_consensus.cc:515] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.785880 25815 raft_consensus.cc:359] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.786562 25815 raft_consensus.cc:385] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:22.786859 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cb94fc0ea4f2980715761c12a0356" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:22.787002 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663cb94fc0ea4f2980715761c12a0356" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:22.787325 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654942d43a514fd4b40fd080b5933994" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:22.787950 25627 raft_consensus.cc:3060] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.788056 25626 raft_consensus.cc:3060] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.787079 25815 raft_consensus.cc:740] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:22.787964 25701 raft_consensus.cc:3060] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.789222 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654942d43a514fd4b40fd080b5933994" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:22.786536 25848 leader_election.cc:290] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:22.789974 25851 leader_election.cc:290] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:22.791008 25815 consensus_queue.cc:260] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.791812 25702 raft_consensus.cc:3060] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.795688 25627 raft_consensus.cc:2468] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:22.795698 25701 raft_consensus.cc:2468] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:22.795751 25626 raft_consensus.cc:2468] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:22.797056 25739 leader_election.cc:304] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:22.798034 25851 raft_consensus.cc:2804] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.798377 25739 leader_election.cc:304] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:22.798504 25851 raft_consensus.cc:697] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 1 LEADER]: Becoming Leader. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:22.799220 25819 raft_consensus.cc:2804] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.799147 25702 raft_consensus.cc:2468] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:22.799841 25819 raft_consensus.cc:697] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 1 LEADER]: Becoming Leader. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:22.799520 25851 consensus_queue.cc:237] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.800668 25819 consensus_queue.cc:237] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.801141 25815 ts_tablet_manager.cc:1434] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:22:22.812124 25825 raft_consensus.cc:493] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.812778 25825 raft_consensus.cc:515] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.812704 25523 catalog_manager.cc:5697] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d reported cstate change: term changed from 0 to 1, leader changed from <none> to 269210845488416d80656a41298e309d (127.15.90.3). New cstate: current_term: 1 leader_uuid: "269210845488416d80656a41298e309d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:22.815044 25825 leader_election.cc:290] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:22.815784 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7012dc39ac8c4464b6c378ccd62b1d1c" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:22.816095 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7012dc39ac8c4464b6c378ccd62b1d1c" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:22.816466 25626 raft_consensus.cc:2468] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 0.
I20260709 13:22:22.816721 25776 raft_consensus.cc:2468] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 0.
I20260709 13:22:22.817461 25665 leader_election.cc:304] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:22.818194 25825 raft_consensus.cc:2804] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.818598 25825 raft_consensus.cc:493] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.818934 25825 raft_consensus.cc:3060] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.824873 25825 raft_consensus.cc:515] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.826306 25825 leader_election.cc:290] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:22.826190 25523 catalog_manager.cc:5697] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d reported cstate change: term changed from 0 to 1, leader changed from <none> to 269210845488416d80656a41298e309d (127.15.90.3). New cstate: current_term: 1 leader_uuid: "269210845488416d80656a41298e309d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:22.827147 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7012dc39ac8c4464b6c378ccd62b1d1c" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:22.827436 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7012dc39ac8c4464b6c378ccd62b1d1c" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:22.827761 25626 raft_consensus.cc:3060] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.828079 25776 raft_consensus.cc:3060] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.833281 25776 raft_consensus.cc:2468] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:22.833791 25626 raft_consensus.cc:2468] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:22.834369 25665 leader_election.cc:304] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:22.835105 25825 raft_consensus.cc:2804] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.835562 25825 raft_consensus.cc:697] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:22.836369 25825 consensus_queue.cc:237] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.843271 25523 catalog_manager.cc:5697] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 0 to 1, leader changed from <none> to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 1 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.869747 25851 raft_consensus.cc:493] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.870294 25851 raft_consensus.cc:515] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.872052 25851 leader_election.cc:290] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:22.872815 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57022bbe81346d99427e9761e46c4a2" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:22.873010 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57022bbe81346d99427e9761e46c4a2" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:22.873457 25626 raft_consensus.cc:2468] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 0.
I20260709 13:22:22.873596 25702 raft_consensus.cc:2468] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 0.
I20260709 13:22:22.874429 25739 leader_election.cc:304] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:22.875190 25851 raft_consensus.cc:2804] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.875497 25851 raft_consensus.cc:493] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.875778 25851 raft_consensus.cc:3060] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.880604 25851 raft_consensus.cc:515] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.882045 25851 leader_election.cc:290] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:22.882805 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57022bbe81346d99427e9761e46c4a2" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:22.882951 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57022bbe81346d99427e9761e46c4a2" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:22.883318 25626 raft_consensus.cc:3060] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.883482 25702 raft_consensus.cc:3060] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.887950 25626 raft_consensus.cc:2468] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:22.888049 25702 raft_consensus.cc:2468] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:22.888902 25739 leader_election.cc:304] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:22.889550 25851 raft_consensus.cc:2804] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.889979 25851 raft_consensus.cc:697] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 1 LEADER]: Becoming Leader. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:22.890694 25851 consensus_queue.cc:237] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.895574 25851 raft_consensus.cc:493] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.896018 25851 raft_consensus.cc:515] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.897500 25851 leader_election.cc:290] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:22.898298 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:22.897625 25523 catalog_manager.cc:5697] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d reported cstate change: term changed from 0 to 1, leader changed from <none> to 269210845488416d80656a41298e309d (127.15.90.3). New cstate: current_term: 1 leader_uuid: "269210845488416d80656a41298e309d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:22.898531 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:22.898896 25626 raft_consensus.cc:2468] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 0.
I20260709 13:22:22.899199 25702 raft_consensus.cc:2468] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 0.
I20260709 13:22:22.899880 25739 leader_election.cc:304] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:22.900660 25851 raft_consensus.cc:2804] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.901017 25851 raft_consensus.cc:493] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.901330 25851 raft_consensus.cc:3060] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.907505 25851 raft_consensus.cc:515] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.909188 25851 leader_election.cc:290] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:22.909817 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:22.910166 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:22.910504 25626 raft_consensus.cc:3060] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.910737 25702 raft_consensus.cc:3060] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.917299 25702 raft_consensus.cc:2468] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:22.917299 25626 raft_consensus.cc:2468] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:22.918341 25742 leader_election.cc:304] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:22.918978 25851 raft_consensus.cc:2804] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.919400 25851 raft_consensus.cc:697] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 1 LEADER]: Becoming Leader. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:22.920171 25851 consensus_queue.cc:237] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.926239 25523 catalog_manager.cc:5697] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d reported cstate change: term changed from 0 to 1, leader changed from <none> to 269210845488416d80656a41298e309d (127.15.90.3). New cstate: current_term: 1 leader_uuid: "269210845488416d80656a41298e309d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:22.933656 25822 raft_consensus.cc:493] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:22.934115 25822 raft_consensus.cc:515] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.935853 25822 leader_election.cc:290] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:22.936368 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a9badecd84aa2916dd8a6634dc9d5" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:22.936775 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a9badecd84aa2916dd8a6634dc9d5" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:22.936964 25702 raft_consensus.cc:2468] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 0.
I20260709 13:22:22.937351 25776 raft_consensus.cc:2468] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 0.
I20260709 13:22:22.937964 25593 leader_election.cc:304] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:22.938760 25822 raft_consensus.cc:2804] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:22.939049 25822 raft_consensus.cc:493] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:22.939311 25822 raft_consensus.cc:3060] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.943900 25822 raft_consensus.cc:515] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.945403 25822 leader_election.cc:290] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:22.946013 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a9badecd84aa2916dd8a6634dc9d5" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:22.946239 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a9badecd84aa2916dd8a6634dc9d5" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:22.946483 25702 raft_consensus.cc:3060] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.946790 25776 raft_consensus.cc:3060] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:22.951093 25702 raft_consensus.cc:2468] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 1.
I20260709 13:22:22.951409 25776 raft_consensus.cc:2468] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 1.
I20260709 13:22:22.952065 25593 leader_election.cc:304] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:22.952934 25822 raft_consensus.cc:2804] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:22.953770 25822 raft_consensus.cc:697] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:22.954500 25822 consensus_queue.cc:237] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:22.961230 25523 catalog_manager.cc:5697] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 0 to 1, leader changed from <none> to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 1 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:22.972046 25825 consensus_queue.cc:1048] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:22.983331 25858 consensus_queue.cc:1048] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.009948 25776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9"
dest_uuid: "269210845488416d80656a41298e309d"
mode: GRACEFUL
new_leader_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:32936
I20260709 13:22:23.010532 25776 raft_consensus.cc:606] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 1 LEADER]: Received request to transfer leadership to TS b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:23.011024 25851 consensus_queue.cc:1048] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.019824 25819 raft_consensus.cc:993] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d: : Instructing follower b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:23.020803 25848 raft_consensus.cc:1081] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 1 LEADER]: Signalling peer b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:23.022943 25627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:46112
I20260709 13:22:23.023425 25627 raft_consensus.cc:493] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.023733 25627 raft_consensus.cc:3060] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.028000 25701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23cb58e5dadb41a98df57c673e2e1e58"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
mode: GRACEFUL
new_leader_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:44144
I20260709 13:22:23.028646 25701 raft_consensus.cc:606] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Received request to transfer leadership to TS b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:23.028646 25851 consensus_queue.cc:1048] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.030927 25627 raft_consensus.cc:515] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:23.033015 25627 leader_election.cc:290] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:23.034019 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:23.035490 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:23.036123 25776 raft_consensus.cc:3055] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.036034 25702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54de093d69a04b5b9ee85140a489e6a5"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
mode: GRACEFUL
new_leader_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:44144
I20260709 13:22:23.036655 25776 raft_consensus.cc:740] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:23.037009 25702 raft_consensus.cc:606] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Received request to transfer leadership to TS b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:23.037170 25626 raft_consensus.cc:1240] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Rejecting Update request from peer 269210845488416d80656a41298e309d for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:23.037518 25776 consensus_queue.cc:260] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:23.039395 25776 raft_consensus.cc:3060] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.043320 25702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7012dc39ac8c4464b6c378ccd62b1d1c"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
mode: GRACEFUL
new_leader_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:44144
I20260709 13:22:23.044164 25702 raft_consensus.cc:606] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Received request to transfer leadership to TS b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:23.045987 25776 raft_consensus.cc:2468] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:23.047147 25590 leader_election.cc:304] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: dd67834e150c49c787fcdda26d893bff
I20260709 13:22:23.048026 25822 raft_consensus.cc:2804] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.048486 25822 raft_consensus.cc:697] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:23.049284 25822 consensus_queue.cc:237] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:23.056349 25524 catalog_manager.cc:5697] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 1 to 2, leader changed from 269210845488416d80656a41298e309d (127.15.90.3) to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 2 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:23.061266 25626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f07a9badecd84aa2916dd8a6634dc9d5"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
mode: GRACEFUL
new_leader_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:46114
I20260709 13:22:23.061810 25626 raft_consensus.cc:606] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Received request to transfer leadership to TS dd67834e150c49c787fcdda26d893bff
I20260709 13:22:23.067878 25776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e57022bbe81346d99427e9761e46c4a2"
dest_uuid: "269210845488416d80656a41298e309d"
mode: GRACEFUL
new_leader_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:32936
I20260709 13:22:23.068403 25776 raft_consensus.cc:606] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 1 LEADER]: Received request to transfer leadership to TS dd67834e150c49c787fcdda26d893bff
I20260709 13:22:23.072868 25776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "654942d43a514fd4b40fd080b5933994"
dest_uuid: "269210845488416d80656a41298e309d"
mode: GRACEFUL
new_leader_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:32936
I20260709 13:22:23.073319 25776 raft_consensus.cc:606] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 1 LEADER]: Received request to transfer leadership to TS dd67834e150c49c787fcdda26d893bff
I20260709 13:22:23.077802 25776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492"
dest_uuid: "269210845488416d80656a41298e309d"
mode: GRACEFUL
new_leader_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:32936
I20260709 13:22:23.078244 25776 raft_consensus.cc:606] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 1 LEADER]: Received request to transfer leadership to TS dd67834e150c49c787fcdda26d893bff
I20260709 13:22:23.182299 25858 consensus_queue.cc:1048] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.191723 25831 consensus_queue.cc:1048] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.198683 25825 raft_consensus.cc:993] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff: : Instructing follower b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:23.199160 25825 raft_consensus.cc:1081] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Signalling peer b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:23.200666 25626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23cb58e5dadb41a98df57c673e2e1e58"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:46100
I20260709 13:22:23.201104 25626 raft_consensus.cc:493] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.201407 25626 raft_consensus.cc:3060] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.206205 25626 raft_consensus.cc:515] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.207816 25626 leader_election.cc:290] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:23.208496 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23cb58e5dadb41a98df57c673e2e1e58" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:23.208881 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23cb58e5dadb41a98df57c673e2e1e58" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:23.209138 25701 raft_consensus.cc:3055] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.209518 25776 raft_consensus.cc:3060] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.209575 25701 raft_consensus.cc:740] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:23.210493 25701 consensus_queue.cc:260] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.211418 25701 raft_consensus.cc:3060] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.215291 25776 raft_consensus.cc:2468] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:23.216298 25590 leader_election.cc:304] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:23.216975 25701 raft_consensus.cc:2468] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:23.217061 25873 raft_consensus.cc:2804] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.217629 25873 raft_consensus.cc:697] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:23.218415 25873 consensus_queue.cc:237] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.224426 25524 catalog_manager.cc:5697] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 1 to 2, leader changed from dd67834e150c49c787fcdda26d893bff (127.15.90.2) to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 2 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:23.261248 25851 consensus_queue.cc:1048] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.267426 25848 raft_consensus.cc:993] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d: : Instructing follower dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:23.267863 25848 raft_consensus.cc:1081] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 1 LEADER]: Signalling peer dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:23.269594 25702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "654942d43a514fd4b40fd080b5933994"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:22:23.270630 25702 raft_consensus.cc:493] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.271037 25702 raft_consensus.cc:3060] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.273650 25851 consensus_queue.cc:1048] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.278584 25702 raft_consensus.cc:515] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.281853 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654942d43a514fd4b40fd080b5933994" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:23.282296 25825 consensus_queue.cc:1048] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.286348 25702 leader_election.cc:290] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:23.286820 25775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654942d43a514fd4b40fd080b5933994" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:23.287473 25775 raft_consensus.cc:3055] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.287804 25775 raft_consensus.cc:740] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:23.288618 25775 consensus_queue.cc:260] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.289918 25775 raft_consensus.cc:3060] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.298380 25775 raft_consensus.cc:2468] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 2.
I20260709 13:22:23.299576 25665 leader_election.cc:304] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:23.300385 25831 raft_consensus.cc:2804] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.300851 25831 raft_consensus.cc:697] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:23.301106 25858 consensus_queue.cc:1048] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.301661 25831 consensus_queue.cc:237] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.308084 25831 raft_consensus.cc:993] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff: : Instructing follower b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:23.308506 25825 raft_consensus.cc:1081] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Signalling peer b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:23.309463 25525 catalog_manager.cc:5697] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 1 to 2, leader changed from 269210845488416d80656a41298e309d (127.15.90.3) to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 2 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:23.312460 25626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7012dc39ac8c4464b6c378ccd62b1d1c"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:46100
I20260709 13:22:23.313073 25626 raft_consensus.cc:493] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.313422 25626 raft_consensus.cc:3060] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.320215 25626 raft_consensus.cc:515] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.321844 25626 leader_election.cc:290] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:23.322513 25702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7012dc39ac8c4464b6c378ccd62b1d1c" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:23.322925 25775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7012dc39ac8c4464b6c378ccd62b1d1c" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:23.323155 25702 raft_consensus.cc:3055] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.323570 25702 raft_consensus.cc:740] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:23.323585 25775 raft_consensus.cc:3060] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.324566 25702 consensus_queue.cc:260] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.325803 25702 raft_consensus.cc:3060] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.330766 25775 raft_consensus.cc:2468] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:23.331925 25590 leader_election.cc:304] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:23.332593 25702 raft_consensus.cc:2468] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:23.332727 25873 raft_consensus.cc:2804] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.333304 25873 raft_consensus.cc:697] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:23.334079 25873 consensus_queue.cc:237] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.339579 25525 catalog_manager.cc:5697] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 1 to 2, leader changed from dd67834e150c49c787fcdda26d893bff (127.15.90.2) to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 2 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:23.344137 25873 consensus_queue.cc:1048] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.351867 25873 consensus_queue.cc:1048] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.361737 25851 consensus_queue.cc:1048] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.368075 25851 consensus_queue.cc:1048] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:23.370358 25873 raft_consensus.cc:993] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea: : Instructing follower dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:23.370851 25873 raft_consensus.cc:1081] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Signalling peer dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:23.372897 25702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f07a9badecd84aa2916dd8a6634dc9d5"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:44132
I20260709 13:22:23.373488 25702 raft_consensus.cc:493] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.373998 25702 raft_consensus.cc:3060] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.381687 25848 consensus_queue.cc:1048] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.383548 25702 raft_consensus.cc:515] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.385782 25702 leader_election.cc:290] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:23.387183 25775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a9badecd84aa2916dd8a6634dc9d5" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:23.387755 25775 raft_consensus.cc:3060] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.392745 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07a9badecd84aa2916dd8a6634dc9d5" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:23.393348 25627 raft_consensus.cc:3055] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.393659 25627 raft_consensus.cc:740] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:23.394445 25627 consensus_queue.cc:260] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.395501 25627 raft_consensus.cc:3060] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.394469 25848 consensus_queue.cc:1048] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:22:23.403450 25627 raft_consensus.cc:2468] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 2.
I20260709 13:22:23.404896 25665 leader_election.cc:304] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:23.405705 25825 raft_consensus.cc:2804] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.406176 25825 raft_consensus.cc:697] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:23.406900 25825 consensus_queue.cc:237] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.407475 25819 raft_consensus.cc:993] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d: : Instructing follower dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:23.407981 25819 raft_consensus.cc:1081] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 1 LEADER]: Signalling peer dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:23.410035 25700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e57022bbe81346d99427e9761e46c4a2"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:22:23.410552 25700 raft_consensus.cc:493] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.410939 25700 raft_consensus.cc:3060] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.420238 25700 raft_consensus.cc:515] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.410558 25775 raft_consensus.cc:2468] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 2.
I20260709 13:22:23.425676 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57022bbe81346d99427e9761e46c4a2" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:23.426286 25626 raft_consensus.cc:3060] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.427640 25700 leader_election.cc:290] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:23.428576 25775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57022bbe81346d99427e9761e46c4a2" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:23.429153 25775 raft_consensus.cc:3055] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.429471 25775 raft_consensus.cc:740] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:23.430271 25775 consensus_queue.cc:260] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.431226 25775 raft_consensus.cc:3060] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.432791 25626 raft_consensus.cc:2468] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 2.
I20260709 13:22:23.434019 25665 leader_election.cc:304] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:23.433624 25524 catalog_manager.cc:5697] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 1 to 2, leader changed from b1a170e0e36e42739a5253a9638242ea (127.15.90.1) to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 2 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:23.434875 25825 raft_consensus.cc:2804] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.435349 25825 raft_consensus.cc:697] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:23.436174 25825 consensus_queue.cc:237] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.437144 25775 raft_consensus.cc:2468] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 2.
I20260709 13:22:23.446833 25523 catalog_manager.cc:5697] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 1 to 2, leader changed from 269210845488416d80656a41298e309d (127.15.90.3) to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 2 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:23.457906 25858 raft_consensus.cc:993] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff: : Instructing follower b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:23.458364 25825 raft_consensus.cc:1081] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Signalling peer b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:23.459808 25626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54de093d69a04b5b9ee85140a489e6a5"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:46100
I20260709 13:22:23.460256 25626 raft_consensus.cc:493] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.460657 25626 raft_consensus.cc:3060] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.465068 25851 consensus_queue.cc:1048] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.466882 25626 raft_consensus.cc:515] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.469842 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54de093d69a04b5b9ee85140a489e6a5" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:23.470005 25851 consensus_queue.cc:1048] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:23.470403 25701 raft_consensus.cc:3055] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.470715 25701 raft_consensus.cc:740] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:23.471496 25701 consensus_queue.cc:260] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.472589 25701 raft_consensus.cc:3060] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.479311 25775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54de093d69a04b5b9ee85140a489e6a5" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:23.481062 25775 raft_consensus.cc:3060] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.481230 25701 raft_consensus.cc:2468] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:23.482093 25626 leader_election.cc:290] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:23.482544 25593 leader_election.cc:304] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:23.484942 25851 raft_consensus.cc:993] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d: : Instructing follower dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:23.485389 25851 raft_consensus.cc:1081] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 1 LEADER]: Signalling peer dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:23.486356 25822 raft_consensus.cc:2804] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.486879 25822 raft_consensus.cc:697] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:23.488710 25822 consensus_queue.cc:237] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.489727 25701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:44138
I20260709 13:22:23.490295 25701 raft_consensus.cc:493] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:23.490669 25701 raft_consensus.cc:3060] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.496276 25701 raft_consensus.cc:515] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.497838 25701 leader_election.cc:290] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:23.498818 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:23.498780 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:23.499574 25627 raft_consensus.cc:3060] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.499696 25776 raft_consensus.cc:3055] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:23.500165 25776 raft_consensus.cc:740] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:23.500407 25775 raft_consensus.cc:2468] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:23.500949 25776 consensus_queue.cc:260] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.502203 25776 raft_consensus.cc:3060] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.506887 25627 raft_consensus.cc:2468] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 2.
I20260709 13:22:23.508061 25665 leader_election.cc:304] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:23.508863 25825 raft_consensus.cc:2804] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:23.509326 25825 raft_consensus.cc:697] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:23.510202 25825 consensus_queue.cc:237] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:23.510908 25776 raft_consensus.cc:2468] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 2.
I20260709 13:22:23.516363 25525 catalog_manager.cc:5697] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 1 to 2, leader changed from 269210845488416d80656a41298e309d (127.15.90.3) to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 2 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:23.522949 25523 catalog_manager.cc:5697] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 1 to 2, leader changed from dd67834e150c49c787fcdda26d893bff (127.15.90.2) to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 2 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:23.547322 25776 raft_consensus.cc:1275] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.548707 25822 consensus_queue.cc:1048] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.556437 25701 raft_consensus.cc:3060] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.563812 25701 raft_consensus.cc:1275] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.564981 25822 consensus_queue.cc:1048] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.674201 25776 raft_consensus.cc:1275] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.675510 25822 consensus_queue.cc:1048] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.686368 25701 raft_consensus.cc:1275] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.687744 25902 consensus_queue.cc:1048] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.717280 25776 raft_consensus.cc:1275] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.718478 25902 consensus_queue.cc:1048] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.725535 25701 raft_consensus.cc:1275] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.727461 25892 consensus_queue.cc:1048] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:22:23.786329 25776 raft_consensus.cc:1275] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.787480 25825 consensus_queue.cc:1048] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.794056 25627 raft_consensus.cc:3060] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:23.801569 25627 raft_consensus.cc:1275] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.802811 25831 consensus_queue.cc:1048] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.909338 25627 raft_consensus.cc:1275] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.910507 25831 consensus_queue.cc:1048] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.916070 25776 raft_consensus.cc:1275] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.917742 25775 raft_consensus.cc:1275] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.920292 25831 consensus_queue.cc:1048] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.920683 25825 consensus_queue.cc:1048] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.929961 25627 raft_consensus.cc:1275] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.931443 25825 consensus_queue.cc:1048] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.948639 25627 raft_consensus.cc:1275] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.949728 25825 consensus_queue.cc:1048] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:23.956749 25776 raft_consensus.cc:1275] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:23.958303 25831 consensus_queue.cc:1048] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:24.017938 25701 raft_consensus.cc:1275] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:24.019173 25892 consensus_queue.cc:1048] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:24.027205 25776 raft_consensus.cc:1275] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:24.032457 25902 consensus_queue.cc:1048] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:26.107333 25523 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50836:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:22:26.109524 25523 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:22:26.157907 25609 tablet_service.cc:1511] Processing CreateTablet for tablet 74b63e14c58c4352a2d834d38e2ebbbd (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:26.159308 25691 tablet_service.cc:1511] Processing CreateTablet for tablet 74b63e14c58c4352a2d834d38e2ebbbd (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:26.159368 25609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b63e14c58c4352a2d834d38e2ebbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.160859 25760 tablet_service.cc:1511] Processing CreateTablet for tablet 74b63e14c58c4352a2d834d38e2ebbbd (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:22:26.160789 25691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b63e14c58c4352a2d834d38e2ebbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.162283 25760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b63e14c58c4352a2d834d38e2ebbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.165057 25612 tablet_service.cc:1511] Processing CreateTablet for tablet 24f9c6e5ff504537a2829336df82c8dc (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:26.165901 25690 tablet_service.cc:1511] Processing CreateTablet for tablet 24f9c6e5ff504537a2829336df82c8dc (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:26.166465 25759 tablet_service.cc:1511] Processing CreateTablet for tablet 24f9c6e5ff504537a2829336df82c8dc (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:22:26.167132 25690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24f9c6e5ff504537a2829336df82c8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.167982 25759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24f9c6e5ff504537a2829336df82c8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.166375 25612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24f9c6e5ff504537a2829336df82c8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.180413 25613 tablet_service.cc:1511] Processing CreateTablet for tablet b8c166f4616e4da79806cbc08b293f3b (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:26.181715 25613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c166f4616e4da79806cbc08b293f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.185611 25761 tablet_service.cc:1511] Processing CreateTablet for tablet b8c166f4616e4da79806cbc08b293f3b (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:26.187141 25761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c166f4616e4da79806cbc08b293f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.189949 25686 tablet_service.cc:1511] Processing CreateTablet for tablet b8c166f4616e4da79806cbc08b293f3b (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:22:26.191339 25686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c166f4616e4da79806cbc08b293f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.200642 25615 tablet_service.cc:1511] Processing CreateTablet for tablet fad28aae4ae94a2db3ba53457d91289a (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:26.202071 25615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad28aae4ae94a2db3ba53457d91289a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.208089 25689 tablet_service.cc:1511] Processing CreateTablet for tablet fad28aae4ae94a2db3ba53457d91289a (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:26.208766 25917 tablet_bootstrap.cc:492] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:26.209461 25689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad28aae4ae94a2db3ba53457d91289a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.216188 25917 tablet_bootstrap.cc:654] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.230449 25763 tablet_service.cc:1511] Processing CreateTablet for tablet fad28aae4ae94a2db3ba53457d91289a (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:22:26.231822 25763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad28aae4ae94a2db3ba53457d91289a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.256716 25918 tablet_bootstrap.cc:492] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:26.259004 25690 tablet_service.cc:1511] Processing CreateTablet for tablet 4a44bb519e4545088211a0b5477850a2 (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:26.259941 25917 tablet_bootstrap.cc:492] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:26.260416 25690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a44bb519e4545088211a0b5477850a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.260492 25917 ts_tablet_manager.cc:1403] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.000s
I20260709 13:22:26.263589 25917 raft_consensus.cc:359] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.265570 25917 raft_consensus.cc:385] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.265854 25917 raft_consensus.cc:740] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.266198 25759 tablet_service.cc:1511] Processing CreateTablet for tablet 4a44bb519e4545088211a0b5477850a2 (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:26.266759 25918 tablet_bootstrap.cc:654] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.266559 25917 consensus_queue.cc:260] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.267717 25759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a44bb519e4545088211a0b5477850a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.271275 25613 tablet_service.cc:1511] Processing CreateTablet for tablet e62e0cbe7be045b396847d4bec3ce26c (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:26.272719 25613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62e0cbe7be045b396847d4bec3ce26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.273016 25691 tablet_service.cc:1511] Processing CreateTablet for tablet e62e0cbe7be045b396847d4bec3ce26c (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:26.274345 25691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62e0cbe7be045b396847d4bec3ce26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.285125 25917 ts_tablet_manager.cc:1434] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.006s
I20260709 13:22:26.288554 25917 tablet_bootstrap.cc:492] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:26.293529 25609 tablet_service.cc:1511] Processing CreateTablet for tablet ff69e0dce1ae45bfa1da5d69c7e5bc4e (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:26.294941 25609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff69e0dce1ae45bfa1da5d69c7e5bc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.294713 25760 tablet_service.cc:1511] Processing CreateTablet for tablet e62e0cbe7be045b396847d4bec3ce26c (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:22:26.296092 25760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62e0cbe7be045b396847d4bec3ce26c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.296619 25615 tablet_service.cc:1511] Processing CreateTablet for tablet 4a44bb519e4545088211a0b5477850a2 (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:22:26.297962 25615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a44bb519e4545088211a0b5477850a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.308789 25686 tablet_service.cc:1511] Processing CreateTablet for tablet ff69e0dce1ae45bfa1da5d69c7e5bc4e (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:26.310139 25686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff69e0dce1ae45bfa1da5d69c7e5bc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.313701 25917 tablet_bootstrap.cc:654] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.318702 25920 tablet_bootstrap.cc:492] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:26.323251 25763 tablet_service.cc:1511] Processing CreateTablet for tablet ff69e0dce1ae45bfa1da5d69c7e5bc4e (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:22:26.323978 25688 tablet_service.cc:1511] Processing CreateTablet for tablet fa552b499e4c4320bc32bc2d1af6c19a (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:26.325349 25688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa552b499e4c4320bc32bc2d1af6c19a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.328013 25612 tablet_service.cc:1511] Processing CreateTablet for tablet fa552b499e4c4320bc32bc2d1af6c19a (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:26.325417 25763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff69e0dce1ae45bfa1da5d69c7e5bc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.329306 25612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa552b499e4c4320bc32bc2d1af6c19a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.348297 25918 tablet_bootstrap.cc:492] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:26.348981 25918 ts_tablet_manager.cc:1403] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.092s	user 0.022s	sys 0.018s
I20260709 13:22:26.352313 25918 raft_consensus.cc:359] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.353087 25918 raft_consensus.cc:385] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.353381 25918 raft_consensus.cc:740] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.354890 25918 consensus_queue.cc:260] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.359577 25920 tablet_bootstrap.cc:654] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.360150 25918 ts_tablet_manager.cc:1434] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:22:26.361528 25918 tablet_bootstrap.cc:492] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:26.375245 25917 tablet_bootstrap.cc:492] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:26.375965 25917 ts_tablet_manager.cc:1403] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.003s
I20260709 13:22:26.381698 25759 tablet_service.cc:1511] Processing CreateTablet for tablet fa552b499e4c4320bc32bc2d1af6c19a (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:22:26.383029 25759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa552b499e4c4320bc32bc2d1af6c19a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.385160 25920 tablet_bootstrap.cc:492] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:26.385646 25920 ts_tablet_manager.cc:1403] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.020s
I20260709 13:22:26.388656 25920 raft_consensus.cc:359] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.389377 25920 raft_consensus.cc:385] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.389662 25920 raft_consensus.cc:740] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
W20260709 13:22:26.389672 25802 tablet.cc:2406] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:22:26.390573 25920 consensus_queue.cc:260] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.393005 25920 ts_tablet_manager.cc:1434] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:22:26.394004 25920 tablet_bootstrap.cc:492] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:26.400110 25920 tablet_bootstrap.cc:654] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.400480 25917 raft_consensus.cc:359] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.401232 25917 raft_consensus.cc:385] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.401432 25918 tablet_bootstrap.cc:654] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.401522 25917 raft_consensus.cc:740] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.410401 25686 tablet_service.cc:1511] Processing CreateTablet for tablet 8d450b339e794efea81195dee35a0e4e (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:26.411667 25686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d450b339e794efea81195dee35a0e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.413601 25918 tablet_bootstrap.cc:492] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:26.417052 25918 ts_tablet_manager.cc:1403] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.003s
I20260709 13:22:26.413736 25761 tablet_service.cc:1511] Processing CreateTablet for tablet 8d450b339e794efea81195dee35a0e4e (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:26.419456 25761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d450b339e794efea81195dee35a0e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.424124 25918 raft_consensus.cc:359] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.425130 25918 raft_consensus.cc:385] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.425487 25918 raft_consensus.cc:740] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.426386 25918 consensus_queue.cc:260] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.413182 25615 tablet_service.cc:1511] Processing CreateTablet for tablet 8d450b339e794efea81195dee35a0e4e (DEFAULT_TABLE table=soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:22:26.428886 25615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d450b339e794efea81195dee35a0e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:22:26.429477 25918 ts_tablet_manager.cc:1434] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:22:26.430753 25918 tablet_bootstrap.cc:492] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:26.411955 25917 consensus_queue.cc:260] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.443397 25918 tablet_bootstrap.cc:654] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.452389 25917 ts_tablet_manager.cc:1434] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.001s
I20260709 13:22:26.453347 25917 tablet_bootstrap.cc:492] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:26.455637 25918 tablet_bootstrap.cc:492] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:26.456151 25918 ts_tablet_manager.cc:1403] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:22:26.458387 25920 tablet_bootstrap.cc:492] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:26.458933 25920 ts_tablet_manager.cc:1403] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.030s
I20260709 13:22:26.459084 25918 raft_consensus.cc:359] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.459851 25918 raft_consensus.cc:385] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.460155 25918 raft_consensus.cc:740] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.460906 25918 consensus_queue.cc:260] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.462390 25920 raft_consensus.cc:359] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.463160 25920 raft_consensus.cc:385] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.463583 25920 raft_consensus.cc:740] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.464391 25920 consensus_queue.cc:260] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.466583 25920 ts_tablet_manager.cc:1434] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:22:26.467483 25920 tablet_bootstrap.cc:492] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:26.463219 25918 ts_tablet_manager.cc:1434] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:22:26.468641 25918 tablet_bootstrap.cc:492] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:26.468977 25917 tablet_bootstrap.cc:654] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.474480 25906 raft_consensus.cc:493] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.474748 25918 tablet_bootstrap.cc:654] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.475080 25920 tablet_bootstrap.cc:654] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.475013 25906 raft_consensus.cc:515] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.477901 25906 leader_election.cc:290] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.479866 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b63e14c58c4352a2d834d38e2ebbbd" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:26.481493 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b63e14c58c4352a2d834d38e2ebbbd" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:26.482065 25776 raft_consensus.cc:2468] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 0.
I20260709 13:22:26.483117 25590 leader_election.cc:304] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
W20260709 13:22:26.484402 25593 leader_election.cc:343] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.485586 25906 raft_consensus.cc:2804] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.492319 25906 raft_consensus.cc:493] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.492874 25906 raft_consensus.cc:3060] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.503333 25906 raft_consensus.cc:515] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.506904 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b63e14c58c4352a2d834d38e2ebbbd" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:26.508369 25906 leader_election.cc:290] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.508500 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b63e14c58c4352a2d834d38e2ebbbd" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
W20260709 13:22:26.509764 25593 leader_election.cc:343] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.510038 25776 raft_consensus.cc:3060] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.510253 25918 tablet_bootstrap.cc:492] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:26.510914 25918 ts_tablet_manager.cc:1403] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.030s
I20260709 13:22:26.511837 25920 tablet_bootstrap.cc:492] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:26.512334 25920 ts_tablet_manager.cc:1403] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.028s
I20260709 13:22:26.512444 25917 tablet_bootstrap.cc:492] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:26.512970 25917 ts_tablet_manager.cc:1403] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.019s
I20260709 13:22:26.514207 25918 raft_consensus.cc:359] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.514981 25918 raft_consensus.cc:385] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.515328 25918 raft_consensus.cc:740] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.515151 25920 raft_consensus.cc:359] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.515957 25920 raft_consensus.cc:385] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.515899 25917 raft_consensus.cc:359] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.516465 25920 raft_consensus.cc:740] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.516786 25917 raft_consensus.cc:385] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.516300 25918 consensus_queue.cc:260] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.517004 25776 raft_consensus.cc:2468] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 1.
I20260709 13:22:26.517374 25920 consensus_queue.cc:260] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.518308 25590 leader_election.cc:304] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: dd67834e150c49c787fcdda26d893bff
I20260709 13:22:26.519462 25918 ts_tablet_manager.cc:1434] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:22:26.519814 25920 ts_tablet_manager.cc:1434] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:22:26.520303 25906 raft_consensus.cc:2804] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.517277 25917 raft_consensus.cc:740] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.520674 25918 tablet_bootstrap.cc:492] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:26.521358 25917 consensus_queue.cc:260] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.523445 25920 tablet_bootstrap.cc:492] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:26.529223 25918 tablet_bootstrap.cc:654] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.529389 25920 tablet_bootstrap.cc:654] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.530875 25917 ts_tablet_manager.cc:1434] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.008s
W20260709 13:22:26.533983 25573 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:22:26.535476 25917 tablet_bootstrap.cc:492] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:26.545423 25917 tablet_bootstrap.cc:654] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.546176 25831 raft_consensus.cc:493] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.546830 25831 raft_consensus.cc:515] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.555578 25906 raft_consensus.cc:697] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:26.555811 25851 raft_consensus.cc:493] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.557497 25851 raft_consensus.cc:515] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.560005 25851 leader_election.cc:290] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:26.565615 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a44bb519e4545088211a0b5477850a2" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:26.565968 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a44bb519e4545088211a0b5477850a2" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
W20260709 13:22:26.567273 25742 leader_election.cc:343] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.567358 25918 tablet_bootstrap.cc:492] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:26.568148 25918 ts_tablet_manager.cc:1403] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.019s
W20260709 13:22:26.568395 25739 leader_election.cc:343] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.569024 25739 leader_election.cc:304] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 269210845488416d80656a41298e309d; no voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff
I20260709 13:22:26.570432 25851 raft_consensus.cc:2749] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:26.567533 25831 leader_election.cc:290] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.572443 25918 raft_consensus.cc:359] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.573434 25918 raft_consensus.cc:385] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.573788 25918 raft_consensus.cc:740] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.574931 25918 consensus_queue.cc:260] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.576542 25906 consensus_queue.cc:237] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.578358 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c166f4616e4da79806cbc08b293f3b" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:26.580106 25918 ts_tablet_manager.cc:1434] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:22:26.581130 25918 tablet_bootstrap.cc:492] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:26.581240 25920 tablet_bootstrap.cc:492] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:26.581720 25920 ts_tablet_manager.cc:1403] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.022s
I20260709 13:22:26.584712 25920 raft_consensus.cc:359] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.585450 25920 raft_consensus.cc:385] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.585755 25920 raft_consensus.cc:740] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.586463 25920 consensus_queue.cc:260] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.588188 25918 tablet_bootstrap.cc:654] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.589411 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c166f4616e4da79806cbc08b293f3b" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:26.589820 25917 tablet_bootstrap.cc:492] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:26.590018 25776 raft_consensus.cc:2468] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 0.
I20260709 13:22:26.590344 25917 ts_tablet_manager.cc:1403] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.012s
I20260709 13:22:26.592890 25665 leader_election.cc:304] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:26.594412 25917 raft_consensus.cc:359] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.596513 25934 raft_consensus.cc:2804] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.596896 25934 raft_consensus.cc:493] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.597201 25934 raft_consensus.cc:3060] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:22:26.597628 25665 leader_election.cc:343] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.595379 25917 raft_consensus.cc:385] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.600811 25917 raft_consensus.cc:740] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.605844 25917 consensus_queue.cc:260] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.605011 25920 ts_tablet_manager.cc:1434] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 13:22:26.609181 25525 catalog_manager.cc:5697] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 0 to 1, leader changed from <none> to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 1 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.609961 25920 tablet_bootstrap.cc:492] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:26.611501 25917 ts_tablet_manager.cc:1434] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:22:26.612614 25917 tablet_bootstrap.cc:492] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:26.614624 25934 raft_consensus.cc:515] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.619050 25934 leader_election.cc:290] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.619271 25920 tablet_bootstrap.cc:654] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.617347 25918 tablet_bootstrap.cc:492] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:26.620014 25918 ts_tablet_manager.cc:1403] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.000s
I20260709 13:22:26.621480 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c166f4616e4da79806cbc08b293f3b" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:26.622076 25776 raft_consensus.cc:3060] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.623068 25918 raft_consensus.cc:359] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.623842 25918 raft_consensus.cc:385] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.624179 25918 raft_consensus.cc:740] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.625128 25851 raft_consensus.cc:493] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.624953 25918 consensus_queue.cc:260] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.625618 25851 raft_consensus.cc:515] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.625957 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c166f4616e4da79806cbc08b293f3b" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:26.626806 25627 raft_consensus.cc:3060] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.629027 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f9c6e5ff504537a2829336df82c8dc" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:26.629880 25626 raft_consensus.cc:2468] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 0.
I20260709 13:22:26.630546 25920 tablet_bootstrap.cc:492] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:26.631080 25920 ts_tablet_manager.cc:1403] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
I20260709 13:22:26.631783 25739 leader_election.cc:304] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:26.634357 25920 raft_consensus.cc:359] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.635076 25920 raft_consensus.cc:385] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.635346 25920 raft_consensus.cc:740] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.635576 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f9c6e5ff504537a2829336df82c8dc" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:26.636031 25920 consensus_queue.cc:260] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.636462 25700 raft_consensus.cc:2468] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 0.
I20260709 13:22:26.638475 25851 leader_election.cc:290] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:26.636461 25776 raft_consensus.cc:2468] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:26.640056 25665 leader_election.cc:304] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:26.640918 25934 raft_consensus.cc:2804] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.641381 25934 raft_consensus.cc:697] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:26.641448 25920 ts_tablet_manager.cc:1434] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:22:26.642567 25920 tablet_bootstrap.cc:492] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:26.642238 25934 consensus_queue.cc:237] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.650689 25917 tablet_bootstrap.cc:654] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.651940 25851 raft_consensus.cc:2804] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.652781 25851 raft_consensus.cc:493] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.653736 25851 raft_consensus.cc:3060] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.639451 25627 raft_consensus.cc:2468] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:26.657748 25920 tablet_bootstrap.cc:654] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.661399 25918 ts_tablet_manager.cc:1434] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.041s	user 0.021s	sys 0.011s
I20260709 13:22:26.662812 25918 tablet_bootstrap.cc:492] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:26.664825 25851 raft_consensus.cc:515] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.667580 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f9c6e5ff504537a2829336df82c8dc" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:26.668217 25627 raft_consensus.cc:3060] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.668433 25917 tablet_bootstrap.cc:492] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:26.669085 25917 ts_tablet_manager.cc:1403] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.002s
I20260709 13:22:26.669621 25524 catalog_manager.cc:5697] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 0 to 1, leader changed from <none> to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 1 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.672801 25917 raft_consensus.cc:359] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.673535 25917 raft_consensus.cc:385] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.674456 25917 raft_consensus.cc:740] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.675814 25627 raft_consensus.cc:2468] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:26.675413 25917 consensus_queue.cc:260] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.677119 25739 leader_election.cc:304] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:26.679105 25917 ts_tablet_manager.cc:1434] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:22:26.679275 25851 leader_election.cc:290] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:26.680083 25851 raft_consensus.cc:2804] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.679965 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f9c6e5ff504537a2829336df82c8dc" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:26.680567 25917 tablet_bootstrap.cc:492] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:26.680688 25851 raft_consensus.cc:697] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 1 LEADER]: Becoming Leader. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:26.673640 25918 tablet_bootstrap.cc:654] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.680691 25700 raft_consensus.cc:3060] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.682001 25851 consensus_queue.cc:237] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.691501 25700 raft_consensus.cc:2468] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 1.
I20260709 13:22:26.694087 25917 tablet_bootstrap.cc:654] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.695174 25906 raft_consensus.cc:493] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.695652 25906 raft_consensus.cc:515] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.697712 25906 leader_election.cc:290] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.699172 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62e0cbe7be045b396847d4bec3ce26c" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:26.700479 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62e0cbe7be045b396847d4bec3ce26c" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:26.701623 25918 tablet_bootstrap.cc:492] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:26.702116 25918 ts_tablet_manager.cc:1403] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.003s
W20260709 13:22:26.702569 25593 leader_election.cc:343] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.700529 25776 raft_consensus.cc:2468] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 0.
I20260709 13:22:26.704237 25590 leader_election.cc:304] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: dd67834e150c49c787fcdda26d893bff
I20260709 13:22:26.705065 25918 raft_consensus.cc:359] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.705507 25906 raft_consensus.cc:2804] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.705828 25918 raft_consensus.cc:385] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.705955 25906 raft_consensus.cc:493] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.706223 25918 raft_consensus.cc:740] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.706379 25906 raft_consensus.cc:3060] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.707472 25918 consensus_queue.cc:260] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.709790 25918 ts_tablet_manager.cc:1434] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:26.710704 25918 tablet_bootstrap.cc:492] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:26.712301 25934 raft_consensus.cc:493] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.712793 25934 raft_consensus.cc:515] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.714521 25906 raft_consensus.cc:515] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.714843 25934 leader_election.cc:290] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.716693 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a44bb519e4545088211a0b5477850a2" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:26.717760 25918 tablet_bootstrap.cc:654] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
W20260709 13:22:26.718242 25665 leader_election.cc:343] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.717808 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a44bb519e4545088211a0b5477850a2" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:26.719385 25776 raft_consensus.cc:2468] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 0.
I20260709 13:22:26.720338 25665 leader_election.cc:304] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:26.711470 25524 catalog_manager.cc:5697] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d reported cstate change: term changed from 0 to 1, leader changed from <none> to 269210845488416d80656a41298e309d (127.15.90.3). New cstate: current_term: 1 leader_uuid: "269210845488416d80656a41298e309d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:26.722196 25906 leader_election.cc:290] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.722533 25934 raft_consensus.cc:2804] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.723070 25934 raft_consensus.cc:493] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.723531 25934 raft_consensus.cc:3060] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.725229 25917 tablet_bootstrap.cc:492] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:26.725756 25917 ts_tablet_manager.cc:1403] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.000s
I20260709 13:22:26.728008 25917 raft_consensus.cc:359] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.728653 25917 raft_consensus.cc:385] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.729207 25917 raft_consensus.cc:740] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.729861 25917 consensus_queue.cc:260] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.730795 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62e0cbe7be045b396847d4bec3ce26c" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:26.731349 25776 raft_consensus.cc:3060] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.737732 25776 raft_consensus.cc:2468] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 1.
I20260709 13:22:26.738437 25920 tablet_bootstrap.cc:492] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:26.739022 25920 ts_tablet_manager.cc:1403] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.097s	user 0.020s	sys 0.024s
I20260709 13:22:26.738878 25590 leader_election.cc:304] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:26.740005 25906 raft_consensus.cc:2804] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.740471 25906 raft_consensus.cc:697] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:26.741255 25906 consensus_queue.cc:237] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.742331 25920 raft_consensus.cc:359] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.743115 25920 raft_consensus.cc:385] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.743458 25920 raft_consensus.cc:740] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.744649 25917 ts_tablet_manager.cc:1434] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:22:26.744436 25920 consensus_queue.cc:260] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.745668 25917 tablet_bootstrap.cc:492] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:26.748414 25920 ts_tablet_manager.cc:1434] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:22:26.749562 25920 tablet_bootstrap.cc:492] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:26.752528 25917 tablet_bootstrap.cc:654] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.755973 25920 tablet_bootstrap.cc:654] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.758545 25918 tablet_bootstrap.cc:492] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:26.759049 25918 ts_tablet_manager.cc:1403] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.049s	user 0.029s	sys 0.016s
I20260709 13:22:26.728636 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62e0cbe7be045b396847d4bec3ce26c" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:26.761901 25700 raft_consensus.cc:3060] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.761633 25918 raft_consensus.cc:359] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.762308 25918 raft_consensus.cc:385] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.762633 25918 raft_consensus.cc:740] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.763374 25918 consensus_queue.cc:260] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.765658 25918 ts_tablet_manager.cc:1434] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:22:26.766521 25918 tablet_bootstrap.cc:492] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d: Bootstrap starting.
I20260709 13:22:26.769469 25917 tablet_bootstrap.cc:492] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:26.769586 25920 tablet_bootstrap.cc:492] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:26.770180 25917 ts_tablet_manager.cc:1403] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 13:22:26.770180 25920 ts_tablet_manager.cc:1403] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.005s
I20260709 13:22:26.772330 25918 tablet_bootstrap.cc:654] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.773500 25920 raft_consensus.cc:359] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.774433 25920 raft_consensus.cc:385] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.773870 25917 raft_consensus.cc:359] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.774752 25920 raft_consensus.cc:740] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.775120 25917 raft_consensus.cc:385] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.775487 25917 raft_consensus.cc:740] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.775568 25920 consensus_queue.cc:260] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.776296 25917 consensus_queue.cc:260] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.778193 25920 ts_tablet_manager.cc:1434] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:22:26.779212 25920 tablet_bootstrap.cc:492] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:26.781610 25917 ts_tablet_manager.cc:1434] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:22:26.782665 25917 tablet_bootstrap.cc:492] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:26.783486 25918 tablet_bootstrap.cc:492] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d: No bootstrap required, opened a new log
I20260709 13:22:26.784022 25918 ts_tablet_manager.cc:1403] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:22:26.785768 25934 raft_consensus.cc:515] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.786609 25918 raft_consensus.cc:359] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.787266 25918 raft_consensus.cc:385] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.787523 25918 raft_consensus.cc:740] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.787912 25934 leader_election.cc:290] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.788363 25918 consensus_queue.cc:260] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.790058 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a44bb519e4545088211a0b5477850a2" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:26.790622 25776 raft_consensus.cc:3060] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.790776 25917 tablet_bootstrap.cc:654] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.788573 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a44bb519e4545088211a0b5477850a2" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:26.791481 25627 raft_consensus.cc:3060] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.790870 25918 ts_tablet_manager.cc:1434] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:22:26.797187 25917 tablet_bootstrap.cc:492] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:26.797646 25917 ts_tablet_manager.cc:1403] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 13:22:26.798976 25776 raft_consensus.cc:2468] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:26.800220 25917 raft_consensus.cc:359] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.801728 25917 raft_consensus.cc:385] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.801586 25665 leader_election.cc:304] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:26.802080 25917 raft_consensus.cc:740] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.802111 25627 raft_consensus.cc:2468] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:26.802513 25934 raft_consensus.cc:2804] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.802886 25917 consensus_queue.cc:260] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.803239 25934 raft_consensus.cc:697] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:26.804177 25934 consensus_queue.cc:237] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.805162 25917 ts_tablet_manager.cc:1434] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:22:26.806090 25917 tablet_bootstrap.cc:492] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea: Bootstrap starting.
I20260709 13:22:26.807799 25935 raft_consensus.cc:493] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.808271 25935 raft_consensus.cc:515] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.810163 25935 leader_election.cc:290] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.811664 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff69e0dce1ae45bfa1da5d69c7e5bc4e" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:26.811934 25917 tablet_bootstrap.cc:654] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.812482 25776 raft_consensus.cc:2468] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 0.
I20260709 13:22:26.813953 25665 leader_election.cc:304] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:26.814695 25935 raft_consensus.cc:2804] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.815045 25935 raft_consensus.cc:493] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.815356 25935 raft_consensus.cc:3060] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.817442 25700 raft_consensus.cc:2468] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 1.
I20260709 13:22:26.822985 25935 raft_consensus.cc:515] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.823539 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff69e0dce1ae45bfa1da5d69c7e5bc4e" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:26.824301 25831 raft_consensus.cc:493] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.824797 25831 raft_consensus.cc:515] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.824915 25627 raft_consensus.cc:2468] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 0.
I20260709 13:22:26.805697 25920 tablet_bootstrap.cc:654] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.826859 25831 leader_election.cc:290] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.828326 25627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad28aae4ae94a2db3ba53457d91289a" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:26.828912 25627 raft_consensus.cc:2468] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 0.
I20260709 13:22:26.829144 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad28aae4ae94a2db3ba53457d91289a" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:26.829730 25776 raft_consensus.cc:2468] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 0.
I20260709 13:22:26.830123 25665 leader_election.cc:304] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:26.830981 25917 tablet_bootstrap.cc:492] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea: No bootstrap required, opened a new log
I20260709 13:22:26.831072 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff69e0dce1ae45bfa1da5d69c7e5bc4e" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:26.831410 25831 raft_consensus.cc:2804] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.831828 25626 raft_consensus.cc:3060] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.831848 25917 ts_tablet_manager.cc:1403] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 13:22:26.832180 25831 raft_consensus.cc:493] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.832839 25831 raft_consensus.cc:3060] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.834645 25906 raft_consensus.cc:493] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.835150 25906 raft_consensus.cc:515] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.836225 25917 raft_consensus.cc:359] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.837106 25906 leader_election.cc:290] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.837190 25917 raft_consensus.cc:385] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.837744 25917 raft_consensus.cc:740] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.838769 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa552b499e4c4320bc32bc2d1af6c19a" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:26.838711 25917 consensus_queue.cc:260] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.839231 25935 leader_election.cc:290] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.839610 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa552b499e4c4320bc32bc2d1af6c19a" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:26.840368 25775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff69e0dce1ae45bfa1da5d69c7e5bc4e" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:26.840965 25775 raft_consensus.cc:3060] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.841461 25917 ts_tablet_manager.cc:1434] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:22:26.841383 25831 raft_consensus.cc:515] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.839352 25776 raft_consensus.cc:2468] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 0.
W20260709 13:22:26.840999 25593 leader_election.cc:343] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.844009 25935 raft_consensus.cc:493] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.844497 25935 raft_consensus.cc:515] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.844688 25590 leader_election.cc:304] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: dd67834e150c49c787fcdda26d893bff
I20260709 13:22:26.844998 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad28aae4ae94a2db3ba53457d91289a" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:26.845641 25625 raft_consensus.cc:3060] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.845821 25906 raft_consensus.cc:2804] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.846261 25906 raft_consensus.cc:493] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.846621 25906 raft_consensus.cc:3060] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.847225 25624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b63e14c58c4352a2d834d38e2ebbbd" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:26.849062 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b63e14c58c4352a2d834d38e2ebbbd" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:26.849344 25935 leader_election.cc:290] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.849762 25776 raft_consensus.cc:2393] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd67834e150c49c787fcdda26d893bff in current term 1: Already voted for candidate b1a170e0e36e42739a5253a9638242ea in this term.
I20260709 13:22:26.850385 25831 leader_election.cc:290] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.853822 25625 raft_consensus.cc:2468] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:26.854871 25665 leader_election.cc:304] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd67834e150c49c787fcdda26d893bff; no voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:26.855181 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad28aae4ae94a2db3ba53457d91289a" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:26.856570 25776 raft_consensus.cc:3060] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.856468 25906 raft_consensus.cc:515] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.846284 25920 tablet_bootstrap.cc:492] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:26.860046 25920 ts_tablet_manager.cc:1403] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.005s
I20260709 13:22:26.861943 25626 raft_consensus.cc:2468] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:26.858400 25525 catalog_manager.cc:5697] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 0 to 1, leader changed from <none> to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 1 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.863147 25920 raft_consensus.cc:359] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.863862 25920 raft_consensus.cc:385] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.864121 25920 raft_consensus.cc:740] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.855885 25775 raft_consensus.cc:2468] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:26.865154 25776 raft_consensus.cc:2468] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 1.
I20260709 13:22:26.867254 25934 raft_consensus.cc:3060] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.867503 25665 leader_election.cc:304] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:26.868575 25665 leader_election.cc:304] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:26.868818 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa552b499e4c4320bc32bc2d1af6c19a" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:26.869566 25906 leader_election.cc:290] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.869726 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa552b499e4c4320bc32bc2d1af6c19a" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
W20260709 13:22:26.870164 25593 leader_election.cc:343] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:22:26.870231 25776 raft_consensus.cc:3060] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.871702 25906 raft_consensus.cc:493] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:26.872197 25906 raft_consensus.cc:515] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.873955 25935 raft_consensus.cc:2804] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.874351 25920 consensus_queue.cc:260] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.874831 25831 raft_consensus.cc:2804] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.876705 25776 raft_consensus.cc:2468] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 1.
I20260709 13:22:26.877660 25934 raft_consensus.cc:2749] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:26.877836 25590 leader_election.cc:304] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: dd67834e150c49c787fcdda26d893bff
I20260709 13:22:26.879218 25931 raft_consensus.cc:2804] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.879925 25931 raft_consensus.cc:697] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:26.879161 25523 catalog_manager.cc:5697] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 0 to 1, leader changed from <none> to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 1 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.880982 25931 consensus_queue.cc:237] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.882382 25831 raft_consensus.cc:697] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:26.883285 25831 consensus_queue.cc:237] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.885902 25935 raft_consensus.cc:697] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:26.886768 25935 consensus_queue.cc:237] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.892864 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d450b339e794efea81195dee35a0e4e" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:26.893725 25776 raft_consensus.cc:2468] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 0.
I20260709 13:22:26.895079 25590 leader_election.cc:304] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:26.895942 25906 leader_election.cc:290] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.896257 25930 raft_consensus.cc:2804] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:22:26.896800 25930 raft_consensus.cc:493] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:22:26.897212 25930 raft_consensus.cc:3060] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.898300 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d450b339e794efea81195dee35a0e4e" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff" is_pre_election: true
I20260709 13:22:26.899029 25700 raft_consensus.cc:2468] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 0.
I20260709 13:22:26.904404 25930 raft_consensus.cc:515] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.906631 25920 ts_tablet_manager.cc:1434] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.018s
I20260709 13:22:26.907596 25920 tablet_bootstrap.cc:492] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff: Bootstrap starting.
I20260709 13:22:26.908469 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d450b339e794efea81195dee35a0e4e" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:26.909137 25700 raft_consensus.cc:3060] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.908629 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d450b339e794efea81195dee35a0e4e" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:26.911127 25776 raft_consensus.cc:3060] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:26.920397 25930 leader_election.cc:290] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:26.921126 25776 raft_consensus.cc:2468] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 1.
I20260709 13:22:26.924482 25920 tablet_bootstrap.cc:654] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff: Neither blocks nor log segments found. Creating new log.
I20260709 13:22:26.919231 25700 raft_consensus.cc:2468] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 1.
I20260709 13:22:26.929365 25590 leader_election.cc:304] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:26.930059 25906 raft_consensus.cc:2804] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:22:26.930469 25906 raft_consensus.cc:697] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:26.931159 25906 consensus_queue.cc:237] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.934648 25920 tablet_bootstrap.cc:492] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff: No bootstrap required, opened a new log
I20260709 13:22:26.934163 25525 catalog_manager.cc:5697] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 0 to 1, leader changed from <none> to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 1 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.935370 25920 ts_tablet_manager.cc:1403] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 13:22:26.939033 25920 raft_consensus.cc:359] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.939988 25920 raft_consensus.cc:385] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:22:26.940400 25920 raft_consensus.cc:740] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Initialized, Role: FOLLOWER
I20260709 13:22:26.941288 25920 consensus_queue.cc:260] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:26.944011 25920 ts_tablet_manager.cc:1434] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:22:26.956754 25523 catalog_manager.cc:5697] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 0 to 1, leader changed from <none> to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 1 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.957955 25523 catalog_manager.cc:5697] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 0 to 1, leader changed from <none> to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 1 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:26.966311 25525 catalog_manager.cc:5697] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 0 to 1, leader changed from <none> to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 1 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.014006 25906 consensus_queue.cc:1048] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.024039 25964 consensus_queue.cc:1048] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.084388 25935 raft_consensus.cc:493] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:22:27.084848 25935 raft_consensus.cc:515] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.086426 25935 leader_election.cc:290] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:27.087150 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa552b499e4c4320bc32bc2d1af6c19a" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1a170e0e36e42739a5253a9638242ea" is_pre_election: true
I20260709 13:22:27.087394 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa552b499e4c4320bc32bc2d1af6c19a" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "269210845488416d80656a41298e309d" is_pre_election: true
I20260709 13:22:27.088199 25776 raft_consensus.cc:2393] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd67834e150c49c787fcdda26d893bff in current term 1: Already voted for candidate b1a170e0e36e42739a5253a9638242ea in this term.
I20260709 13:22:27.089097 25665 leader_election.cc:304] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd67834e150c49c787fcdda26d893bff; no voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:27.089701 25935 raft_consensus.cc:3060] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:22:27.094437 25935 raft_consensus.cc:2749] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:22:27.118198 25776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24f9c6e5ff504537a2829336df82c8dc"
dest_uuid: "269210845488416d80656a41298e309d"
mode: GRACEFUL
new_leader_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:32936
I20260709 13:22:27.118754 25776 raft_consensus.cc:606] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 1 LEADER]: Received request to transfer leadership to TS b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:27.123172 25700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8c166f4616e4da79806cbc08b293f3b"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
mode: GRACEFUL
new_leader_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:44144
I20260709 13:22:27.123646 25700 raft_consensus.cc:606] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Received request to transfer leadership to TS b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:27.128088 25700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fad28aae4ae94a2db3ba53457d91289a"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
mode: GRACEFUL
new_leader_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:44144
I20260709 13:22:27.128531 25700 raft_consensus.cc:606] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Received request to transfer leadership to TS b1a170e0e36e42739a5253a9638242ea
I20260709 13:22:27.135228 25626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e62e0cbe7be045b396847d4bec3ce26c"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
mode: GRACEFUL
new_leader_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:46114
I20260709 13:22:27.135828 25626 raft_consensus.cc:606] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Received request to transfer leadership to TS dd67834e150c49c787fcdda26d893bff
I20260709 13:22:27.142961 25626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa552b499e4c4320bc32bc2d1af6c19a"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
mode: GRACEFUL
new_leader_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:46114
I20260709 13:22:27.143510 25626 raft_consensus.cc:606] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Received request to transfer leadership to TS dd67834e150c49c787fcdda26d893bff
I20260709 13:22:27.147938 25626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d450b339e794efea81195dee35a0e4e"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
mode: GRACEFUL
new_leader_uuid: "269210845488416d80656a41298e309d"
 from {username='slave'} at 127.0.0.1:46114
I20260709 13:22:27.148424 25626 raft_consensus.cc:606] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Received request to transfer leadership to TS 269210845488416d80656a41298e309d
I20260709 13:22:27.215389 25940 consensus_queue.cc:1048] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.217900 25935 consensus_queue.cc:1048] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.224532 25974 raft_consensus.cc:993] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d: : Instructing follower b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:27.225281 25973 raft_consensus.cc:1081] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 1 LEADER]: Signalling peer b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:27.227578 25626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24f9c6e5ff504537a2829336df82c8dc"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:46112
I20260709 13:22:27.228132 25626 raft_consensus.cc:493] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.230468 25626 raft_consensus.cc:3060] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.232110 25974 consensus_queue.cc:1048] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.237423 25626 raft_consensus.cc:515] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.238523 25625 raft_consensus.cc:1240] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Rejecting Update request from peer 269210845488416d80656a41298e309d for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:27.238917 25959 consensus_queue.cc:1048] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.241971 25974 consensus_queue.cc:1059] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.242823 25974 raft_consensus.cc:3055] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.242913 25626 leader_election.cc:290] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:27.243242 25974 raft_consensus.cc:740] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:27.245136 25974 consensus_queue.cc:260] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.246225 25974 raft_consensus.cc:3060] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.246544 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f9c6e5ff504537a2829336df82c8dc" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:27.249082 25775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24f9c6e5ff504537a2829336df82c8dc" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:27.255281 25957 consensus_queue.cc:1048] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.260135 25775 raft_consensus.cc:2468] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:27.265852 25590 leader_election.cc:304] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: dd67834e150c49c787fcdda26d893bff
I20260709 13:22:27.266336 25957 raft_consensus.cc:993] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff: : Instructing follower b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:27.266808 25957 raft_consensus.cc:1081] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Signalling peer b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:27.267685 25964 raft_consensus.cc:2804] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.268196 25964 raft_consensus.cc:697] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:27.269265 25626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8c166f4616e4da79806cbc08b293f3b"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:46100
I20260709 13:22:27.269054 25964 consensus_queue.cc:237] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.269836 25626 raft_consensus.cc:493] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.270200 25626 raft_consensus.cc:3060] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.274829 25959 consensus_queue.cc:1048] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.279655 25626 raft_consensus.cc:515] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.281644 25626 leader_election.cc:290] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:27.282606 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c166f4616e4da79806cbc08b293f3b" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:27.283170 25776 raft_consensus.cc:3060] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.286339 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c166f4616e4da79806cbc08b293f3b" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:27.286908 25700 raft_consensus.cc:3055] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.287184 25700 raft_consensus.cc:740] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:27.287954 25700 consensus_queue.cc:260] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.289199 25700 raft_consensus.cc:3060] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.289978 25776 raft_consensus.cc:2468] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:27.291483 25590 leader_election.cc:304] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:27.292382 25964 raft_consensus.cc:2804] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.291839 25523 catalog_manager.cc:5697] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 1 to 2, leader changed from 269210845488416d80656a41298e309d (127.15.90.3) to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 2 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.292876 25964 raft_consensus.cc:697] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:27.293748 25964 consensus_queue.cc:237] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.294571 25906 consensus_queue.cc:1048] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.296114 25700 raft_consensus.cc:2468] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:27.301563 25964 raft_consensus.cc:993] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea: : Instructing follower dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:27.301976 25931 raft_consensus.cc:1081] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Signalling peer dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:27.304131 25700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e62e0cbe7be045b396847d4bec3ce26c"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:44132
I20260709 13:22:27.304663 25700 raft_consensus.cc:493] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.305022 25700 raft_consensus.cc:3060] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.310047 25964 consensus_queue.cc:1048] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.311905 25700 raft_consensus.cc:515] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.312855 25701 raft_consensus.cc:1240] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Rejecting Update request from peer b1a170e0e36e42739a5253a9638242ea for earlier term 1. Current term is 2. Ops: []
I20260709 13:22:27.313108 25525 catalog_manager.cc:5697] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 1 to 2, leader changed from dd67834e150c49c787fcdda26d893bff (127.15.90.2) to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 2 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.314838 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62e0cbe7be045b396847d4bec3ce26c" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:27.315387 25626 raft_consensus.cc:3055] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.315536 25700 leader_election.cc:290] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:27.315785 25774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62e0cbe7be045b396847d4bec3ce26c" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:27.315755 25626 raft_consensus.cc:740] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:27.319222 25959 consensus_queue.cc:1048] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:22:27.319222 25626 consensus_queue.cc:260] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.320429 25626 raft_consensus.cc:3060] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.327222 25626 raft_consensus.cc:2468] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 2.
I20260709 13:22:27.328286 25665 leader_election.cc:304] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1a170e0e36e42739a5253a9638242ea, dd67834e150c49c787fcdda26d893bff; no voters: 269210845488416d80656a41298e309d
I20260709 13:22:27.329618 25959 raft_consensus.cc:2804] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.330071 25959 raft_consensus.cc:697] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:27.330905 25959 consensus_queue.cc:237] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.334388 25831 consensus_queue.cc:1048] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.344198 25525 catalog_manager.cc:5697] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 1 to 2, leader changed from b1a170e0e36e42739a5253a9638242ea (127.15.90.1) to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 2 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.347745 25934 consensus_queue.cc:1048] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.359023 25935 raft_consensus.cc:993] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff: : Instructing follower b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:27.359499 25959 raft_consensus.cc:1081] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Signalling peer b1a170e0e36e42739a5253a9638242ea to start an election
I20260709 13:22:27.364161 25626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fad28aae4ae94a2db3ba53457d91289a"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
 from {username='slave'} at 127.0.0.1:46100
I20260709 13:22:27.364568 25934 consensus_queue.cc:1048] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.368201 25626 raft_consensus.cc:493] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.368674 25626 raft_consensus.cc:3060] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.371021 25964 consensus_queue.cc:1048] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.376029 25626 raft_consensus.cc:515] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.379081 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad28aae4ae94a2db3ba53457d91289a" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:27.379418 25626 leader_election.cc:290] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:27.379740 25700 raft_consensus.cc:3055] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.380069 25700 raft_consensus.cc:740] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:27.380807 25700 consensus_queue.cc:260] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.382153 25700 raft_consensus.cc:3060] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.383447 25776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad28aae4ae94a2db3ba53457d91289a" candidate_uuid: "b1a170e0e36e42739a5253a9638242ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:27.383952 25776 raft_consensus.cc:3060] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.385324 25964 raft_consensus.cc:993] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea: : Instructing follower 269210845488416d80656a41298e309d to start an election
I20260709 13:22:27.385812 25906 raft_consensus.cc:1081] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Signalling peer 269210845488416d80656a41298e309d to start an election
I20260709 13:22:27.387364 25774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d450b339e794efea81195dee35a0e4e"
dest_uuid: "269210845488416d80656a41298e309d"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:22:27.388571 25774 raft_consensus.cc:493] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.388955 25774 raft_consensus.cc:3060] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.390321 25776 raft_consensus.cc:2468] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:27.391340 25590 leader_election.cc:304] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:27.391165 25931 consensus_queue.cc:1048] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.392673 25931 raft_consensus.cc:2804] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.393133 25931 raft_consensus.cc:697] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Becoming Leader. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:27.393932 25931 consensus_queue.cc:237] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.396394 25774 raft_consensus.cc:515] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.399816 25701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d450b339e794efea81195dee35a0e4e" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:27.400328 25701 raft_consensus.cc:3060] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.400707 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d450b339e794efea81195dee35a0e4e" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:27.401259 25626 raft_consensus.cc:3055] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.401544 25626 raft_consensus.cc:740] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:27.402757 25774 leader_election.cc:290] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [CANDIDATE]: Term 2 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:27.402256 25626 consensus_queue.cc:260] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.404748 25700 raft_consensus.cc:2468] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1a170e0e36e42739a5253a9638242ea in term 2.
I20260709 13:22:27.404981 25626 raft_consensus.cc:3060] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.410264 25626 raft_consensus.cc:2468] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 2.
I20260709 13:22:27.410323 25701 raft_consensus.cc:2468] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 2.
I20260709 13:22:27.411334 25739 leader_election.cc:304] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:27.412303 25974 raft_consensus.cc:2804] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.412757 25974 raft_consensus.cc:697] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 2 LEADER]: Becoming Leader. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:27.413533 25974 consensus_queue.cc:237] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.416996 25524 catalog_manager.cc:5697] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea reported cstate change: term changed from 1 to 2, leader changed from dd67834e150c49c787fcdda26d893bff (127.15.90.2) to b1a170e0e36e42739a5253a9638242ea (127.15.90.1). New cstate: current_term: 2 leader_uuid: "b1a170e0e36e42739a5253a9638242ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.426702 25525 catalog_manager.cc:5697] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d reported cstate change: term changed from 1 to 2, leader changed from b1a170e0e36e42739a5253a9638242ea (127.15.90.1) to 269210845488416d80656a41298e309d (127.15.90.3). New cstate: current_term: 2 leader_uuid: "269210845488416d80656a41298e309d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:27.500106 25906 consensus_queue.cc:1048] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.506250 25931 raft_consensus.cc:993] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea: : Instructing follower dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:27.506714 25964 raft_consensus.cc:1081] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Signalling peer dd67834e150c49c787fcdda26d893bff to start an election
I20260709 13:22:27.509660 25700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa552b499e4c4320bc32bc2d1af6c19a"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
 from {username='slave'} at 127.0.0.1:44132
I20260709 13:22:27.510231 25700 raft_consensus.cc:493] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:27.510607 25700 raft_consensus.cc:3060] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.511348 25931 consensus_queue.cc:1048] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:22:27.517935 25700 raft_consensus.cc:515] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.520474 25626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa552b499e4c4320bc32bc2d1af6c19a" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:27.520982 25626 raft_consensus.cc:3055] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:22:27.521330 25626 raft_consensus.cc:740] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:27.521521 25774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa552b499e4c4320bc32bc2d1af6c19a" candidate_uuid: "dd67834e150c49c787fcdda26d893bff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "269210845488416d80656a41298e309d"
I20260709 13:22:27.522109 25774 raft_consensus.cc:3060] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.522003 25626 consensus_queue.cc:260] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.523103 25626 raft_consensus.cc:3060] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.527179 25774 raft_consensus.cc:2468] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 2.
I20260709 13:22:27.528229 25700 leader_election.cc:290] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), 269210845488416d80656a41298e309d (127.15.90.3:39373)
I20260709 13:22:27.528414 25665 leader_election.cc:304] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:27.529255 25626 raft_consensus.cc:2468] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd67834e150c49c787fcdda26d893bff in term 2.
I20260709 13:22:27.529277 25959 raft_consensus.cc:2804] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:22:27.530012 25959 raft_consensus.cc:697] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Becoming Leader. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:27.530827 25959 consensus_queue.cc:237] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:27.537050 25523 catalog_manager.cc:5697] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff reported cstate change: term changed from 1 to 2, leader changed from b1a170e0e36e42739a5253a9638242ea (127.15.90.1) to dd67834e150c49c787fcdda26d893bff (127.15.90.2). New cstate: current_term: 2 leader_uuid: "dd67834e150c49c787fcdda26d893bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:27.706905 25700 raft_consensus.cc:3060] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.711884 25700 raft_consensus.cc:1275] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.713037 25931 consensus_queue.cc:1048] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.720607 25775 raft_consensus.cc:1275] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.722146 25963 consensus_queue.cc:1048] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.799073 25775 raft_consensus.cc:1275] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.800305 25963 consensus_queue.cc:1048] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.807716 25700 raft_consensus.cc:1275] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.809490 25963 consensus_queue.cc:1048] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.834937 25701 raft_consensus.cc:1275] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.836066 25963 consensus_queue.cc:1048] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.843497 25775 raft_consensus.cc:1275] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer b1a170e0e36e42739a5253a9638242ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.844812 25963 consensus_queue.cc:1048] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.891165 25774 raft_consensus.cc:3060] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:22:27.896240 25774 raft_consensus.cc:1275] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.897416 25934 consensus_queue.cc:1048] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.904789 25626 raft_consensus.cc:1275] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.906141 25935 consensus_queue.cc:1048] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.931357 25626 raft_consensus.cc:1275] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.932889 25935 consensus_queue.cc:1048] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.940640 25775 raft_consensus.cc:1275] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Refusing update from remote peer dd67834e150c49c787fcdda26d893bff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.942270 25935 consensus_queue.cc:1048] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.943977 25626 raft_consensus.cc:1275] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Refusing update from remote peer 269210845488416d80656a41298e309d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.946224 25974 consensus_queue.cc:1048] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:27.959306 25701 raft_consensus.cc:1275] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Refusing update from remote peer 269210845488416d80656a41298e309d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:22:27.960851 25992 consensus_queue.cc:1048] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:22:30.151321 25525 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50836:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:22:30.175094 25525 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:50836:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:22:30.241895 15720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:22:30.401499 25593 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.2:33105, user_credentials={real_user=slave}} blocked reactor thread for 64830.6us
I20260709 13:22:30.472997 25623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9"
dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
mode: GRACEFUL
new_leader_uuid: "269210845488416d80656a41298e309d"
 from {username='slave'} at 127.0.0.1:53206
I20260709 13:22:30.473871 25623 raft_consensus.cc:606] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Received request to transfer leadership to TS 269210845488416d80656a41298e309d
I20260709 13:22:30.472993 26045 tablet.cc:1724] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:30.479655 26041 log.cc:927] Time spent T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.003s
I20260709 13:22:30.484678 26046 tablet.cc:1724] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.504918 26047 tablet.cc:1724] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:30.534963 26034 log.cc:927] Time spent T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:22:30.547257 26039 log.cc:927] Time spent T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:22:30.550566 26038 log.cc:927] Time spent T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:22:30.562120 26059 tablet.cc:1724] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.566794 26054 tablet.cc:1724] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:30.586306 26037 log.cc:927] Time spent T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:22:30.590495 26052 tablet.cc:1724] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:30.609755 26044 log.cc:927] Time spent T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d: Append to log took a long time: real 0.138s	user 0.001s	sys 0.004s
I20260709 13:22:30.614421 26056 tablet.cc:1724] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.614732 26062 tablet.cc:1724] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.642974 26061 tablet.cc:1724] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.659133 26036 raft_consensus.cc:993] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea: : Instructing follower 269210845488416d80656a41298e309d to start an election
I20260709 13:22:30.659812 26036 raft_consensus.cc:1081] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Signalling peer 269210845488416d80656a41298e309d to start an election
I20260709 13:22:30.667936 26058 tablet.cc:1724] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.676994 26064 tablet.cc:1724] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.662135 25772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9"
dest_uuid: "269210845488416d80656a41298e309d"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:22:30.670959 26046 tablet.cc:1724] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.679502 25772 raft_consensus.cc:493] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:30.709903 25772 raft_consensus.cc:3060] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:30.721002 26045 tablet.cc:1724] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.737319 26067 tablet.cc:1724] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.739724 26046 tablet.cc:1724] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.730733 26054 tablet.cc:1724] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.758258 26064 tablet.cc:1724] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.764012 25772 raft_consensus.cc:515] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:30.770586 26045 tablet.cc:1724] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.774659 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:30.775385 25700 raft_consensus.cc:3060] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:30.768402 26059 tablet.cc:1724] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:22:30.769454 25665 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.15.90.1:38483, user_credentials={real_user=slave}} blocked reactor thread for 112069us
I20260709 13:22:30.782804 25699 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492"
dest_uuid: "dd67834e150c49c787fcdda26d893bff"
mode: GRACEFUL
new_leader_uuid: "269210845488416d80656a41298e309d"
 from {username='slave'} at 127.0.0.1:54612
I20260709 13:22:30.782948 25772 leader_election.cc:290] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 3 election: Requested vote from peers dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105), b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483)
I20260709 13:22:30.783386 25699 raft_consensus.cc:606] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Received request to transfer leadership to TS 269210845488416d80656a41298e309d
I20260709 13:22:30.787411 26061 tablet.cc:1724] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.785157 25700 raft_consensus.cc:2468] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 3.
I20260709 13:22:30.791226 25625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5a94445821d4b0d814d79e60a0907e9" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:30.791879 25625 raft_consensus.cc:3055] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:30.759161 26052 tablet.cc:1724] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.792235 25625 raft_consensus.cc:740] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1a170e0e36e42739a5253a9638242ea, State: Running, Role: LEADER
I20260709 13:22:30.793222 25625 consensus_queue.cc:260] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:30.794450 25625 raft_consensus.cc:3060] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:30.795097 26056 tablet.cc:1724] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.798239 26042 raft_consensus.cc:993] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff: : Instructing follower 269210845488416d80656a41298e309d to start an election
I20260709 13:22:30.798727 26042 raft_consensus.cc:1081] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Signalling peer 269210845488416d80656a41298e309d to start an election
I20260709 13:22:30.800050 26046 tablet.cc:1724] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.802304 26058 tablet.cc:1724] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.804530 26067 tablet.cc:1724] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.805452 25774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492"
dest_uuid: "269210845488416d80656a41298e309d"
 from {username='slave'} at 127.0.0.1:32932
I20260709 13:22:30.806033 25774 raft_consensus.cc:493] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:22:30.806399 25774 raft_consensus.cc:3060] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:30.812549 25774 raft_consensus.cc:515] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:30.812953 25742 leader_election.cc:304] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, dd67834e150c49c787fcdda26d893bff; no voters: 
I20260709 13:22:30.813934 26031 raft_consensus.cc:2804] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:30.814390 26031 raft_consensus.cc:697] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 3 LEADER]: Becoming Leader. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:30.815339 26031 consensus_queue.cc:237] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } }
I20260709 13:22:30.815713 25624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1a170e0e36e42739a5253a9638242ea"
I20260709 13:22:30.816447 25624 raft_consensus.cc:3060] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:30.822842 25700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deff8dd285914aa5bfd0ac19f783c492" candidate_uuid: "269210845488416d80656a41298e309d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd67834e150c49c787fcdda26d893bff"
I20260709 13:22:30.823431 25700 raft_consensus.cc:3055] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:22:30.823773 25700 raft_consensus.cc:740] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dd67834e150c49c787fcdda26d893bff, State: Running, Role: LEADER
I20260709 13:22:30.823376 25774 leader_election.cc:290] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 3 election: Requested vote from peers b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483), dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105)
I20260709 13:22:30.824518 25700 consensus_queue.cc:260] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:30.825419 25700 raft_consensus.cc:3060] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:22:30.786031 26054 tablet.cc:1724] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.792004 15720 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:22:30.827858 25624 raft_consensus.cc:2468] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 3.
I20260709 13:22:30.828202 15720 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:22:30.829293 25739 leader_election.cc:304] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 269210845488416d80656a41298e309d, b1a170e0e36e42739a5253a9638242ea; no voters: 
I20260709 13:22:30.830101 25627 raft_consensus.cc:1240] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 3 FOLLOWER]: Rejecting Update request from peer dd67834e150c49c787fcdda26d893bff for earlier term 2. Current term is 3. Ops: []
I20260709 13:22:30.830271 26032 raft_consensus.cc:2804] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:22:30.830857 26032 raft_consensus.cc:697] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 3 LEADER]: Becoming Leader. State: Replica: 269210845488416d80656a41298e309d, State: Running, Role: LEADER
I20260709 13:22:30.831748 26032 consensus_queue.cc:237] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } }
I20260709 13:22:30.833135 25700 raft_consensus.cc:2468] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 3.
I20260709 13:22:30.833871 26062 tablet.cc:1724] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:22:30.842093 25625 raft_consensus.cc:2468] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 269210845488416d80656a41298e309d in term 3.
I20260709 13:22:30.869042 25523 catalog_manager.cc:5697] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d reported cstate change: term changed from 2 to 3, leader changed from b1a170e0e36e42739a5253a9638242ea (127.15.90.1) to 269210845488416d80656a41298e309d (127.15.90.3). New cstate: current_term: 3 leader_uuid: "269210845488416d80656a41298e309d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } }
I20260709 13:22:30.870421 25523 catalog_manager.cc:5697] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d reported cstate change: term changed from 2 to 3, leader changed from dd67834e150c49c787fcdda26d893bff (127.15.90.2) to 269210845488416d80656a41298e309d (127.15.90.3). New cstate: current_term: 3 leader_uuid: "269210845488416d80656a41298e309d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "269210845488416d80656a41298e309d" member_type: VOTER last_known_addr { host: "127.15.90.3" port: 39373 } health_report { overall_health: HEALTHY } } }
I20260709 13:22:30.878111 25524 catalog_manager.cc:6242] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f: soft_deleted_table [id=5bf0076475bd4f908d8e8bab4feae4d7] alter complete (version 1)
I20260709 13:22:31.319130 25700 raft_consensus.cc:1275] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 3 FOLLOWER]: Refusing update from remote peer 269210845488416d80656a41298e309d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:31.320220 26031 consensus_queue.cc:1048] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:31.322789 25625 raft_consensus.cc:1275] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 3 FOLLOWER]: Refusing update from remote peer 269210845488416d80656a41298e309d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:31.324220 26031 consensus_queue.cc:1048] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:22:31.333901 25700 raft_consensus.cc:1275] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 3 FOLLOWER]: Refusing update from remote peer 269210845488416d80656a41298e309d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:31.336153 25992 consensus_queue.cc:1048] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd67834e150c49c787fcdda26d893bff" member_type: VOTER last_known_addr { host: "127.15.90.2" port: 33105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:31.341972 25624 raft_consensus.cc:1275] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 3 FOLLOWER]: Refusing update from remote peer 269210845488416d80656a41298e309d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:22:31.349742 26032 consensus_queue.cc:1048] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1a170e0e36e42739a5253a9638242ea" member_type: VOTER last_known_addr { host: "127.15.90.1" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:22:31.891629 15720 tablet_server.cc:179] TabletServer@127.15.90.1:0 shutting down...
W20260709 13:22:31.907179 25739 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:22:31.912108 25739 consensus_peers.cc:597] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d -> Peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Couldn't send request to peer b1a170e0e36e42739a5253a9638242ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:31.923383 25665 consensus_peers.cc:597] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff -> Peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Couldn't send request to peer b1a170e0e36e42739a5253a9638242ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:31.931087 25665 consensus_peers.cc:597] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff -> Peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Couldn't send request to peer b1a170e0e36e42739a5253a9638242ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:31.932595 25739 consensus_peers.cc:597] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d -> Peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Couldn't send request to peer b1a170e0e36e42739a5253a9638242ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:31.937141 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:31.938022 15720 tablet_replica.cc:333] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.938853 15720 raft_consensus.cc:2243] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:31.939386 15720 raft_consensus.cc:2272] T fa552b499e4c4320bc32bc2d1af6c19a P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.941749 15720 tablet_replica.cc:333] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.942387 15720 raft_consensus.cc:2243] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:31.942831 15720 raft_consensus.cc:2272] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.944960 15720 tablet_replica.cc:333] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.945613 15720 raft_consensus.cc:2243] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:31.946610 15720 raft_consensus.cc:2272] T b8c166f4616e4da79806cbc08b293f3b P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.949635 15720 tablet_replica.cc:333] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.950443 15720 raft_consensus.cc:2243] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:31.951490 15720 raft_consensus.cc:2272] T fad28aae4ae94a2db3ba53457d91289a P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.954402 15720 tablet_replica.cc:333] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
W20260709 13:22:31.954514 25665 consensus_peers.cc:597] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff -> Peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Couldn't send request to peer b1a170e0e36e42739a5253a9638242ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:31.955255 15720 raft_consensus.cc:2243] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:31.956204 15720 raft_consensus.cc:2272] T 54de093d69a04b5b9ee85140a489e6a5 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.958438 15720 tablet_replica.cc:333] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.959015 15720 raft_consensus.cc:2243] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:31.959878 15720 raft_consensus.cc:2272] T 7012dc39ac8c4464b6c378ccd62b1d1c P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.962071 15720 tablet_replica.cc:333] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.962651 15720 raft_consensus.cc:2243] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:31.963054 15720 raft_consensus.cc:2272] T e62e0cbe7be045b396847d4bec3ce26c P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.965199 15720 tablet_replica.cc:333] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.965696 15720 raft_consensus.cc:2243] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:31.966455 15720 raft_consensus.cc:2272] T 23cb58e5dadb41a98df57c673e2e1e58 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.968807 15720 tablet_replica.cc:333] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.969339 15720 raft_consensus.cc:2243] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:31.970079 15720 raft_consensus.cc:2272] T 24f9c6e5ff504537a2829336df82c8dc P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.972213 15720 tablet_replica.cc:333] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.972779 15720 raft_consensus.cc:2243] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:31.973196 15720 raft_consensus.cc:2272] T 654942d43a514fd4b40fd080b5933994 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.975579 15720 tablet_replica.cc:333] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.976140 15720 raft_consensus.cc:2243] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:31.976536 15720 raft_consensus.cc:2272] T f07a9badecd84aa2916dd8a6634dc9d5 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.978811 15720 tablet_replica.cc:333] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.979452 15720 raft_consensus.cc:2243] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:31.979930 15720 raft_consensus.cc:2272] T e57022bbe81346d99427e9761e46c4a2 P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.982079 15720 tablet_replica.cc:333] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.982585 15720 raft_consensus.cc:2243] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:31.982978 15720 raft_consensus.cc:2272] T 4a44bb519e4545088211a0b5477850a2 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.985215 15720 tablet_replica.cc:333] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.986001 15720 raft_consensus.cc:2243] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:31.986442 15720 raft_consensus.cc:2272] T deff8dd285914aa5bfd0ac19f783c492 P b1a170e0e36e42739a5253a9638242ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.989948 15720 tablet_replica.cc:333] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.990512 15720 raft_consensus.cc:2243] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:31.991009 15720 raft_consensus.cc:2272] T 663cb94fc0ea4f2980715761c12a0356 P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.993570 15720 tablet_replica.cc:333] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.994264 15720 raft_consensus.cc:2243] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:31.995215 15720 raft_consensus.cc:2272] T 74b63e14c58c4352a2d834d38e2ebbbd P b1a170e0e36e42739a5253a9638242ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:31.997615 15720 tablet_replica.cc:333] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:31.998158 15720 raft_consensus.cc:2243] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:31.998656 15720 raft_consensus.cc:2272] T 8d450b339e794efea81195dee35a0e4e P b1a170e0e36e42739a5253a9638242ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.000954 15720 tablet_replica.cc:333] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea: stopping tablet replica
I20260709 13:22:32.001616 15720 raft_consensus.cc:2243] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.002103 15720 raft_consensus.cc:2272] T c5a94445821d4b0d814d79e60a0907e9 P b1a170e0e36e42739a5253a9638242ea [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:32.023938 25665 consensus_peers.cc:597] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff -> Peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Couldn't send request to peer b1a170e0e36e42739a5253a9638242ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:32.050136 15720 tablet_server.cc:196] TabletServer@127.15.90.1:0 shutdown complete.
W20260709 13:22:32.052757 25665 consensus_peers.cc:597] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff -> Peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Couldn't send request to peer b1a170e0e36e42739a5253a9638242ea. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:38483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:22:32.070293 25739 consensus_peers.cc:597] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d -> Peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Couldn't send request to peer b1a170e0e36e42739a5253a9638242ea. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:38483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:32.100529 15720 tablet_server.cc:179] TabletServer@127.15.90.2:0 shutting down...
I20260709 13:22:32.136750 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:32.137409 15720 tablet_replica.cc:333] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.138203 15720 raft_consensus.cc:2243] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.139075 15720 raft_consensus.cc:2272] T fa552b499e4c4320bc32bc2d1af6c19a P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.141810 15720 tablet_replica.cc:333] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.142689 15720 raft_consensus.cc:2243] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.143653 15720 raft_consensus.cc:2272] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:32.145107 25665 consensus_peers.cc:597] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff -> Peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Couldn't send request to peer b1a170e0e36e42739a5253a9638242ea. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:38483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:32.146306 15720 tablet_replica.cc:333] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.147032 15720 raft_consensus.cc:2243] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.147483 15720 raft_consensus.cc:2272] T 74b63e14c58c4352a2d834d38e2ebbbd P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.149430 15720 tablet_replica.cc:333] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.149998 15720 raft_consensus.cc:2243] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.150444 15720 raft_consensus.cc:2272] T b8c166f4616e4da79806cbc08b293f3b P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.152374 15720 tablet_replica.cc:333] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.152931 15720 raft_consensus.cc:2243] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.153723 15720 raft_consensus.cc:2272] T f07a9badecd84aa2916dd8a6634dc9d5 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.155750 15720 tablet_replica.cc:333] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.156296 15720 raft_consensus.cc:2243] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.157059 15720 raft_consensus.cc:2272] T 654942d43a514fd4b40fd080b5933994 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.158989 15720 tablet_replica.cc:333] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.159516 15720 raft_consensus.cc:2243] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.159981 15720 raft_consensus.cc:2272] T 663cb94fc0ea4f2980715761c12a0356 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.161875 15720 tablet_replica.cc:333] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.162454 15720 raft_consensus.cc:2243] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.163213 15720 raft_consensus.cc:2272] T e57022bbe81346d99427e9761e46c4a2 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.165016 15720 tablet_replica.cc:333] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.165565 15720 raft_consensus.cc:2243] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.166296 15720 raft_consensus.cc:2272] T 4a44bb519e4545088211a0b5477850a2 P dd67834e150c49c787fcdda26d893bff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.168650 15720 tablet_replica.cc:333] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.169168 15720 raft_consensus.cc:2243] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.169569 15720 raft_consensus.cc:2272] T deff8dd285914aa5bfd0ac19f783c492 P dd67834e150c49c787fcdda26d893bff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.172511 15720 tablet_replica.cc:333] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.173050 15720 raft_consensus.cc:2243] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.173501 15720 raft_consensus.cc:2272] T 24f9c6e5ff504537a2829336df82c8dc P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.175329 15720 tablet_replica.cc:333] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.175859 15720 raft_consensus.cc:2243] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.176576 15720 raft_consensus.cc:2272] T e62e0cbe7be045b396847d4bec3ce26c P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.178375 15720 tablet_replica.cc:333] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.178948 15720 raft_consensus.cc:2243] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.179452 15720 raft_consensus.cc:2272] T 23cb58e5dadb41a98df57c673e2e1e58 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.181461 15720 tablet_replica.cc:333] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.181885 15720 raft_consensus.cc:2243] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.182273 15720 raft_consensus.cc:2272] T 7012dc39ac8c4464b6c378ccd62b1d1c P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.184083 15720 tablet_replica.cc:333] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.184588 15720 raft_consensus.cc:2243] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.184962 15720 raft_consensus.cc:2272] T fad28aae4ae94a2db3ba53457d91289a P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.187034 15720 tablet_replica.cc:333] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.187598 15720 raft_consensus.cc:2243] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.188110 15720 raft_consensus.cc:2272] T 54de093d69a04b5b9ee85140a489e6a5 P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.191052 15720 tablet_replica.cc:333] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.191761 15720 raft_consensus.cc:2243] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:22:32.192215 25739 consensus_peers.cc:597] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d -> Peer b1a170e0e36e42739a5253a9638242ea (127.15.90.1:38483): Couldn't send request to peer b1a170e0e36e42739a5253a9638242ea. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.1:38483: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:32.192304 15720 raft_consensus.cc:2272] T 8d450b339e794efea81195dee35a0e4e P dd67834e150c49c787fcdda26d893bff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.194514 15720 tablet_replica.cc:333] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff: stopping tablet replica
I20260709 13:22:32.195006 15720 raft_consensus.cc:2243] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.195459 15720 raft_consensus.cc:2272] T c5a94445821d4b0d814d79e60a0907e9 P dd67834e150c49c787fcdda26d893bff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.236099 15720 tablet_server.cc:196] TabletServer@127.15.90.2:0 shutdown complete.
W20260709 13:22:32.252409 25742 consensus_peers.cc:597] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d -> Peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Couldn't send request to peer dd67834e150c49c787fcdda26d893bff. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:32.270818 15720 tablet_server.cc:179] TabletServer@127.15.90.3:0 shutting down...
I20260709 13:22:32.310302 15720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:22:32.311347 15720 tablet_replica.cc:333] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.312597 15720 raft_consensus.cc:2243] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.313273 15720 raft_consensus.cc:2272] T fa552b499e4c4320bc32bc2d1af6c19a P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:22:32.313673 25742 consensus_peers.cc:597] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d -> Peer dd67834e150c49c787fcdda26d893bff (127.15.90.2:33105): Couldn't send request to peer dd67834e150c49c787fcdda26d893bff. Status: Network error: Client connection negotiation failed: client connection to 127.15.90.2:33105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:22:32.315912 15720 tablet_replica.cc:333] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.316607 15720 raft_consensus.cc:2243] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.317081 15720 raft_consensus.cc:2272] T ff69e0dce1ae45bfa1da5d69c7e5bc4e P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.319252 15720 tablet_replica.cc:333] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.320109 15720 raft_consensus.cc:2243] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.320618 15720 raft_consensus.cc:2272] T 24f9c6e5ff504537a2829336df82c8dc P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.322757 15720 tablet_replica.cc:333] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.323374 15720 raft_consensus.cc:2243] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.323832 15720 raft_consensus.cc:2272] T b8c166f4616e4da79806cbc08b293f3b P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.325874 15720 tablet_replica.cc:333] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.326508 15720 raft_consensus.cc:2243] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.327015 15720 raft_consensus.cc:2272] T f07a9badecd84aa2916dd8a6634dc9d5 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.329304 15720 tablet_replica.cc:333] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.329955 15720 raft_consensus.cc:2243] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.330425 15720 raft_consensus.cc:2272] T 654942d43a514fd4b40fd080b5933994 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.332633 15720 tablet_replica.cc:333] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.333158 15720 raft_consensus.cc:2243] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.333631 15720 raft_consensus.cc:2272] T 4a44bb519e4545088211a0b5477850a2 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.335654 15720 tablet_replica.cc:333] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.336355 15720 raft_consensus.cc:2243] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.337167 15720 raft_consensus.cc:2272] T deff8dd285914aa5bfd0ac19f783c492 P 269210845488416d80656a41298e309d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.339794 15720 tablet_replica.cc:333] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.340369 15720 raft_consensus.cc:2243] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.340889 15720 raft_consensus.cc:2272] T e57022bbe81346d99427e9761e46c4a2 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.342928 15720 tablet_replica.cc:333] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.343477 15720 raft_consensus.cc:2243] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.344381 15720 raft_consensus.cc:2272] T 663cb94fc0ea4f2980715761c12a0356 P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.346352 15720 tablet_replica.cc:333] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.346891 15720 raft_consensus.cc:2243] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.347357 15720 raft_consensus.cc:2272] T e62e0cbe7be045b396847d4bec3ce26c P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.349390 15720 tablet_replica.cc:333] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.349889 15720 raft_consensus.cc:2243] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.350354 15720 raft_consensus.cc:2272] T 23cb58e5dadb41a98df57c673e2e1e58 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.352347 15720 tablet_replica.cc:333] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.352859 15720 raft_consensus.cc:2243] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.353307 15720 raft_consensus.cc:2272] T 7012dc39ac8c4464b6c378ccd62b1d1c P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.355294 15720 tablet_replica.cc:333] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.355871 15720 raft_consensus.cc:2243] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.356324 15720 raft_consensus.cc:2272] T fad28aae4ae94a2db3ba53457d91289a P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.358328 15720 tablet_replica.cc:333] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.358978 15720 raft_consensus.cc:2243] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.359428 15720 raft_consensus.cc:2272] T 54de093d69a04b5b9ee85140a489e6a5 P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.361474 15720 tablet_replica.cc:333] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.361958 15720 raft_consensus.cc:2243] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:22:32.362460 15720 raft_consensus.cc:2272] T 74b63e14c58c4352a2d834d38e2ebbbd P 269210845488416d80656a41298e309d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.365168 15720 tablet_replica.cc:333] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.365875 15720 raft_consensus.cc:2243] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.367113 15720 raft_consensus.cc:2272] T 8d450b339e794efea81195dee35a0e4e P 269210845488416d80656a41298e309d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.370383 15720 tablet_replica.cc:333] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d: stopping tablet replica
I20260709 13:22:32.370927 15720 raft_consensus.cc:2243] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.372073 15720 raft_consensus.cc:2272] T c5a94445821d4b0d814d79e60a0907e9 P 269210845488416d80656a41298e309d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.414412 15720 tablet_server.cc:196] TabletServer@127.15.90.3:0 shutdown complete.
I20260709 13:22:32.445230 15720 master.cc:562] Master@127.15.90.62:37389 shutting down...
I20260709 13:22:32.470932 15720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:22:32.471527 15720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:22:32.471879 15720 tablet_replica.cc:333] T 00000000000000000000000000000000 P e13c2f78cc724772bc1aaa79b9fbcf2f: stopping tablet replica
I20260709 13:22:32.492069 15720 master.cc:584] Master@127.15.90.62:37389 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11197 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (23200 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (280719 ms total)
[  PASSED  ] 8 tests.
I20260709 13:22:32.546815 15720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 408 messages since previous log ~14 seconds ago
I20260709 13:22:32.547070 15720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 408 messages since previous log ~14 seconds ago
I20260709 13:22:32.547269 15720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 407 messages since previous log ~14 seconds ago
I20260709 13:22:32.547482 15720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:22:32.547670 15720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~31 seconds ago
I20260709 13:22:32.548269 15720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 9 messages since previous log ~170 seconds ago
I20260709 13:22:32.548565 15720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 12 messages since previous log ~0 seconds ago
I20260709 13:22:32.548909 15720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
